• nous@programming.dev
    link
    fedilink
    English
    arrow-up
    10
    ·
    3 days ago

    One problem is GHs auto-merge when ready button. It will merge when there are still tests running unless they are required. It would be much better if the auto merges took into account all checks and not just required ones.

    • Voytrekk@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      12
      ·
      3 days ago

      It tests passing is a requirement of merging, then you should set the tests as required.

      • nous@programming.dev
        link
        fedilink
        English
        arrow-up
        2
        ·
        3 days ago

        If you have folderA and folderB each with their own set of tests. You don’t need folderAs tests to run with a change to folderB. Most CI/CD systems can do this easily enough with two different reports. But you cannot mark them both as required as they both wont always run. Instead you need a complicated fan out pipelines in your CICD system so you can only have one report back to GH or you need to always spawn a job for both folders and have the ones that dont need to run return successful. Neither of these is very good and becomes very complex when you are working with large monorepos.

        It would be much better if the CICD system that knows which pipelines it needs to run for a given PR could tell GH about which tests are required for a particular PR and if you could configure GH to wait for that report from the CICD system. Or at the very least if the auto-merge was blocked for any failed checks and the manual merge button was only blocked on required checks.

        • Voytrekk@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          3
          ·
          2 days ago

          You can have certain jobs run based on what directories or files were modified. If projectA was the only one modified, it can run just projectA’s tests.

          • nous@programming.dev
            link
            fedilink
            English
            arrow-up
            1
            ·
            2 days ago

            Yes. They can. But they do not mix well with required checks. From githubs own documentation:

            If a workflow is skipped due to path filtering, branch filtering or a commit message, then checks associated with that workflow will remain in a “Pending” state. A pull request that requires those checks to be successful will be blocked from merging.

            If, however, a job within a workflow is skipped due to a conditional, it will report its status as “Success”. For more information, see Using conditions to control job execution.

            So even with github actions you cannot mix a required check and path/branch or any filtering on a workflow as the jobs will hang forever and you will never be able to merge the branch in. You can do either or, but not both at once and for larger complex projects you tend to want to do both. But instead you need complex complex workflows or workflows that always start and instead do internal checks to detect if they need to actually run or not. And this is with github actions - it is worst for external CICD tooling.