Skip to content

System tests: Restructure and cleanup the tests.yaml#799

Merged
MakisH merged 6 commits into
developfrom
testsuites-cleanup
May 27, 2026
Merged

System tests: Restructure and cleanup the tests.yaml#799
MakisH merged 6 commits into
developfrom
testsuites-cleanup

Conversation

@MakisH
Copy link
Copy Markdown
Member

@MakisH MakisH commented May 27, 2026

Description

The tests.yaml has evolved a bit chaotically. This PR structures the file in the following way:

test_suites:
  elastic-tube-1d:
    tutorials:
      - &elastic-tube-1d_fluid-cpp_solid-cpp
        path: elastic-tube-1d
        case_combination:
          - fluid-cpp
          - solid-cpp
        reference_result: ./elastic-tube-1d/reference-results/fluid-cpp_solid-cpp.tar.gz
      - &elastic-tube-1d_fluid-cpp_solid-python
        ...

  release_test:
    tutorials:
      - *elastic-tube-1d_fluid-cpp_solid-cpp
      - *elastic-tube-1d_fluid-cpp_solid-python
      ...

  calculix-adapter:
    tutorials:
      - *flow-over-heated-plate-two-meshes_fluid-openfoam_solid-calculix
      ...

Conventions:

  • Test suites follow the name of the respective tutorial or repository
  • Tests suites append the entries of the case_combination, separated by underscore
  • Test suites and tests are sorted alphabetically
  • Every test suite for a component includes by default all test cases that use that component.
    Skipped components are still mentioned in a comment.

The release_test stays as-is, to not have to change workflows in other repositories.

Triggered system tests (with the latest components): https://github.com/precice/tutorials/actions/runs/26500173873 -> Works

Supercedes #775, as it does not only reduce duplication, but it also structures the file.

Closes #767

Checklist

  • I updated the system tests documentation
  • I added a summary of any user-facing changes (compared to the last release) in the changelog-entries/<PRnumber>.md.
  • After merging:
    • Update the respective adapters: Updated the OpenFOAM and DuMux adapters. I think no other adapter uses a system tests workflow at the moment.

@MakisH MakisH self-assigned this May 27, 2026
MakisH added a commit to precice/dumux-adapter that referenced this pull request May 27, 2026
Related to (and requires) precice/tutorials#799

@Fujikawas Should we also update the `MICRO_MANAGER_REF`?
@MakisH MakisH merged commit f19be4d into develop May 27, 2026
1 check passed
@MakisH MakisH deleted the testsuites-cleanup branch May 27, 2026 09:19
MakisH added a commit to precice/openfoam-adapter that referenced this pull request May 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Duplication in tests.yaml

1 participant