Show unit test reports in Gitlab

Gitlab supports generating reports about what unit tests failed, using Pytest output in JUnit XML format.

If this change works, you'll see something like this below:

You can also see a live example on this TTAT MR.

Interestingly, this pipeline appears not to be running the unit tests. Is that by design?

changed the description

added 16 commits

• 36a322df...26480f05 - 15 commits from branch 2.8.4-DEVELOPMENT
• b8d4fe87 - Add rule to unit-test macro to keep JUnit-style XML reports for Gitlab CI integration

Compare with previous version

It's by design, no unit-test job will run unless the code related to it has changed. It seems like maybe they should also run if unit-test.template.yml changes?

Turns out that this is a bad idea because the unit-test.template.yml jobs rely on the build.template.yml jobs to build the services' images beforehand. There might be a way to specify that relationship with the needs parameter, but I don't want to spend too much time on this.

added 1 commit

• 7e1c0417 - Allowed all unit-test CI jobs to run when template changes

Compare with previous version

added 1 commit

• 2301a8c0 - Revert "Allowed all unit-test CI jobs to run when template changes"

Compare with previous version

added 1 commit

• a98e474b - Added test reports to package-build CI jobs

Compare with previous version

added 1 commit

• 9bf66c5a - Drafted fix for reports not being found

Compare with previous version

added 1 commit

• 6475b9e6 - Drafted fix for reports not being found

Compare with previous version

added 1 commit

• 2752e382 - Drafted fix for reports not being found

Compare with previous version

added 22 commits

• 172d98bd...77a55d83 - 15 commits from branch 2.8.4-DEVELOPMENT
• 1b96c67c - Add rule to unit-test macro to keep JUnit-style XML reports for Gitlab CI integration
• 2ac9d5ec - Allowed all unit-test CI jobs to run when template changes
• 78d20f2b - Revert "Allowed all unit-test CI jobs to run when template changes"
• cdd2e461 - Added test reports to package-build CI jobs
• 794e9500 - Drafted fix for reports not being found
• 425f2e71 - Added PACKAGE_NAME to CI config for test reports
• 0067c0d1 - Removed dead code

Compare with previous version

anyone mind if I add service twiddles to see if this works? It would be nice to get this fixed so the other pipelines stop failing

Here's one vote for: please do!

added 1 commit

• 70583e2a - service twiddles for pipeline testing

Compare with previous version

added 1 commit

• caf30655 - Uncommented image weblog delivery

Compare with previous version

added 1 commit

• 54b6a286 - service twiddles for pipeline testing

Compare with previous version

added 1 commit

• 369331ed - fix matrix model

Compare with previous version

added 1 commit

• 6041619f - fix matrix model

Compare with previous version

added 1 commit

• 4af8cfef - fix matrix model

Compare with previous version

added 1 commit

• 2fa2d67b - fix matrix model

Compare with previous version

added 1 commit

• 39f6ede8 - fix matrix model

Compare with previous version

added 1 commit

• ed86a45e - fix matrix model

Compare with previous version

added 1 commit

• 1518bcf7 - fix matrix model

Compare with previous version

added 1 commit

• 12af003d - fix matrix model

Compare with previous version

added 1 commit

• 0696c1f9 - fix matrix model

Compare with previous version

added 1 commit

• ab9413b4 - fix matrix model

Compare with previous version

added 1 commit

• b5befc81 - fix matrix model

Compare with previous version

added 1 commit

• 6c33d9b5 - fix matrix model

Compare with previous version

added 1 commit

• f8f55308 - fix matrix model

Compare with previous version

added 1 commit

• 3ca22a73 - fix matrix model

Compare with previous version

added 1 commit

• 42c7d53b - fix matrix model

Compare with previous version

added 1 commit

• 3b090e7b - fix matrix model

Compare with previous version

added 1 commit

• ec96755c - fix matrix model

Compare with previous version

added 1 commit

• 904026d7 - fix matrix model

Compare with previous version

added 1 commit

• 06b48ecf - fix matrix model

Compare with previous version

added 1 commit

• 2a15625e - fix matrix model

Compare with previous version

added 1 commit

• fc5d133a - fix matrix model

Compare with previous version

added 1 commit

• fb36ccff - fix matrix model

Compare with previous version

It'd be greatly appreciated if you could let me get rid of or squash all these tiny commits before merging.

I'm going to move them out when I get this working

added 1 commit

• 707f9651 - fix matrix model

Compare with previous version

added 1 commit

• c449df58 - fix matrix model

Compare with previous version

added 1 commit

• e12ed2a6 - fix matrix model

Compare with previous version

Ok, now this MR is working all the way through and looks like it's accumulating tests for the ones that ran as expected. I'll revert the matrix testing commits and open a new MR for those. Mind looking over these results first?

None of the tests in shared/ ran, is that what we expect atm? Otherwise the report looks good to me.

Right now nothing can actually run the shared/ tests at all. I have fixes in that other draft pipeline branch to fix that which I want to get back to soon

That would be nice, the new matrix unit tests are under shared/ but they've been helpful running manually for now.

These reports look pretty cool though!

Matrix changes on this branch have been reverted. Objections to merging?

approved this merge request

approved this merge request

unapproved this merge request

approved this merge request

unapproved this merge request

approved this merge request

merged

mentioned in commit 54c9ff2e