Queued / running test status visible in Bodhi
by Adam Williamson
Hi folks! I already mentioned this in a devel@ thread, but Miro
suggested pointing it out here too to make sure folks are aware.
With Bodhi 7.1.1 deployed into production recently, queued/running
tests are now shown as such in Bodhi. Previously, tests that were
required for gating but which had not yet finished were shown as
"missing" - the gating status referred to them as such, and they got a
row on the Automated Results tab which had a red background and wasn't
clickable (as we had no idea where a link should go).
Now, so long as the test system reported a "result" with outcome QUEUED
or RUNNING, the test will show up as such in Bodhi. The gating status
summary now refers to running tests as such, and they (even non-gating
ones) get a row on the Automated Results tab with a *blue* background
that is clickable. (It should also have an hourglass icon, but I messed
up the icon names, so that doesn't work in 7.1.1; when
https://github.com/fedora-infra/bodhi/pull/5187 is merged and reaches
deployment, that will be fixed).
Hopefully this will make things less confusing for folks.
I believe Fedora CI reports the correct "results" for all test
executions. openQA reports QUEUED in *most* cases; it does not yet
report RUNNING (so openQA tests will show as queued until they're
finished). It doesn't report QUEUED when a failed test is auto-
restarted; I'm going to fix that upstream, I just didn't get the
roundtuits yet. When that happens, the gating status will be failed and
the test will show as failed in Bodhi until the rerun completes.
See attached screenshot for an example of how it looks right now.
--
Adam Williamson (he/him/his)
Fedora QA
Fedora Chat: @adamwill:fedora.im | Mastodon: @adamw(a)fosstodon.org
https://www.happyassassin.net
7 months, 4 weeks