Testing Farm release 2023-11.1 https://docs.testing-farm.io/Testing%20Farm/0.1/releases/2023-11.1.html is deployed ๐.
๐ฎ *Upgrades*
Artemis https://gitlab.com/testing-farm/artemis upgraded from v0.0.65 to v0.0.66 https://gitlab.com/testing-farm/artemis/-/releases/v0.0.66.
Testing Farm CLI tool updated from v0.0.14 to v0.0.15 https://gitlab.com/testing-farm/cli/-/releases/v0.0.15, please update your installation for the new features to work.
๐ฏ *Highlights*
Test checks from tmt are now properly displayed in Testing Farm results. ( TFT-1666 https://issues.redhat.com/browse/TFT-1666)
Provisioning retries can be disabled and provisioning errors can be treated as test failures. (TFT-2202 https://issues.redhat.com/browse/TFT-2202)
It is now possible to set a backlink to a userโs CI system or service via the API. (TFT-1452 https://issues.redhat.com/browse/TFT-1452)
Testing Farm now supports Red Hat CoreOS images. (TFT-1697 https://issues.redhat.com/browse/TFT-1697)
Debug and event logs from Flasher, used to provision RHIVOS devices, are now exposed in the test runs. (TFT-2247 https://issues.redhat.com/browse/TFT-2247)
The CLI tool now supports printing only request ID in its reserve command. ( TFT-2249 https://issues.redhat.com/browse/TFT-2249)
Polarion and ReportPortal integration is now documented https://docs.testing-farm.io/Testing%20Farm/0.1/test-request.html#_reporting in Testing Farm docs. (TFT-2263 https://issues.redhat.com/browse/TFT-2263)
The skip test result outcome is now supported. (TFT-2282 https://issues.redhat.com/browse/TFT-2282)
๐ *Bugfixes*
RHEL repositories in Beaker provisioned machines now use rhel- prefix. ( TFT-2098 https://issues.redhat.com/browse/TFT-2098)
The tmt-reboot command now works during Testing Farm reservations https://docs.testing-farm.io/Testing%20Farm/0.1/cli.html#reserve. ( TFT-2217 https://issues.redhat.com/browse/TFT-2217)
Kernel parameters can be now passed via Testing Farm API. (TFT-2376 https://issues.redhat.com/browse/TFT-2376)
Testing Farm sets tmt context during plan export. (TFT-2383 https://issues.redhat.com/browse/TFT-2383)
Console logs are now enabled in Public ranch. (TFT-2378 https://issues.redhat.com/browse/TFT-2378)
๐ซ *Contributors*
We would like to thank the following external contributors for contributing to Testing Farm.
- Ed Santiago - for contributing to our CLI tool
๐ฆ๏ธ *Packages* List of important packages bundled in the worker image.
โฏ podman run --entrypoint rpm quay.io/testing-farm/worker:2023-11.1 -q tmt standard-test-roles ansible-core podman beakerlib | sort | uniq ansible-core-2.14.11-1.fc38.noarch beakerlib-1.29.3-2.fc38.noarch podman-4.7.2-1.fc38.x86_64 standard-test-roles-4.11-2.fc38.noarch tmt-1.29.0-1.fc38.noarch
๐ *Statistics*
Testing Farm has passed 725k requests https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats?orgId=1&viewPanel=7 per year \o/
Error rate ~ 2.67% from start of November http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=12&orgId=1&from=1698793200000&to=1701385200000
~ 64k testing requests in November http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=8&orgId=1&from=1698793200000&to=1701385200000
Average queue time 20.3s http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=26&orgId=1&from=1698793200000&to=1701385200000 on Public ranch, 12.1s http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=27&orgId=1&from=1698793200000&to=1701385200000 on Red Hat ranch from the start of October.
On the behalf of the Testing Farm Team, /M
-- ๐งโ๐ง Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE ๐ฉ Red Hat Slack :: mvadkert :: #testing-farm #tmt ๐ฑ Fedora Matrix :: mvadkert :: #Fedora CI ๐๏ธ Remote Czech Republic :: Red Hat Czech s.r.o