Hi,
Testing Farm release 2024-10.5 was deployed on 2024-12-17 đ.
*đ Breaking Changes*
The result.xunit field was removed from the API. Please use result.xunit_url and download the xUnit output instead.
The Testing Farm CLI v0.0.21 has changed parsing of key=value options, which can break in certain cases. See the documentation </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc#multiple-kv> for more details.
Tests defined directly under the discover step using the shell method are now sorted alphabetically. If you rely on specific order in which tests are executed, use explicitly the order attribute as a workaround. This change will be fixed in the next release. <#user-content-upgrades>đ Upgrades
Testing Farm CLI </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/cli.adoc> tool updated to v0.0.22 https://gitlab.com/testing-farm/cli/-/releases/v0.0.22, please update your installation.
Artemis https://gitlab.com/testing-farm/artemis/ was updated to v0.0.72 https://gitlab.com/testing-farm/artemis/-/releases/v0.0.72 on both ranches.
tmt https://tmt.readthedocs.org was updated to 1.39 https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-39, see also release notes for 1.36 https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36, 1.37 https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-36 and 1.38 https://tmt.readthedocs.io/en/stable/releases.html#tmt-1-38.
fmf https://fmf.readthedocs.org was updated to 1.5 https://fmf.readthedocs.io/en/stable/releases.html#fmf-1-5-0. đŻ Highlights
Testing Farm onboarding to Red Hat ranch is now self service using Red Hat Employee SSO. See the onboarding documentation </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/onboarding.adoc> for more information.
Preliminary support for Image Mode for RHEL-9.6.0, Fedora-40 and CentOS-Stream 9 is available. Read more about the support and possible use cases in our RFD5 </testing-farm/docs/root/-/blob/76b2ee79bed589660d86805e35e7fc5d01218bd2/rfd/rfd5-testing-image-mode.adoc>.
Reservations in Public ranch do not require an ssh proxy anymore and you can directly connect to the provisioned machines and access all the ports. (TFT-2678 https://issues.redhat.com/browse/TFT-2678)
Support for dedicated (non-spot) AWS instances was added in Red Hat ranch. This can help with stability of long-running tests and prevents pre-mature test machine termination by AWS. See official documentation for details how to enable this for your requests </testing-farm/docs/root/76b2ee79bed589660d86805e35e7fc5d01218bd2/test-request.adoc#_tags>.
*đ Improvements*
The TMT_SSH_* options can now be set by the requests in the environments[].tmt.environment field.This can help to workaround unstable network conditions for certain Beaker labs. (TFT-2936 https://issues.redhat.com/browse/TFT-2936)
For plans the tmt running log is shown during execution. (TFT-2845 https://issues.redhat.com/browse/TFT-2845)
The tmt plans workdir is exposed during tests execution. (TFT-2740 https://issues.redhat.com/browse/TFT-2740)
The poweruser role was introduced, making it possible to cancel any job on Testing Farm. Improves the experience for teams using automation accounts. (TFT-2706 https://issues.redhat.com/browse/TFT-2706) *đ Bugfixes*
Bug causing failed jobs reported as passed in some corner cases was fixed. (TFT-2847 https://issues.redhat.com/browse/TFT-2847)
Fix the long-term problem with archiving, causing occasionally incomplete logs. (TFT-2750 https://issues.redhat.com/browse/TFT-2750)
Fix "Artemis API call failed: Condition 'api_call' failed to pass within given time" occasional error. (TFT-2734 https://issues.redhat.com/browse/TFT-2734)
Fixed a problem when very long secrets would not be hidden in the logs. (TFT-2698 https://issues.redhat.com/browse/TFT-2698)
Fix a problem when the hiding of secrets in logs was currupting yaml files. (TFT-2487 https://issues.redhat.com/browse/TFT-2487) <#user-content-%EF%B8%8F-packages>đŚď¸ Packages
List of important packages bundled in the worker image.
⯠podman run --entrypoint rpm quay.io/testing-farm/worker-public:2024-10.5 -q fmf tmt standard-test-roles ansible-core podman beakerlib | sort | uniqansible-core-2.16.12-1.fc40.noarchbeakerlib-1.31.3-1.fc40.noarchfmf-1.5.0-1.fc40.noarchpodman-5.3.1-1.fc40.x86_64standard-test-roles-4.11-3.fc40.noarchtmt-1.39.0-1.fc40.noarch
đ Stats
Testing Farm is on track to surpass 1.33M requests per year https://stats.testing-farm.io/d/dpYooDIVk/testing-farm-all-time-stats \o/.
The average error rate for Testing Farm was approximately 3.10% http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m&from=now-30d&to=now&viewPanel=12. On the behalf of the Testing Farm Team, /M