Hi,
Testing Farm release 2023-05.1 https://docs.testing-farm.io/general/0.1/releases/2023-05.1.html is deployed 🎉 (TFT-1871 https://issues.redhat.com/browse/TFT-1871).
*🎮 Upgrades*
- tmt https://tmt.readthedocs.io/en/stable/ updated from 1.22 to 1.24 https://github.com/teemtee/tmt/releases/tag/1.24.0, see also release notes for 1.23 https://github.com/teemtee/tmt/releases/tag/1.23.0 - Artemis upgraded to v0.0.57 https://gitlab.com/testing-farm/artemis/-/tags/v0.0.57, improving hardware requirements https://docs.testing-farm.io/general/0.1/test-request.html#hardware
*🎯 Highlights*
- Testing Farm CLI https://docs.testing-farm.io/general/0.1/cli.html reserve command available, for easy provisioning of a single machine from Testing Farm. (TFT-2073 https://issues.redhat.com/browse/TFT-2073) (DevConf mini-demo https://youtu.be/nS0Z1OilOas?t=18474)
- Non-RHEL teams are onboarding to Testing Farm, see for example strizmi-kafk2a-operator https://github.com/strimzi/strimzi-kafka-operator/blob/main/systemtest/tmt/README.md. (fedoramagazine blog post https://fedoramagazine.org/how-to-use-testing-farm-outside-of-rhel/)
- Support for customizing global timeout for a request. Default is 12 hours. (TFT-1763 https://issues.redhat.com/browse/TFT-1763)
- Support for private GIT repositories, the username and password can be passed directly in the git url and are properly treated as secrets. ( TFT-1656 https://issues.redhat.com/browse/TFT-1656)
- Support for tests filtering via the API request. (TFT-1993 https://issues.redhat.com/browse/TFT-1993) (docs https://docs.testing-farm.io/general/0.1/test-request.html#tmt)
- Support for installing only certain packages from a repository. ( TFT-2070 https://issues.redhat.com/browse/TFT-2070)
- Support for merge request refs for GitLab and GitHub. (TFT-1578 https://issues.redhat.com/browse/TFT-1578)
- Metrics for average queue time available for Red Hat and Public Ranch available. (TFT-1764 https://issues.redhat.com/browse/TFT-1764) (link http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m )
- Kickstart support for Beaker provisioner, on par with kickstart support in the Beaker XML. (TFT-1395 https://issues.redhat.com/browse/TFT-1395) (thanks to Martin Litwora / sst_upgrades)
- Support for different location of tmt metadata root in the git repositories. (TFT-1706 https://issues.redhat.com/browse/TFT-1706)
- Artemis can now detect spot instances pre-maturely terminated. ( TFT-1888 https://issues.redhat.com/browse/TFT-1888)
- TESTING_FARM_REQUEST_ID environment variable exposed to tests. ( TFT-2044 https://issues.redhat.com/browse/TFT-2044) (Thanks to Lukas Kotek / KVM QE)
- Support for tuning Beaker watchdog timeout in Artemis. (TFT-1949 https://issues.redhat.com/browse/TFT-1949) (Thanks to Martin Litwora / sst_upgrades)
- Testing Farm CLI run command available, to easily run small shell snippets in Testing Farm. (TFT-2019 https://issues.redhat.com/browse/TFT-2019)
*🐞 Bugfixes*
- Excluding of packages for repository and copr build artifacts properly works now. (TFT-977 https://issues.redhat.com/browse/TFT-977)
- Compose and arch are not part of the plan name anymore in the JUnit XML. Oculus Improved to show compose and arch below the plan name. ( TFT-1810 https://issues.redhat.com/browse/TFT-1810)
- Multiple fixes for dnf5 which landed in Fedora Rawhide. Zuul PR testing disabled due to dnf5/issues/549 https://github.com/rpm-software-management/dnf5/issues/549.
- Non-printable characters in results-junit.xml are now properly handled (TFT-2039 https://issues.redhat.com/browse/TFT-2039).
- Plans with non-standard characters supported. (TFT-1881 https://issues.redhat.com/browse/TFT-1881)
- Test machine's hostname, FQDN and reverse DNS records are now properly resolvable. (TFT-1987 https://issues.redhat.com/browse/TFT-1987)
- Improved stability of aarch64 in AWS by using non-spot instances. ( TFT-2080 https://issues.redhat.com/browse/TFT-2080)
*🔍 Statistics*
- Error rate ~ 3.69% in May http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=12&orgId=1&from=1682892000000&to=1685570399000 - ~ 56k testing requests in May http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=8&orgId=1&from=1682892000000&to=1685570399000 - Average queued time ~24 second in Public http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=26&orgId=1&from=1684792800000&to=1687557599000, ~5 minutes in Red Hat http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=27&orgId=1&from=now-30d&to=now in th last month
https://issues.redhat.com/browse/TFT-1761 https://issues.redhat.com/browse/TFT-1761On behalf of the Testing Farm Team, Miroslav Vadkerti
-- Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE IRC mvadkert #tft #tmt #osci :: Mobile +420 773 944 252 Remote Czech Republic :: Red Hat Czech s.r.o
Small correction, the subject is incorrect, we updated to tmt-1.24 at last, sorry about that.
/M
On Fri, Jun 23, 2023 at 10:33 AM Miroslav Vadkerti mvadkert@redhat.com wrote:
Hi,
Testing Farm release 2023-05.1 https://docs.testing-farm.io/general/0.1/releases/2023-05.1.html is deployed 🎉 (TFT-1871 https://issues.redhat.com/browse/TFT-1871).
*🎮 Upgrades*
- tmt https://tmt.readthedocs.io/en/stable/ updated from 1.22 to 1.24
https://github.com/teemtee/tmt/releases/tag/1.24.0, see also release notes for 1.23 https://github.com/teemtee/tmt/releases/tag/1.23.0
- Artemis upgraded to v0.0.57
https://gitlab.com/testing-farm/artemis/-/tags/v0.0.57, improving hardware requirements https://docs.testing-farm.io/general/0.1/test-request.html#hardware
*🎯 Highlights*
- Testing Farm CLI https://docs.testing-farm.io/general/0.1/cli.html reserve
command available, for easy provisioning of a single machine from Testing Farm. (TFT-2073 https://issues.redhat.com/browse/TFT-2073) (DevConf mini-demo https://youtu.be/nS0Z1OilOas?t=18474)
- Non-RHEL teams are onboarding to Testing Farm, see for example
strizmi-kafk2a-operator https://github.com/strimzi/strimzi-kafka-operator/blob/main/systemtest/tmt/README.md. (fedoramagazine blog post https://fedoramagazine.org/how-to-use-testing-farm-outside-of-rhel/)
- Support for customizing global timeout for a request. Default is 12
hours. (TFT-1763 https://issues.redhat.com/browse/TFT-1763)
- Support for private GIT repositories, the username and password can
be passed directly in the git url and are properly treated as secrets. ( TFT-1656 https://issues.redhat.com/browse/TFT-1656)
- Support for tests filtering via the API request. (TFT-1993
https://issues.redhat.com/browse/TFT-1993) (docs https://docs.testing-farm.io/general/0.1/test-request.html#tmt)
- Support for installing only certain packages from a repository. (
TFT-2070 https://issues.redhat.com/browse/TFT-2070)
- Support for merge request refs for GitLab and GitHub. (TFT-1578
https://issues.redhat.com/browse/TFT-1578)
- Metrics for average queue time available for Red Hat and Public
Ranch available. (TFT-1764 https://issues.redhat.com/browse/TFT-1764) (link http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?orgId=1&refresh=1m )
- Kickstart support for Beaker provisioner, on par with kickstart
support in the Beaker XML. (TFT-1395 https://issues.redhat.com/browse/TFT-1395) (thanks to Martin Litwora / sst_upgrades)
- Support for different location of tmt metadata root in the git
repositories. (TFT-1706 https://issues.redhat.com/browse/TFT-1706)
- Artemis can now detect spot instances pre-maturely terminated. (
TFT-1888 https://issues.redhat.com/browse/TFT-1888)
- TESTING_FARM_REQUEST_ID environment variable exposed to tests. (
TFT-2044 https://issues.redhat.com/browse/TFT-2044) (Thanks to Lukas Kotek / KVM QE)
- Support for tuning Beaker watchdog timeout in Artemis. (TFT-1949
https://issues.redhat.com/browse/TFT-1949) (Thanks to Martin Litwora / sst_upgrades)
- Testing Farm CLI run command available, to easily run small shell
snippets in Testing Farm. (TFT-2019 https://issues.redhat.com/browse/TFT-2019)
*🐞 Bugfixes*
- Excluding of packages for repository and copr build artifacts
properly works now. (TFT-977 https://issues.redhat.com/browse/TFT-977 )
- Compose and arch are not part of the plan name anymore in the JUnit
XML. Oculus Improved to show compose and arch below the plan name. ( TFT-1810 https://issues.redhat.com/browse/TFT-1810)
- Multiple fixes for dnf5 which landed in Fedora Rawhide. Zuul PR
testing disabled due to dnf5/issues/549 https://github.com/rpm-software-management/dnf5/issues/549.
- Non-printable characters in results-junit.xml are now properly
handled (TFT-2039 https://issues.redhat.com/browse/TFT-2039).
- Plans with non-standard characters supported. (TFT-1881
https://issues.redhat.com/browse/TFT-1881)
- Test machine's hostname, FQDN and reverse DNS records are now
properly resolvable. (TFT-1987 https://issues.redhat.com/browse/TFT-1987)
- Improved stability of aarch64 in AWS by using non-spot instances. (
TFT-2080 https://issues.redhat.com/browse/TFT-2080)
*🔍 Statistics*
- Error rate ~ 3.69% in May
- ~ 56k testing requests in May
- Average queued time ~24 second in Public
http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=26&orgId=1&from=1684792800000&to=1687557599000, ~5 minutes in Red Hat http://metrics.osci.redhat.com/d/NnHWU1dnz/testing-farm?viewPanel=27&orgId=1&from=now-30d&to=now in th last month
https://issues.redhat.com/browse/TFT-1761 https://issues.redhat.com/browse/TFT-1761On behalf of the Testing Farm Team, Miroslav Vadkerti
-- Miroslav Vadkerti :: Senior Principal QE :: Testing Farm / Linux QE IRC mvadkert #tft #tmt #osci :: Mobile +420 773 944 252 Remote Czech Republic :: Red Hat Czech s.r.o