Planned Outage - build systems ( koji, osbs, mbs, src, pdc, kojipkgs, odcs, registriy) - 2021-11-09 17:00 UTC
There will be an outage starting at 2021-11-09 17:00 UTC, which will last approximately 4 hours.
To convert UTC to your local time, take a look at http://fedoraproject.org/wiki/Infrastructure/UTCHowto or run:
date -d '2021-11-09 17:00UTC'
Reason for outage:
We will be doing several maint tasks during this outage:
All the s390x builders will be moving from the current z13 maintframe to a z15 mainframe.
koji hub and builders will be updated from 1.25.1 to 1.26.1
Updates will be applied to all build servers and reboots done to the latest kernel.
Maintainers are advised to avoid starting builds before the outage that won't complete before the outage is over. Some builds may restart or need to be resubmitted if they are running during the maint window.
Affected Services:
koji (both hub and builders) mbs - module build service odcs - on demand compose service osbs - openshift build service pdc - product def center src - dist-git/pagure kojipkgs - pkgs stored on koji registry - container registries
Ticket Link:
https://pagure.io/fedora-infrastructure/issue/10302
Please join #fedora-admin or #fedora-noc on irc.libera.chat or add comments to the ticket for this outage above.
_______________________________________________ devel-announce mailing list -- devel-announce@lists.fedoraproject.org To unsubscribe send an email to devel-announce-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel-announce@lists.fedorapro... Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
Hello Kevin,
On Fri, Nov 5, 2021 at 2:26 PM Kevin Fenzi kevin@scrye.com wrote:
Planned Outage - build systems ( koji, osbs, mbs, src, pdc, kojipkgs, odcs, registriy) - 2021-11-09 17:00 UTC
[…]
We will be doing several maint tasks during this outage:
All the s390x builders will be moving from the current z13 maintframe to a z15 mainframe.
I'm getting a bunch of build failures only on s390x with a message about a read-only filesystem, e.g.: https://koji.fedoraproject.org/koji/buildinfo?buildID=1854066 https://koji.fedoraproject.org/koji/buildinfo?buildID=1854065 https://koji.fedoraproject.org/koji/buildinfo?buildID=1854067
Are these related to the problems with the move between mainframes?
On Wed, Nov 10, 2021 at 11:57 AM Alexander Ploumistos alex.ploumistos@gmail.com wrote:
Hello Kevin,
On Fri, Nov 5, 2021 at 2:26 PM Kevin Fenzi kevin@scrye.com wrote:
Planned Outage - build systems ( koji, osbs, mbs, src, pdc, kojipkgs, odcs, registriy) - 2021-11-09 17:00 UTC
[…]
We will be doing several maint tasks during this outage:
All the s390x builders will be moving from the current z13 maintframe to a z15 mainframe.
I'm getting a bunch of build failures only on s390x with a message about a read-only filesystem, e.g.: https://koji.fedoraproject.org/koji/buildinfo?buildID=1854066 https://koji.fedoraproject.org/koji/buildinfo?buildID=1854065 https://koji.fedoraproject.org/koji/buildinfo?buildID=1854067
Are these related to the problems with the move between mainframes?
I'm seeing similar problems with my builds, I've reported it with fedora-infra here: https://pagure.io/fedora-infrastructure/issue/10324 Feel free to add more information if you have any.
Fabio
Now they're back up and running again. I think that when I started the builds before, s390x did not appear in the output of "koji list-tasks --mine".
For full details on the problems please see https://pagure.io/fedora-infrastructure/issue/10302 synopsis: z15 move failed, we are still on z13?/z14? until next week or so when this will be tried again.
On Wed, 10 Nov 2021 at 06:55, Alexander Ploumistos alex.ploumistos@gmail.com wrote:
Now they're back up and running again. I think that when I started the builds before, s390x did not appear in the output of "koji list-tasks --mine". _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
looks to me (only?) buildvm-s390x-22.s390.fedoraproject.org is having issues, so I have disabled it
Dan
On Wed, 10 Nov 2021 07:03:14 -0500 Stephen John Smoogen smooge@gmail.com wrote:
For full details on the problems please see https://pagure.io/fedora-infrastructure/issue/10302 synopsis: z15 move failed, we are still on z13?/z14? until next week or so when this will be tried again.
On Wed, 10 Nov 2021 at 06:55, Alexander Ploumistos alex.ploumistos@gmail.com wrote:
Now they're back up and running again. I think that when I started the builds before, s390x did not appear in the output of "koji list-tasks --mine". _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure
-- Stephen J Smoogen. Let us be kind to one another, for most of us are fighting a hard battle. -- Ian MacClaren _______________________________________________ devel mailing list -- devel@lists.fedoraproject.org To unsubscribe send an email to devel-leave@lists.fedoraproject.org Fedora Code of Conduct: https://docs.fedoraproject.org/en-US/project/code-of-conduct/ List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines List Archives: https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org Do not reply to spam on the list, report it: https://pagure.io/fedora-infrastructure