What low-hanging fruit can we attack to get compose time down to a
reasonable window?
by Matthew Miller
Yesterday's compose stalled. So, no compose yesterday. The day before
that:
2017-08-28 03:19:38 [...] Fedora-27-20170828.n.0 started [...]
2017-08-28 20:26:31 [...] Fedora-27-20170828.n.0 FINISHED_INCOMPLETE [...]
That's *over 17 hours*. We're not too far off from actually literally
taking more than 24 hours to make a day's compose.
If this were something like one, two, or even four hours, when there is
a problem, we could fix that and restart without losing a whole day
(which often cascades into months).
I understand that a large part of the slowness is simply IO, from
moving a bunch of packages around, and there are tens of thousands of
packages. But, the day-to-day changeset isn't that big. Looking back at
F26 compose reports from June, I see changes ranging from a few
megabytes up to 3GB or so. Even processing at at at one megabyte per
second, that should be less than an hour even on those busy days. (Plus
whatever time for creating images, which I understand has its own
things with RPM scripts being slow and etc.)
Anyway, there has to be some low-hanging fruit here. Is there something
we can optimize by caching day-to-day, or caching as new packages are
built?
Is there a place we can thrown money at the problem and do this
all on a machine with RAID 10 SSDs or something?
--
Matthew Miller
<mattdm(a)fedoraproject.org>
Fedora Project Leader
6 years, 7 months
[releng] Issue #7004: Please, update module-bootstrap-rawhide
by Petr Šabata
psabata reported a new issue against the project: `releng` that you are following:
``
We recently rebased the Host & Platform package set, along with their buildroot. Please, tag & untag the following secure boot packages from `module-bootstrap-rawhide` to unblock our update.
Packages to be tagged:
* `fedora-release-28-0.1`
* `fedora-repos-28-0.1`
* `grub2-2.02-14.fc27`
* `kernel-4.13.0-0.rc6.git4.1.fc28`
* `pesign-0.112-20.fc27`
Packages to be untagged:
* `fedora-release-27-0.2`
* `fedora-repos-27-0.2`
* `grub2-2.02-0.38.fc26`
* `kernel-4.13.0-0.rc1.git1.1.fc27`
* `pesign-0.112-7.fc27`
Thank you!
``
To reply, visit the link below or just reply to this email
https://pagure.io/releng/issue/7004
6 years, 7 months