On Mon, 11 Mar 2019 at 06:55, Mikolaj Izdebski <mizdebsk(a)redhat.com> wrote:
On Mon, Mar 11, 2019 at 10:43 AM Stephen John Smoogen <smooge(a)gmail.com> wrote:
>
> On Mon, 11 Mar 2019 at 04:52, Mikolaj Izdebski <mizdebsk(a)redhat.com> wrote:
> >
> > I would like to propose increasing NUM_CONCURRENT_BUILDS for MBS to
> > value 100 after beta freeze is over.
> >
> > The above MBS setting controls how many parallel component builds MBS
> > can run at the same time. Current value is only 20. That value was
> > defined 3 years ago, in March 2017 when there were much fewer modules
> > in Fedora. Our Koji has capacity to run many more builds. Currently we
> > have 158 Koji builders in default channel that are able to run RPM
> > builds. Their total capacity is 566. Therefore it should be safe to
> > increase MBS NUM_CONCURRENT_BUILDS to at least 100. Especially since
> > Koji builds submitted by MBS have lower priority than default for
> > non-modular component builds submitted by packagers, so
> > packager-submitted builds will take precedence over builds submitted
> > by MBS.
> >
>
> Does the koji numbers above take into account architectures? While
> have 158 builders they are spread out over a lot of architectures with
> ~12 s390x builders, ~30 ppc64le, ~20 arm and ~20 aarch64 builders and
> I guess ~70 x86_64 builders. So while we could build a lot more x86_64
> builds at once, could we completely swamp the other arches and
> actually cause problems for even completing the x86_64 ones?
>
> If the architecture would be a problem, should we look at the
> smaller/slowest number of builders and work out what its capacity is
> and not go much above that?
That should not be a problem. Koji can handle thousands of builds
submitted at the same time. This happens, for example, during mass
rebuilds.
Yeah.. sorry I didn't explain things clearly. Koji can handle it but
does it make the developer experience worse across the board? We could
do a mass rebuild every day and koji wouldn't break a sweat.. but
developers actually wanting to get stuff out of Fedora would hate it
because the queues for builds would be so long. My questions should
have stated that.
--
Stephen J Smoogen.