On 12/04/2010 04:51 AM, Jinze Xue wrote:
hello experts!
I added 2000 build tasks to my koji build system with --nowait .
I have 4 builder host and I set sleeptime=300, maxjobs=50.
but the tasks assigned to builders is to fast , why it not be 300 seconds?
the new tasks assigned to builders and my children tasks of my old builds
can't assigned .(one build task need have 3 children tasks in general)
how to solve this problem?
thanks
can I set the maxjobs to 500?
how much jobs can a general computer bear?
This is indeed an overload situation. The scheduler is admittedly
simplistic.
Due to some user complaints about previous behavior, kojid will bypass
sleeps when loading up on tasks. This is why your sleeptime of 300 does
not slow this process down.
Since maxjobs is not the only limiting factor, you can generally raise
it without too much risk. It depends on your hardware. The build tasks
have very low impact, however they are separate processes and there is
some overhead.
Another thing you can do is to use the free-task command to free up some
of the top level build jobs that are clogging up your builders. Because
the buildArch subtasks are higher priority, this should free up the logjam.
In the future, I would avoid dumping so many builds so fast on a koji
system while it is idle. When you have 2000 jobs to submit to an idle
koji system, start with a reasonable subset (say 4x the number of
builders), let those get underway, and then submit the rest.
I think , parallel prent tasks and children tasks is not smart , will
there
any changes in the future?
A smarter scheduler is on my to do list. However, I don't expect to drop
"parallel parent and child tasks."