On 21Jan2022 10:39, linux guy linuxguy123@gmail.com wrote:
I'm using a server to run a bunch of simulations. By bunch I mean hundreds. Each simulation takes from 10 minutes to 10 hours to run. All of the simulations are run from the command line. Every day I generate more simulation cases.
I'm looking for a method/system/app that I can give a list of tasks that will run them on the server, automatically, one after another.
If you can define a task in a single line of text you could run something like this on the server:
tail -f task_list.txt | while read -r spec; do run the task from $spec; done
Put that in a tmux or screen session.
Task submission is then just appending a spec to the text file:
echo "specification here" >> task_list.txt
Dumb as rocks, but effective. I've run simple workers like this.
Probably "run the task from $spec" should invoke a shell script to run exactly one task collecting the output, logging the times etc.
Cheers, Cameron Simpson cs@cskk.id.au