[NLPL Task Force (A)] Too many jobs on Saga

[Artur Kulmizev]

Thanks Stephan,

I usually work with submitting around 15 jobs at a time programmatically, but I’ll avoid it for larger arrays and try to use your script. I had a bug in one of my loops which exploded the job limit redundantly.

Again, I’m very sorry for the inconvenience at this late hour.

Best,

-Artur

Sent from my iPhone

On Oct 26, 2020, at 19:09, Stephan Oepen <oe at ifi.uio.no> wrote:


thanks for the courtesy copy, thomas, and for freeing up the queue!

on the pre-Saga systems, there used to be a limit on the number of jobs a user could have in the queue, 200 maybe.  it sounds as if Saga does not impose such a limit (currently)?

artur, i once wrote a script to ‘trickle’ very long lists of jobs through the scheduler, while keeping my count of jobs in the queue below some limit at all times:

http://wiki.nlpl.eu/index.php/Infrastructure/trickle

best wishes, oe


On Mon, 26 Oct 2020 at 23:49 Thomas Röblitz <Thomas.Roblitz at uib.no<mailto:Thomas.Roblitz at uib.no>> wrote:
Hei Artur,

  you have too many jobs submitted on Saga. It prevents the scheduler from accepting more jobs.

I’ll scancel your jobs, because we have a course tomorrow and it’s currently impossible to submit jobs - hence Saga wouldn’t be usable during the course.

Please, don’t submit so many individual jobs. You could execute multiple ones sequentially in a single job script or use array jobs.

Sorry for the inconvenience

Thomas

--
Scientific Computing, IT division
University of Bergen, Norway









När du har kontakt med oss på Uppsala universitet med e-post så innebär det att vi behandlar dina personuppgifter. För att läsa mer om hur vi gör det kan du läsa här: http://www.uu.se/om-uu/dataskydd-personuppgifter/

E-mailing Uppsala University means that we will process your personal data. For more information on how this is performed, please read here: http://www.uu.se/en/about-uu/data-protection-policy
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.nlpl.eu/archives/infrastructure/attachments/20201026/59f1ac5e/attachment.htm>