[NLPL Task Force (A)] [uninett.no #224350] Re: Too many jobs on Saga

Mon Oct 26 23:19:18 UTC 2020

Tue Oct 27 00:19:18 2020: Request 224350 was acted upon.
Transaction: Ticket created by artur.kulmizev at lingfil.uu.se
       Queue: metacenter-support
     Subject: Re: Too many jobs on Saga
       Owner: Nobody
  Requestors: artur.kulmizev at lingfil.uu.se
      Status: new
 Ticket <URL: https://rt.uninett.no/Ticket/Display.html?id=224350 >
          To: "Stephan Oepen" <oe at ifi.uio.no>
          CC: "support at metacenter.no" <support at metacenter.no>, "infrastructure" <infrastructure at nlpl.eu>

Thanks Stephan,

I usually work with submitting around 15 jobs at a time programmatically, but I’ll avoid it for larger arrays and try to use your script. I had a bug in one of my loops which exploded the job limit redundantly.

Again, I’m very sorry for the inconvenience at this late hour.

Best,

-Artur

Sent from my iPhone

On Oct 26, 2020, at 19:09, Stephan Oepen <oe at ifi.uio.no> wrote:

thanks for the courtesy copy, thomas, and for freeing up the queue!

on the pre-Saga systems, there used to be a limit on the number of jobs a user could have in the queue, 200 maybe.  it sounds as if Saga does not impose such a limit (currently)?

artur, i once wrote a script to ‘trickle’ very long lists of jobs through the scheduler, while keeping my count of jobs in the queue below some limit at all times:

http://wiki.nlpl.eu/index.php/Infrastructure/trickle

best wishes, oe

On Mon, 26 Oct 2020 at 23:49 Thomas Röblitz <Thomas.Roblitz at uib.no<mailto:Thomas.Roblitz at uib.no>> wrote:
Hei Artur,

  you have too many jobs submitted on Saga. It prevents the scheduler from accepting more jobs.

I’ll scancel your jobs, because we have a course tomorrow and it’s currently impossible to submit jobs - hence Saga wouldn’t be usable during the course.

Please, don’t submit so many individual jobs. You could execute multiple ones sequentially in a single job script or use array jobs.

Sorry for the inconvenience

Thomas

--
Scientific Computing, IT division
University of Bergen, Norway

När du har kontakt med oss på Uppsala universitet med e-post så innebär det att vi behandlar dina personuppgifter. För att läsa mer om hur vi gör det kan du läsa här: http://www.uu.se/om-uu/dataskydd-personuppgifter/

E-mailing Uppsala University means that we will process your personal data. For more information on how this is performed, please read here: http://www.uu.se/en/about-uu/data-protection-policy