Opened 8 months ago

Closed 8 months ago

#1511 closed enhancement (fixed)

Increase the delay between ASCAT jobs

Reported by: Nicklas Nordborg Owned by: Nicklas Nordborg
Priority: major Milestone: Reggie v4.49.1
Component: net.sf.basedb.reggie Keywords:
Cc:

Description

When submitting multiple jobs to the cluster there is a default delay of 30 seconds that is added to each job. The delay is there because most jobs start by copying data from the network to the local node and this will perform better if not all jobs start at the same time.

The BAM files for WGS data that ASCAT uses is however very large and they take several minutes to copy. The result is that too many jobs are copying data from the same server at the same time and will take several hours just for the copy operation.

Slurm can probably be configured to take care of this (via partions, QoS, etc.) but since that is not in place, it may help a bit to increase the delay between ASCAT jobs to ~5 minutes.

Change History (1)

comment:1 by Nicklas Nordborg, 8 months ago

Resolution: fixed
Status: newclosed

In 7319:

Fixes #1511: Increase the delay between ASCAT jobs

Increased the delay between ASCAT jobs to 3 minutes. The delay is remembered between batches so if the wizard is used multiple times it should be one long queue.

Note: See TracTickets for help on using tickets.