Submitting dependency jobs using SLURM

SLURM scheduler uses sbatch command to submit the jobs. You can submit large number of jobs using a loop or if you want to run a series of jobs that runs after completion of set of jobs using the same command. You can also schedule the job to start running on a predefined time as well. In this tutorial, we will explain how to submit jobs that runs depending on status of the previously submitted jobs or schedule a bunch of jobs to run one after the other.

To understand the dependency feature take a look at the -d, --dependency section in the man page of the sbatch command

Once you submit a job, using that job ID, you can submit dependency jobs. For eg.

sbatch first_job.slurm

You will get the job id

854.computername

Next, you can submit a job that only runs after successful completion of the first job as follows:

sbatch --dependency=afterok:854 second_job.slurm

The format here is

sbatch --dependency=type:job_id jobfile

If the job requires more than one job to be completed before it is executed, you can supply all the jobids using , separator

sbatch --dependency=type:job_id,job_id,job_id jobfile

You can also set the job to run if any one of the job ids compltes successfully using a ? separator

sbatch --dependency=type:job_id?job_id?job_id jobfile

The other dependencies that can be used for<type:job_id> are as follows:

Argument Description
after This job can begin execution after the specified jobs have begun execution
afterany This job can begin execution after the specified jobs have terminated.
aftercorr A task of this job array can begin execution after the corresponding task ID in the specified job has completed successfully
afternotok This job can begin execution after the specified jobs have terminated in some failed state
afterok This job can begin execution after the specified jobs have successfully executed
singleton This job can begin execution after any previously launched jobs sharing the same job name and user have terminated

Further Reading


Homepage Section Index Previous Next