Slurm

Example slurm file:

#!/bin/zsh -i

#SBATCH --time=8:00:00
#SBATCH --mem=8G
#SBATCH --gres=gpu:1
#SBATCH --output=script.out

module load anaconda
module load cuda
conda activate env-name
mkdir -p slurm_output

python script.py

To run this bash script on slurm: sbatch script-name.sh. To see current jobs: slurm q.

Using array jobs is an easy way to send jobs in an embarrassingly parallel way.