Creating a high-memory CASA job on Hydra
For this exampe the following files are in the current working directory. This will be your home directory on Hydra, or the RTDC dedicated space.
- casa has been soft-linked to your casa installation. You can request any version of CASA be installed on the RTDC space like in this example.
- fulldata.ms (your input data file) has been soft-linked to wherever it is located - this saves disk space if you plan to run different jobs from different folders.
- runcasa.job is the job submission script (CONTENT DESCRIBED BELOW)
- tclean-test.py is called from runcasa.job and for this example is the same script found at Running CASA in Parallel Mode.
The job file can be generated online using the QSub Generator. Alternatively you can write it yourself following the template below.# /bin/cshDeclare the job's shell # # $ -cwd -j yRun from current directory. -j y combines stdout & stderr
messages# $ -o runall.logSet output log file (will append if file exists) # $ -q mThM.qChoose queue. Here it is the high memory (>6GB/cpu)
queue mThM.q.# $ -l himem,h_data=30G,h_vmem=30G,mres=30GRequired for high-memory queue. This reserves the
approximate memory required per cpu.# $ -N run_my_testSet a name for this job (not have to be the script name) # $ -pe mthread 5Set parallel environment & number of cores/cpus.
mthread is a good choice for casa.# $ -m beaInclude this if you want email notifications when the job
begins/end/aborts# $ -M you@cfa.harvard.eduProvide your email # echo $JOB_NAME started `date` on $HOST in $QUEUESend an information message to the log file echo jobID=$JOB_ID and NSLOTS=$NSLOTSand more information # set CASA = casa/bin/Set the variable CASA $CASA/mpicasa -n $NSLOTS $CASA/casa --nogui -c tclean-test.pyRun your tclean script # echo $JOB_NAME done `date`Report end time
NOTE: All jobs that use more than 2 GB of memory (per CPU) should include a memory reservation and requirement with -l mres=X,h_data=X,h_vmem=X.
Find more information on all the queue options at HPC: Available Queues
Find more information on submitting jobs at HPC: Submitting Jobs .

