Page History

...

• largeHG: t01-t02
• internetHG: s01-s02s03
• commonHG: s03-s33 & u01-u26testHG: u34-u35s04-s21

LSF host partitions

• largeHP: t01-t02
• commonHP: s03-s33 & u01-u26testHP: u34-u35s01-s21

Long vs. Short Jobs

• If a job specifies estimated run time, -We, or hard run time, -W, of 60 59 [minutes] or less, it is considered ‘short’.
• Short jobs can run on all hosts.
• To run a short job you must specify -We HOURS:MINUTES or -W HOURS:MINUTES
• Short jobs can run on all hosts. They have a hard run limit of 2 times the requested run time.
• All jobs are that do not request a run time of 59 minutes or less than 60 minutes are considered ‘long’.
• Long jobs can run on 30% of commonHG hosts, and on 50% of largeHG hosts if they request enough memory to be eligible.

...

Job was submitted from host by user in cluster .
Job was executed on host(s) , in queue , as user in cluster .
was used as the home directory.
was used as the working directory.
Started at Tue May 24 11:14:37 2016
Results reported on Tue May 24 11:14:50 2016
Your job looked like:
------------------------------------------------------------
# LSBATCH: User input
sleep 13
------------------------------------------------------------
Successfully completed.
Resource usage summary:
CPU time : 0.07 sec.
Total Requested Memory : -
Delta Memory : -
Run time : 13 sec.
Turnaround time : 14 sec.
The output (if any) follows:

*Also a NOTE before using this: If you have that LSB_JOB_REPORT_MAIL=Y exported and do not put -u or -N ( and you don’t have -o or -oo), a message gets sent to you in the terminal at /var/mail/username and is only on the host that you ran the job on. In order to change it back just export LSB_JOB_REPORT_MAIL=N after you are done! If the users DON’T there is probably a potential to flood the /var/mail directories on the hosts with junk!

LSF Rules:

Memory Request Rules:
– Both Soft memory limits -R “rusage[mem=GB] and Hard memory limits -M GB should be requested.
– If none are requested the default for soft is 8 GB and for hard is 16 GB
– If hard is requested but soft is not: soft = hard

Runtime Request Rules for short jobs:
– If soft runtime -We hour:minute is set and hard -W hour:minute is not, hard runtime = 2x soft runtime
– If hard runtime is set, soft runtime does not need to be.

Note:
– There is no hard runtime for long jobs. A job is considered long if there is no runtime specified.
– If soft mem limit is less than small host threshold (376 GB), job is long (>60 minutes), and it does not have internet requested the jobs will only be submitted to “commonHG”.
– Queue test is exempt from these rules.