The new juno cluster is now available only for testing. Please request "Access another cluster" from http://hpc.mskcc.org/compute-accounts/account-change-request/ if you want to participate in the test. juno currently has 216 CPUs. The login node is juno, and runs CentOS 7 with GPFS. Nodes jx01-jx10 are running CentOS 7 with GPFS, while node ju14 is running CentOS 6 without GPFS. All juno nodes have access to the solisi Isilon file systems. CentOS 7 nodes also have access to /juno GPFS storage.
Slides from Sep 27 2018 User Group meeting Juno_UG_092018.pdf
November 28, 2018: the default OS type is CentOS07. Please, check "Job Submission"
The juno cluster uses LSF (Load Sharing Facility) 10.1FP6 from IBM to schedule jobs. The default queue, ‘general’, includes all Juno compute nodes.
LSF 10.1 makes use of Linux control groups (cgroups) to limit the CPU cores and memory that a job can use. The goal is to isolate the jobs from each other and prevent them from consuming all the resources on a machine. All LSF job processes are controlled by the Linux cgroup system. If a job's processes on a host use more memory than it requested, the job will be terminated by the Linux cgroup memory sub-system.
Memory (-M or -R "rusage[mem=**]" ) is a consumable resource. specified as GB per slot/task (-n).
LSF will terminate any job which exceeds its requested memory (-M or -R "rusage[mem=**]").
All jobs should specify Walltime (-W), otherwise a default Walltime of 6 hours will be used.
LSF will terminate any job which exceeds its Walltime.
The maximum Walltime for general queue is 744 hours (31 days).
Queue name: general
Operating System: CentOS 7
Number of slots (-n): 1
Maximum Waltime (job runtime): 6 hours
Memory (RAM) : 2GB
By default jobs submitted on juno only run on CentOS 7 nodes (with GPFS). Users can specify CentOS 6 nodes (Isilon only), CentOS 7 nodes (with GPFS), or either type.
To submit a job to CentOS 7 nodes use either of these formats:
bsub -n 1 -W 1:00 -R "rusage[mem=2]" bsub -n 1 -W 1:00 -app anyOS -R "select[type==CentOS7]" -R "rusage[mem=2]" |
To submit a job to CentOS 6 nodes:
bsub -n 1 -W 1:00 -app anyOS -R "select[type==CentOS6]" -R "rusage[mem=2]" |
To submit a job to any nodes, running either CentOS 6 or 7:
bsub -n 1 -W 1:00 -app anyOS -R "rusage[mem=2]" |
To submit a job to nodes with NVMe /fscratch:
bsub -n 1 -R "fscratch" -app anyOS bsub -n 1 -R "pic" -app anyOS |