Differences in LSF Configuration between Juno and luna

  1. We reserve ~12GB of RAM per host for the operating system and GPFS on Juno CentOS 7 hosts.
  2. On each jx## node (CentOS 7, GPFS installed), 240GB of RAM is available for LSF jobs.
  3. On each ju## node (CentOS 6, no GPFS), 250GB of RAM is available for LSF jobs.
  4. When specifying RAM for LSF jobs, specify GB of RAM per task (slot) on Juno (unlike luna, where RAM is specified per job).
  5. All jobs must have -W (maximum execution Walltime) specified on Juno. Please do not use -We on Juno.
  6. There is no /swap on CentOS 7 nodes. Memory usage is enforced by cgroups so jobs never swap. A job will be terminated if memory usage exceeds its LSF specification.
  7. To check jobs which are DONE or status EXIT, use "bhist -l JobID" or "bhist -n 0 -l JobID". bacct is also available. "bjobs -l JobID" only shows RUNNING and PEND jobs.
  8. There is no iounits resource on Juno.
  9. CMOPI SLA configured on Juno. The loan policies are: 100% resources for 90 mints jobs for not SLA users, and 75% resources for 240 mints jobs for not SLA users.