General Documentation
- Welcome FAQ
- Secure Shell SSH
- Available Software
- Installing Software
- Guidelines and Policies
- Glossary
- Grant Support
- Sharing Data
- Containers & Singularity
- UserGroup Presentations
- Jupyter Notebook Usage
LSF Primer
Lilac Cluster Guide
Juno Cluster Guide
Cloud Resources
Backup Policy on server/node local drives
File lists
Page History
...
2. Copy files from other clusters:
Info |
---|
HAL cluster is outside the firewall, so lilac cannot be accessed directly from HAL cluster |
SABA/LUNA/LUX:
To copy files from other clusters, firstssh -A
into the other cluster to forward your keys.Code Block language bash theme Midnight firstline 1 title Command line linenumbers true ssh -A $USERNAME@$CLUSTER
We recommend
rsync -va
to copy files and directories.Make note of the source directory/source files and destination directory/files on Lilac and copy them as below:
Code Block language bash theme Midnight firstline 1 title Command line linenumbers true rsync -av --progress $SOURCEPATH lilac:$DESTPATH
HAL:
Remember that thehal
cluster is outside the MSKCC network, and does not have access tolilac
.First - Make note of the source directory/source files on HAL and destination directory/files on Lilac:
To transfer data, ssh into lilac as below :
Code Block language bash theme Midnight firstline 1 title Command line linenumbers true ssh -A $USERNAME@lilac.mskcc.org
Then pull files from HAL:
Code Block language bash theme Midnight firstline 1 title Command line linenumbers true rsync -av --progress hal:$SOURCEPATH $DESTPATH
Tip - Depending on the size and number of files to copy, you may run multiple
rsync
commands simultaneously to copy different directories. - The HPC private network is faster than the MSKCC campus network, so using short names (
lilac
,saba
,luna
,selene
, etc.) will often make transfers faster than using fully qualified domain names such asluna.mskcc.org
. This does not apply tohal
, though
- Depending on the size and number of files to copy, you may run multiple
...