Globus Data Transfer
For data transfers to and from the DSS beyond a few GB in size, we recommend using Globus Online.
Globus is a fast, secure, and reliable data transfer service developed and operated by the University of Chicago. Globus is widely and globally used in HPC environments. The basic Globus Transfer service is free to use.
The service allows establishing a secure connection between any server or desktop (virtual) machine set up as a Globus endpoint. Access right management is fully supported. The transfer connection can be established from anywhere, a control service manages the data transfer between the endpoints.
The control service instance monitors transfer rates and optimizes concurrency while maintaining a secure connection between the endpoints. The process also keeps track of the transfer progress and data integrity. In case of errors or interruptions, transfers will automatically be re-established whenever possible. On successful completion, the user receives an email message. In case a transfer does not make any progress over a certain period of time (typically 3 days), the process expires and will be terminated. This event will also trigger an email dispatch.
All terrabyte DSS storage containers located at the LRZ facilities in Garching are accessible via a Globus Server endpoint. Running a Globus Connect Personal endpoint within your infrastructure will make it possible to establish a connection and transfer data between these endpoints. The Globus Connect Personal software is available for Linux, MacOS, and Windows operating systems.
A detailed introduction to Globus Online is provided in this LRZ documentation: Using DSS world wide via Globus Online. Before you can connect to the Globus Server, you might need to set some firewall rules.
For using Globus within the EOC infrastructure, please see Globus for EOC users (only available from within DLR network).