Storage Resources

Data Science Storage

The core of the terrabyte storage is made up of 10 racks packed with ThinkSystem SR630 servers and variously sized DSS-G storage systems from Lenovo. Together they provide 49 petabytes of storage (gross volume). The data is organised by IBM's Spectrum Scale file system (GPFS), and the Infiniband network ensures extremely fast data transfers between the storage and compute components. The GPFS file system is mounted on all LRZ HPC clusters.

The data can be transferred from DLR's German Satellite Data Archive (D-SDA) in Oberpfaffenhofen to the terrabyte platform at the LRZ in Garching near Munich via a direct network connection running currently at 10 gigabits per second with an optional upgrade to up to 100 gigabits per second.

Both the CPU- and the GPU-cluster are directly attached to a dedicated GPFS-storage system (Data Science Storage, DSS) with a capacity of about 50 PB net. The DSS hosts a large amount of various earth observation and auxiliary data and offers the possibility to store personal data (HOME), project data (dedictated storage containers) and intermediate data (SCRATCH).

Cloud Storage

Cloud Storage from Quobyte is used for terrabyte's web services currently deployed in the LRZ Compute Cloud. As soon as the terrabyte Cloud based on Kubernetes is deployed, Quobyte is used as Persistent Volume Claims in Kubernetes. In addition, cloud storage volumes can be exposed using S3 accessible internally in the internal LRZ network.

terrabyte's Cloud Storage is currently only available by request of users.