terrabyte Services
The HPDA terrabyte platform offers a wide range of services supporting easy access to the resources. Please see the next chapters for details of the services available to you. An overview is shown in the Figure below.
High Performance Computing
The terrabyte High Performance Computing (HPC) offers command line based processing control for large-scale batch processing, automated processing workflows or numerical simulations.
- Resource assignment via SLURM scheduler
- Single-core jobs
- Shared memory thread-parallel jobs
- Distributed memory parallel jobs
- Interactive testing
- Parallelization by message passing (MPI)
- Shared memory parallelization with OpenMP or pthreads
- Mixed (hybrid) programming with MPI and OpenMP
terrabyte Portal
The terrabyte Portal is a web-based Graphical User Interface (GUI) offering user-friendly services to access terrabyte's compute resources. Here you can develop and run code directly on the terrabyte compute resources using tools like Jupyter and Visual Studio, as well as analyze your results with GIS tools like QGIS or open a remote desktop to access additional software.
- Large pre-installed software portfolio
- Development environment with compilers, tools and libraries on front end nodes
- Run time environments and applications on batch nodes
- Bring your own software via software containers
- Development and processing with Jupyter Notebooks, Visual Studio Code, and RStudio
- Flexible usage due to various available memory sizes
- Secure shell based logins and data transfer to generally accessible front end nodes
Identity Management
With the identity management services you can create a terrabyte account and use the services to login to several services (e.g., Private STAC API, SLURM REST API).
Project Management
In the section project management you learn about terrabyte/LRZ projects, which allow to grant access to terrabyte for external collaborators (e.g., in research projects). Any project request will be evaluated on a bi-weekly basis.
Data Discovery & Access
Access the terrabyte data collections via STAC API and Browser and load data as multi-dimensional data cubes. The terrabyte services offer a variety of data access options.
Data Storage
The terrabyte infrastructure offers a variety of storage resources for your data.
- Access to EO- and auxiliary-data
- SCRATCH space for short lifetime data (removal is forced)
- DSS/HOME area with small quota for program and configuration data
- DSS/PROJECT area (individual storage) upon request for long lifetime data
- DSS/PROJECT area (shared storage) for collaborative work
Data Transfer
We provide data transfer options to move your data to and from the terrabyte infrastructure as well as share your data with 3rd parties.