Skip to main content

terrabyte Services

The HPDA terrabyte platform offers a wide range of services supporting easy access to the resources. Please see the next chapters for details of the services available to you. An overview is shown in the Figure below.

terrabyte services

High Performance Computing

The terrabyte High Performance Computing (HPC) offers command line based processing control for large-scale batch processing, automated processing workflows or numerical simulations.

  • Resource assignment via SLURM scheduler
  • Single-core jobs
  • Shared memory thread-parallel jobs
  • Distributed memory parallel jobs
  • Interactive testing
  • Parallelization by message passing (MPI)
  • Shared memory parallelization with OpenMP or pthreads
  • Mixed (hybrid) programming with MPI and OpenMP

terrabyte Portal

The terrabyte Portal is a web-based Graphical User Interface (GUI) offering user-friendly services to access terrabyte's compute resources. Here you can develop and run code directly on the terrabyte compute resources using tools like Jupyter and Visual Studio, as well as analyze your results with GIS tools like QGIS or open a remote desktop to access additional software.

  • Large pre-installed software portfolio
  • Development environment with compilers, tools and libraries on front end nodes
  • Run time environments and applications on batch nodes
  • Bring your own software via software containers
  • Development and processing with Jupyter Notebooks, Visual Studio Code, and RStudio
  • Flexible usage due to various available memory sizes
  • Secure shell based logins and data transfer to generally accessible front end nodes

Identity Management

With the identity management services you can create a terrabyte account and use the services to login to several services (e.g., Private STAC API, SLURM REST API).

Project Management

In the section project management you learn about terrabyte/LRZ projects, which allow to grant access to terrabyte for external collaborators (e.g., in research projects). Any project request will be evaluated on a bi-weekly basis.

Data Discovery & Access

Access the terrabyte data collections via STAC API and Browser and load data as multi-dimensional data cubes. The terrabyte services offer a variety of data access options.

Data Storage

The terrabyte infrastructure offers a variety of storage resources for your data.

  • Access to EO- and auxiliary-data
  • SCRATCH space for short lifetime data (removal is forced)
  • DSS/HOME area with small quota for program and configuration data
  • DSS/PROJECT area (individual storage) upon request for long lifetime data
  • DSS/PROJECT area (shared storage) for collaborative work

Data Transfer

We provide data transfer options to move your data to and from the terrabyte infrastructure as well as share your data with 3rd parties.