Skip to main content

terrabyte Release Notes

Version 1.2 - 31.10.2024​

We would like to announce the second version of the terrabyte infrastructure, web services, and software.

Breaking changes!

  • Support
  • Data
    • Sentinel-1 GRD and SLC data has moved to /dss/dsstbyfs03/pn56su/pn56su-dss-0022/Sentinel-1
    • Sentinel-1 NRB data has moved to /dss/dsstbyfs03/pn56su/pn56su-dss-0023/Sentinel-1/NRB
    • Sentinel-5p data has moved to /dss/dsstbyfs03/pn56su/pn56su-dss-0022/Sentinel-5p
      • Please note: The folder structure has been changed. Now, RPRO and OFFL are not stored in seperate folders anymore.
    • Attentation: The existing folders for the above mentioned datasets within /dss/dsstbyfs01/pn56su/pn56su-dss-0008 will be removed starting from Januar 2025.
  • STAC API
    • Several fixes and enhancements have already been implemented in May 2024 (see forum post)

New services

New software

  • terrapi - The terrapi command line interface is available since November 2024 and helps users to interact with terrabyte APIs
  • terrapi-client - The library terrapi-client offers functions to easily work with the private STAC API. It builds on top of the Python library terrapi for authentication with the terrabyte authentication service

Hardware

  • Since April 2024 new compute nodes and storage capacity have been added to terrabyte.
  • Now, we have 262 HPC nodes and 47 A-100 GPUs nodes available. In sum, terrabyte provides ca. 44.000 virtual CPU cores and 188 GPUs.
  • Additional 20 Petabyte of storage has been installed by LRZ, which will further extend the storage capacity to 55 Petabyte useable net storage. Thew new storage is mainly used for the Sentinel-1 Normalized Radar Backscatter product as well as Sentinel-2 Collection 1 Level-2A.

Data

  • Our data roadmap has been published
  • We have published data dashboards for Sentinel and Landsat to inform about the current available data
  • We have made our inventory of data available as Geoparquet file to allow users to query the data availability for their own area and time of interest: https://docs.terrabyte.lrz.de/datasets/terrabyte-datasets/inventory/usage/
  • Hourly ingestion of Sentinel-1 GRD, SLC, Sentinel-2 L2A, Sentinel-3 OLCI L1 EFR, Sentinel-5p data and Landsat OT (8-9)
  • Sentinel-1 SLC available only on demand
  • Copernicus DEM 30m and 90m Version 2023 published
    • GLO-30 Full, Free & Open release of the restricted countries: Armenia, Azerbaijan and Moldova.
    • Correction of the following Tiles:
      • GLO-30 correction of 3 tiles: N24W099, N30E076 and S17W065
      • GLO-90 correction of 2 tiles: N30E076 and S17W065

Workshops and Cafè

Version 1.0 - 15.07.2023​

We would like to announce the launch of the terrabyte web services. In the last weeks we have improved all our services and worked on the documentation, all now available in a first operational version.

In addition to the already provided HPC environment, together with the LRZ we now offer the following web services:

All services are documented in the terrabyte documentation and can be used with a terrabyte account. Anyone with a DLR internal account can create an account via the Self-Registration Service (initial login with DLR ID required).