Destination Earth Data Lake (DEDL) Service – Access and discovery data through the Harmonized Data Access (HDA)

Destination Earth initiative (DestinE), driven by the Exploitation of Meteorological Satellites (EUMETSAT), the European Space Agency (ESA) and the European Centre for Medium-Range Weather Forecasts (ECMWF) aims to create a highly accurate replica or Digital Twin of the Earth. The first two Digital Twins describe weather-induced and geophysical extremes, as well as climate change adaptation, but the number of Digital Twins will continue to grow. To develop new models, there is a high need to gain access to data and dedicated services. One of the three key components of DestinE is the Destination Earth Data Lake (DEDL) which provides discovery, access, and big data processing services.

DEDL facilitates data storage and access through three primary types of data entry points: the Fresh Data Pool (FDP), Federated Datasets (FED), and the Digital Twins Data Warehouse. DEDL offers big data processing which allows near-data processing and by this conceptually supports ML/AI applications executed on the DEDL. The DestinE data lake federates with existing data holdings as well as with complementary data from diverse sources like in-situ, socio-economic, or data-space data. Thanks to DEDL, it is possible to get immediate access to data like Sentinel-1/2/3/5P missions. What is more, all this data is provided as a full archive immediately available to the user. With instant access to current Earth Observation (EO) data, researchers and other users can conduct time-sensitive analyses without the delays associated with data ordering. Moreover, having a comprehensive archive of EO data enables trend analysis and the investigation of long-term changes.

In this presentation we will demonstrate how to use Harmonized Data Access (HDA) – one of the tools developed within the DEDL. We will present the available datasets provided through HDA and guide you on how to use it to search collections and products. as Additionally, we will demonstrate how to obtain these datasets for use in your own environment. As SpatioTemporal Asset Catalogs (STAC) is used as a metadata standard, discovery and work with data provided by DEDL is user-friendly. Thanks to HDA it is possible to use a single account to explore data across tens of collections and petabytes of products.

The DestinE Data Lake is an initiative that revolutionizes the handling of Earth Observation data, improving capabilities in climate research, and supporting sustainable development efforts. The principles behind the DEDL will enable data harmonization and federation on a scale beyond current capabilities.