The EERIE cloud: Apps and Catalogs for Cloudified Earth System Model Output

We present recent progress around the EERIE cloud data server (https://eerie.cloud.dkrz.de) and its software stack “cloudify”. The EERIE cloud provides efficient open access to prominent climate datasets stored on disk at the German Climate Computing Center (DKRZ).

A new kerchunk-plugin enables data access to raw model output as-is to enable verifiable data transfer with better latency. STAC (Spatio Temporal Assets Catalog) catalogs are deployed and displayed through the EERIE cloud to make the provided DKRZ datasets findable and accessible. Two in-browser apps can be started, pre-configured for each dataset, by just clicking buttons: (1) the data visualization app “gridlook” as well as a (2) jupyterlite for interactive analysis and monitoring. 

We leverage the python package xpublish, a plugin for Pangeo's central analysis package Xarray. Its main feature is to provide ESM output by mapping any input data to virtual zarr datasets. Users can retrieve these datasets as if they were cloud-native and cloud-optimized.