EGU23-3624, updated on 22 Feb 2023
https://doi.org/10.5194/egusphere-egu23-3624
EGU General Assembly 2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.

ESM Data Exploration with the Model Data Explorer

Philipp S. Sommer1, Linda Baldewein1, Hatef Takyar1, Rehan Chaudhary1, Mostafa Hadizadeh2, Housam Dibeh1, Max Böcke1, Christof Lorenz2, Tilman Dinter3, Stefan Pinkernell3, Klaus Getzlaff4, and Ulrike Kleeberg1
Philipp S. Sommer et al.
  • 1Helmholtz-Zentrum hereon GmbH, Institute of Carbon Cycles, Geesthacht, Germany (philipp.sommer@hereon.de)
  • 2Karlsruhe Institute of Technology, Scientific Data Management, Garmisch-Partenkirchen, Germany
  • 3Alfred Wegener Institute, Computing and Data Centre, Bremerhaven, Germany
  • 4GEOMAR Helmholtz-Zentrum für Ozeanforschung, Ocean Circulation and Climate Dynamics, Kiel, Germany

Making Earth-System-Model (ESM) Data accessible is challenging due to the large amount of data that we are facing in this realm. The upload is time-consuming, expensive, technically complex, and every institution has their own procedures.

Non-ESM experts face a lot of problems and pure data portals are hardly usable for inter- and trans-disciplinary communication of ESM data and findings, as this level of accessibility often requires specialized web or computing services. 

With the Model Data Explorer, we want to simplify the generation of web services from ESM data, and we provide a framework that allows us to make the raw model data accessible to non-ESM experts.

Our decentralized framework implements the possibility for an efficient remote processing of distributed ESM data. Users interface with an intuitive map-based front-end to compute spatial or temporal aggregations, or select regions to download the data. The data generators (i.e. the scientist with access to the raw data) use a light-weight and secure python library based on the Data Analytics Software Framework (DASF, https://digital-earth.pages.geomar.de/dasf/dasf-messaging-python) to create a back-end module. This back-end module runs close to the data, e.g. on the HPC-resource where the data is stored. Upon request, the module generates and provides the required data for the users in the web front-end.

Our approach is intended for scientists and scientific usage! We aim for a framework where web-based communication of model-driven data science can be maintained by the scientific community. The Model Data Explorer ensures fair reward for the scientific work and adherence to the FAIR principles without too much overhead and loss in scientific accuracy. 

The Model Data Explorer is in the progress of development at the Helmholtz-Zentrum Hereon, together with multiple scientific and data management partners in other German research centers. The full list of contributors is constantly updated and can be accessed at https://model-data-explorer.readthedocs.io.

How to cite: Sommer, P. S., Baldewein, L., Takyar, H., Chaudhary, R., Hadizadeh, M., Dibeh, H., Böcke, M., Lorenz, C., Dinter, T., Pinkernell, S., Getzlaff, K., and Kleeberg, U.: ESM Data Exploration with the Model Data Explorer, EGU General Assembly 2023, Vienna, Austria, 24–28 Apr 2023, EGU23-3624, https://doi.org/10.5194/egusphere-egu23-3624, 2023.