EGU21-9632, updated on 04 Mar 2021
https://doi.org/10.5194/egusphere-egu21-9632
EGU General Assembly 2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.

Easing and promoting the application of ML and AI in earth system sciences - introducing the KI:STE platform

Thomas Seidler1,4, Norbert Schultz3, Dr. Markus Quade3, Christian Autermann2, Dr. Benedikt Gräler2, and PD Dr. Markus Abel1,4,3
Thomas Seidler et al.
  • 1Ambrosys GmbH, Germany (thomas.seidler@ambrosys.de)
  • 252°North Initiative for Geospatial Open Source Software GmbH
  • 3Mantik UG
  • 4University of Potsdam, Institute of Physics and Astronomy

Earth system modeling is virtually impossible without dedicated data analysis. Typically, data are big and due to the complexity of the system, adequate tools for the analysis lie in the domain of machine learning or artificial intelligence. However, earth system specialists have other expertise than developing and deploying state-of-the art programming code which is needed to efficiently use modern software frameworks and computing resources. In addition, Cloud and HPC infrastructure are frequently needed to run analyses with data beyond Tera- or even Petascale volume, and corresponding requirements on available RAM, GPU and CPU sizes. 

Inside the KI:STE project (www.kiste-project.de), we extend the concepts of an existing project, the Mantik-platform (www.mantik.ai), such that handling of data and algorithms is facilitated for earth system analyses while abstracting technical challenges such as scheduling and monitoring of training jobs and platform specific configurations away from the user.

The principles for design are collaboration and reproducibility of algorithms from the first data load to the deployment of a model to a cluster infrastructure. In addition to the executive part where code is developed and deployed, the KI:STE project develops a learning platform where dedicated topics in relation to earth system science are systematically and pedagogically presented.

In this presentation, we show the architecture and interfaces of the KI:STE platform together with a simple example.

How to cite: Seidler, T., Schultz, N., Quade, Dr. M., Autermann, C., Gräler, Dr. B., and Abel, P. Dr. M.: Easing and promoting the application of ML and AI in earth system sciences - introducing the KI:STE platform, EGU General Assembly 2021, online, 19–30 Apr 2021, EGU21-9632, https://doi.org/10.5194/egusphere-egu21-9632, 2021.

Display materials

Display file

Comments on the display material

to access the discussion