Big Data in Earth System Sciences: The Challenges of Data Compression & Data Spaces in the cloud computing era
Co-organized by AS5/CL5/GD10/GI2/NP4
Convener:
Clément BouvierECSECS
|
Co-conveners:
William Ray,
Mattia Santoro,
Juniper TyreeECSECS,
Weronika Borejko,
Oriol TintoECSECS,
Sara Faghih-NainiECSECS
Orals
|
Thu, 01 May, 16:15–18:00 (CEST) Room -2.92
Posters on site
|
Attendance Thu, 01 May, 10:45–12:30 (CEST) | Display Thu, 01 May, 08:30–12:30 Hall X4
Data compression has gained interest for making data more manageable, speeding up transfer times, and reducing resource needs without affecting the quality of scientific analyses. Reproducing recent ML and forecasting results has become essential for developing new methods in operational settings. At the same time, replicability is a major concern for ESS and downstream applications and the necessary data accuracy needs further investigation. Research on data reduction and prediction interpretability helps improve understanding of data relationships and prediction stability.
In addition, new data spaces are being developed in Europe, such as the Copernicus Data Space Ecosystem and Green Deal Data Space, as well as multiple national data spaces. These provide access to data, through streamlined access, cloud processing and online visualization generating actionable knowledge enabling more effective decision-making. Analysis ready data can easily be accessed via API transforming data access and processing scalability. Developers and users will share opportunities and challenges of designing and using data spaces for research and industry.
This session connects developers and users of ESS big data, discussing how to facilitate the sharing, integration, and compression of these datasets, focusing on:
1) Approaches and techniques to enhance shareability of high-volume ESS datasets: data compression, novel data space implementation and evolution.
2) The effect of reduced data on the quality of scientific analyses.
3) Ongoing efforts to build data spaces and connect with existing initiatives on data sharing and processing, and examples of innovative services that can be built upon data spaces.
16:15–16:20
Presentation Wolfgang Wagner
16:20–16:30
|
EGU25-4155
|
solicited
|
On-site presentation
16:30–16:40
|
EGU25-17326
|
On-site presentation
16:40–16:50
|
EGU25-15282
|
On-site presentation
16:50–17:00
|
EGU25-11118
|
On-site presentation
17:00–17:05
Presentation Milan Klöwer
17:05–17:15
|
EGU25-13394
|
ECS
|
On-site presentation
17:15–17:25
|
EGU25-5977
|
On-site presentation
17:25–17:35
|
EGU25-7371
|
ECS
|
On-site presentation
17:35–17:45
|
EGU25-17172
|
ECS
|
On-site presentation
17:45–17:55
|
EGU25-20430
|
On-site presentation
17:55–18:00
Session end
X4.71
|
EGU25-12760
|
ECS
X4.73
|
EGU25-20188
|
ECS