A modernised Data Store infrastructure for improving the access to Copernicus Climate and Atmosphere data and services.

The Copernicus Climate (CDS) and Atmosphere (ADS) Data Stores implemented by ECMWF on behalf of the EC are instances of a shared underlaying infrastructure which was designed as a distributed system and open framework to provide seamless web-based and API-based access to a wide catalogue of datasets, tools, applications and other digital information fulfilling the objectives of the Services. Such an approach also allowed the implementation ofquality controlled standards. The infrastructure also integrates a Toolbox platform to perform operations and create web-based applications .that can be subsequently made available to end-users within the Data Store portals or even embedded on external platforms as in the case of Climate-Adapt (EEA). Due to the adoption of FAIR guiding principles (Findable, Accessible, Interoperable, Reusable) and international recognized standards across different components of the infrastructure, the Data Stores are currently able to interoperate and establish close synergies with other data and services platforms such as WEkEO. The Data Store infrastructure is hosted in an on-premises Cloud physically located within ECMWF premises in Bologna providing elasticity of resources and automated deployment capabilities. 

Having grown at a steady rate in terms of users, functional capabilities, workload and content since their official opening, the infrastructure is now looking to the new challenges and opportunities that lay ahead. In the coming future the Data Stores will remain at the core of both C3S and CAMS Services but the underlaying infrastructure is in the process for being further improved.  Taking onboard operational experience, user feedback, lessons learned, know-how and updated technologies which may have evolved since the initial implementation are the key priorities of this new phase. The final objective of this modernisation effort is to make the current services more accessible and fully embrace Open-Source scientific software to ensure compatibility with state-of-the-art solutions such as machine learning, data cubes and interactive notebooks.  In summary the Data Stores are evolving into a modern, cloud-based, more usable and interoperable infrastructure that will allow to: better meet the evolving requirements, scale-up according to increased demand, strengthen synergies with other platforms such as WEkEO, contribute to related initiatives such as the Destination Earth system and become a core building block for the European green and digital transformation. 

After several years in operation, more than 130k registered users and daily rates of 90 TB of data delivered , the aim of this presentation is to guide the audience through the past and present of the Climate and Atmosphere Data Stores and their Toolbox and engage participants into a discussion about the future infrastructure which is currently under development.