Comprehensive evaluations of Earth Systems Science Prediction (ESSP) systems (e.g., numerical weather prediction, hydrologic prediction, climate prediction and projection, etc.) are essential to understand sources of prediction errors and to improve earth system models. However, numerous roadblocks limit the extent and depth of ESSP system performance evaluations. Observational data used for evaluation are often not representative of the physical structures that are being predicted. Satellite and other large spatial and temporal observations datasets can help provide this information, but the community lacks tools to adequately integrate these large datasets to provide meaningful physical insights on the strengths and weaknesses of predicted fields. ESSP system evaluations also require large storage volumes to handle model simulations, large spatial datasets, and verification statistics which are difficult to maintain. Standardization, infrastructure, and communication in one scientific field is already a challenge. Bridging different communities to allow knowledge transfers, is even harder. The development of innovative methods in open frameworks and platforms is needed to enable meaningful and informative model evaluations and comparisons for many large Earth science applications from weather to climate.

The purpose of this Open Science 2.0 session is to bring experts together to discuss innovative methods for integrating, managing, evaluating, and disseminating information about the quality of ESSP fields in meaningful way. Presentations of these innovative methods applied to Earth science applications is encouraged. The session should generate some interest in communities and research projects building and maintaining these systems (e.g. ESMVal, Copernicus, Climaf, Freva, Birdhouse, MDTF, UV-CDAT, CMEC - PCMDI Metrics Package, Doppyo, MET-TOOLS, CDO, NCO, etc.). The session allows room for the exchange of ideas. An outcome of this session is to connect the scientists, develop a list of tools and techniques that could be developed and provided to the community in the future.