Open Data for Impact: how to use the Open Data on Amazon Web Services to advance analysis

When data is made accessible in the cloud, you can shorten the time to insights and help build impactful offerings for climate modelers and stakeholders. When data is shared on the Registry of Open Data on AWS, anyone can analyze it and build services on top of it using a broad range of compute and data analytics products, including Amazon EC2, Amazon Athena, AWS Lambda, and Amazon EMR. Sharing data in the cloud lets data users spend more time on data analysis rather than data acquisition. Just putting data into the cloud isn’t enough. In this session, the Amazon Web Services (AWS) Open Data team will discuss different options for creating cloud-optimized versions of data, that can be more efficiently utilized in the cloud. We will discuss the various options and trade-offs, such as when to create a full cloud optimized copy versus when to create a subset for your user community. We discuss how to match up the different options based on different levels of traffic, newness of data, and typical types of processing of the data. We will show how to use high quality climate and environmental datasets with the Registry of Open Data on AWS when they are cloud optimized and when they are not, and discuss the time difference for the data consumer between each option. Additionally, we will also show how to harness these data using low- and no-code machine learning tools such as SageMaker and SageMaker Studio Lab, using cloud-optimized capabilities such as subsetting, and how these capabilities can speed up the time from data to decision.