EGU22-3103
https://doi.org/10.5194/egusphere-egu22-3103
EGU General Assembly 2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.

Connecting spatial climate information to infrastructure operations using deep reinforcement learning

Liam Ekblad1, Jonathan Herman1, Scott Steinschneider2, Matteo Giuliani3, and Andrea Castelletti3
Liam Ekblad et al.
  • 1University of California Davis, Davis, United States of America
  • 2Cornell University, Ithaca, United States of America
  • 3Politecnico di Milano, Milan, Italy

Water infrastructure operations can adapt to both short-term variability and long-term change. Studies that have leveraged climate information to reoperate infrastructure have yet to explore the direct use of spatially distributed information in operating policy training, which could enable learning from weather patterns associated with emerging risks—for example, flood and drought events associated with atmospheric rivers or high-pressure ridges, respectively, which result from co-occurring weather and climate patterns on multiple timescales. This study investigates the potential for spatial projections from large-ensemble climate models to directly inform reservoir operating policies using a deep reinforcement learning strategy, aiming to discover flexible, climate-informed policies without prior dimension reduction, which could cause loss of information. The approach is demonstrated for Folsom Reservoir in California. We investigate how learned policies interpret spatial climate information by connecting flood control and water supply shortage operations to the sensitivity and salience patterns associated with the input images. To assess the extent to which trained policies generalize to possible future climates, policies trained on historical data are tested on held-out scenarios drawn from the same period, and their performance is compared to flood and shortage scenarios drawn from a future period. Trained policies are robust to the variability present across climate model ensembles, demonstrate value in identifying spatial climate patterns for operations, and maintain the flexibility to dynamically adapt to climate change as it occurs, illustrating a broad benefit to global infrastructure systems facing climate risks.

How to cite: Ekblad, L., Herman, J., Steinschneider, S., Giuliani, M., and Castelletti, A.: Connecting spatial climate information to infrastructure operations using deep reinforcement learning, EGU General Assembly 2022, Vienna, Austria, 23–27 May 2022, EGU22-3103, https://doi.org/10.5194/egusphere-egu22-3103, 2022.

Displays

Display file