RAT (Robustness Assessment Test): a straightforward evaluation of hydrological model robustness to a changing climate

Hydrological models are increasingly used under evolving climatic conditions. They should thus be evaluated regarding their temporal transferability (application in different time periods) and extrapolation capacity (application beyond the range of known past conditions). In theory, parameters of hydrological models are independent of climate. In practice, however, many published studies based on the Split-Sample Test (Klemeš, 1986), have shown that model performances decrease systematically when it is used out of its calibration period. The RAT test proposed here aims at evaluating model robustness to a changing climate by assessing potential undesirable dependencies of hydrological model performances to climate variables. The test compares, over a long data period, the annual value of several climate variables (temperature, precipitation and aridity index) and the bias of the model over each year. If a significant relation exists between the climatic variable and the bias, the model is not considered to be robust to climate change on the catchment. The test has been compared to the Generalized Split-Sample Test (Coron et al., 2012) and showed similar results.

Here, we report on a large scale application of the test for three hydrological models with different level of complexity (GR6J, HYPE, MIKE-SHE) on a data set of 352 catchments in Denmark, France and Sweden. The results show that the test behaves differently given the evaluated variable (be temperature, precipitation or aridity) and the hydrological characteristics of each catchment. They also show that, although of different level of complexity, the robustness of the three models is similar on the overall data set. However, they are not robust on the same catchments and, then, are not sensitive to the same hydrological characteristics. This example highlights the applicability of the RAT test regardless of the model set-up and calibration procedure and its ability to provide a first evaluation of the model robustness to climate change.

 

References

Coron, L., V. Andréassian, C. Perrin, J. Lerat, J. Vaze, M. Bourqui, and F. Hendrickx, 2012. Crash testing hydrological models in contrasted climate conditions: An experiment on 216 Australian catchments, Water Resour. Res., 48, W05552, doi:10.1029/2011WR011721

Klemeš, V., 1986. Operational testing of hydrological simulation models, Hydrol. Sci. J., 31, 13–24, doi:10.1080/02626668609491024