Towards onset: shades of ENSO skill

Climate forecast skill for the El Nino-Southern Oscillation (ENSO) is better than chance, but has increased little in recent decades. Further, the relative skill of dynamical and statistical models varies in skill assessments, depending on choices made about how to evaluate the forecasts. Using a suite of models from the North American Multi-Model Ensemble (NMME) archive we outline the consequences for skill of how the bias corrections and forecast anomalies are formed. We show that the method for computing forecast anomalies is such a critical part of the provenance of a skill score that any score for forecast anomalies lacking clarity about the method is open to wide interpretation. Many assessments of hindcast skill are likely to be overestimates of attainable forecast skill because the hindcast anomalies are informed by observations over the period assessed that would not be available to a real forecast. The relative skill rankings of forecast models can change between hindcast and forecast systems because the impact of model bias on skill is sensitive to the ways in which forecast anomalies are formed. Dynamical models are found to be more skillful than simple statistical models for forecasting the onset of El Nino events.