4-9 September 2022, Bonn, Germany
OSA1.4
Probabilistic and ensemble forecasting from short to seasonal time scales

OSA1.4

Probabilistic and ensemble forecasting from short to seasonal time scales
Convener: Andrea Montani | Co-conveners: Jan Barkmeijer, Fernando Prates
Orals
| Fri, 09 Sep, 09:00–10:30 (CEST)|Room HS 7
Posters
| Attendance Fri, 09 Sep, 11:00–13:00 (CEST) | Display Thu, 08 Sep, 08:00–Fri, 09 Sep, 14:00|b-IT poster area

Orals: Fri, 9 Sep | Room HS 7

Chairpersons: Andrea Montani, Fernando Prates
09:00–09:15
|
EMS2022-644
|
Onsite presentation
|
Zied Ben Bouallegue

The crossing-point forecast (CPF) is a new concept in the field of probabilistic forecasting. A CPF is defined by the intersection between a forecast cumulative distribution and the corresponding climatology distribution. Focusing on this intersection point, a probabilistic forecast is summarized into a single number conveying information about a "probabilistic worst-case scenario" with respect to climatology. Is the predicted chance of suffering a loss, due to the occurrence of an (exceedance) event, higher than that event’s climatological frequency? The crossing-point forecast indicates the limit case for which the answer is positive.

The outcome corresponding to a CPF, called “crossing-point observation”, is directly related to the return period of the event that materializes. A simple error function that applies to the forecast and observed crossing-points is formulated. The resulting score is closely related to the diagonal score: it is proper and equitable which makes its application appealing for the comparison of competing forecasts. The proposed scoring function is consistent for the crossing-point forecast in a similar way as the root mean squared error is consistent for the distributional mean forecast or the mean absolute error is consistent for the 50%-quantile forecast.

In weather forecasting, the information provided by CPF could be highly relevant for vulnerable users and more generally for users with interest for high-impact events. We propose here a comparison with the Extreme Forecast Index (EFI) using the ensemble forecast of the Integrated Forecasting System run at ECMWF and the corresponding model climatology. The EFI is designed to provide forecasters with general initial guidance on potential extreme weather events. Both EFI and CPF are derived using the same ingredients which makes their comparison particularly relevant. Based on case studies and verification metrics, we illustrate the complementarity of the two types of forecasts.

How to cite: Ben Bouallegue, Z.: On the crossing-point forecast, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-644, https://doi.org/10.5194/ems2022-644, 2022.

09:15–09:30
|
EMS2022-489
|
Onsite presentation
Chiara Marsigli and Christoph Gebhardt

Convection-permitting ensemble forecasting is well established as a tool to support the prediction of severe weather and high-impact weather in several meteorological centres. At the Deutscher Wetterdienst, ICON-D2-EPS is the limited-area high-resolution component of the ICON modeling system, running as an ensemble of 20 members at 2 km horizontal resolution over Germany and surrounding areas. Several products to support operational forecasting and warning issuing are regularly issued. The perturbed initial conditions are provided by the km-scale ensemble data assimilation system KENDA, run at the same resolution, assimilating a wide range of observations, included radar-derived radar volumes. Boundary conditions are provided by ICON-EPS, the global ensemble with a refinement at 20 km on Europe. Simple model perturbations are applied by Parameter Perturbation, where a set of parameters of the physics parametrisation schemes are perturbed with respect to the default value. In this work, the effect of the model perturbation is studied, by assessing how it contributes to generate diversity between the members for case studies, as compared to a standard operational verification carried out on periods, and how it influences the ensemble spread, in addition to the initial and boundary condition perturbations. The extent to which the ensemble spread is able to represent forecast uncertainty is discussed for near-surface weather parameters. The effect of increasing the amplitude of the parameter perturbation is also addressed. Finally, the impact of the parameter perturbation is discussed in comparison with physically-based perturbation methods which have been implmented and tested in ICON thanks to collaborative works.

How to cite: Marsigli, C. and Gebhardt, C.: Comparative studies of model perturbations for ICON-D2-EPS., EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-489, https://doi.org/10.5194/ems2022-489, 2022.

09:30–09:45
|
EMS2022-356
|
CC
|
Onsite presentation
|
Nikolaos Mastrantonas, Luca Furnari, Linus Magnusson, Alfonso Senatore, Giuseppe Mendicino, Florian Pappenberger, and Jörg Matschullat

Extreme precipitation events pose a great threat to society, the economy, and the environment with devastating consequences like floods and landslides. Improved forecasting of this hazard, combined with adequate Early Warning Systems, can thus support the mitigation of the associated negative impacts. Here, we propose new forecasting products that substantially improve predictions of extreme precipitation events at different timescales, from short- to medium- and extended-range forecasts. Our study focuses on forecasting extreme rainfall in Calabria, south Italy. This region, located in the central Mediterranean, has a complex and abruptly varying topography that poses additional challenges in precipitation formation and forecasting. For this work we use data from three sources; observational precipitation from the EOBS dataset, modelled atmospheric fields from ERA5 reanalysis, and forecasted atmospheric fields from ECMWF reforecasts for 1 up to 45 days lead time. Based on our analysis we show that different forecasting horizons require different forecasting products. More specifically, bias-correcting the precipitation forecasts for short- to medium-range lead times provides the most informative outputs to end-users. For extended-range forecasts though, this method is not sufficient, as it cannot outperform the reference score based on climatological information. For such extended lead times, it is beneficial to use the large-scale weather variability to infer reliable information about extreme precipitation. This can be accomplished by connecting Mediterranean-wide weather patterns, with the probability of extreme precipitation in Calabria. We present the benefits of the methods, based on long-term statistical analysis using a range of indicators, such as the Brier skill score, and the reliability diagram.

How to cite: Mastrantonas, N., Furnari, L., Magnusson, L., Senatore, A., Mendicino, G., Pappenberger, F., and Matschullat, J.: Forecasting extreme precipitation in the central Mediterranean: Different products for different timescales, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-356, https://doi.org/10.5194/ems2022-356, 2022.

09:45–10:00
|
EMS2022-330
|
Onsite presentation
|
Jonas Bhend, Christoph Spirig, Lionel Moret, and Mark A. Liniger

Automated forecasting provides the basis for everyday forecast products used by a wide range of users. Continued progress in numerical weather prediction allows to produce local forecasts with considerable accuracy. To further reduce systematic errors and thereby render such local forecasts more beneficial to users, statistical postprocessing can be employed. While statistical postprocessing can readily be optimized for specific applications, optimization is less straight forward for general-purpose forecasts that are used across a diversity of applications and decisions. This issue is illustrated with ensemble postprocessing for automated precipitation forecasts.

While medium-range precipitation forecasts are often communicated with hourly granularity, beyond the nowcasting range most applications are likely less affected by the precise timing of precipitation. In contrast, (sub-)daily aggregated precipitation  may be a more relevant quantity. In addition, predictability of hourly precipitation is generally very limited days in advance and statistical postprocessing for hourly precipitation forecasts will therefore be strongly affected by the regression-to-the-mean problem (i.e. statistical postprocessing resorts to issuing climatological forecasts in the absence of predictability). To overcome the above issues, we propose a combined postprocessing approach operating on daily aggregated precipitation and hourly fractions of daily precipitation. We present results for a simple disaggregation according to the NWP precipitation and disaggregation according to a separate postprocessing of the hourly fraction of daily totals. The latter approach allows us to correct systematic biases in the diurnal cycle of precipitation occurrence particularly relevant for convective situations in complex topography as is the case in Switzerland. The same approach can be used to extend daily precipitation forecasts into the sub-seasonal to seasonal range.

How to cite: Bhend, J., Spirig, C., Moret, L., and Liniger, M. A.: Multi-resolution postprocessing for precipitation, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-330, https://doi.org/10.5194/ems2022-330, 2022.

10:00–10:15
|
EMS2022-457
|
Onsite presentation
|
Estíbaliz Gascón, Augustin Vintzileos, and Tim Hewson

Ideally, weather forecasts should be provided for points and not for the large regions represented by global model grid boxes. This requirement can be addressed by post-processing global forecast model output, as in “ecPoint”, an innovative statistical technique developed by ECMWF that uses decision trees and non-local calibration. Products from ecPoint explicitly incorporate the expected sub-grid variability and gridscale bias correction (which both vary according to a diagnosed “grid-box weather type”). Pre-existing 6-h (currently running in CINECA supercomputer facilities in Bologna) and 12-h ecPoint-Rainfall forecasts products are currently being provided by ECMWF in real-time, using shorter range (day 1-15) twice daily predictions at 18km resolution. These probabilistic forecasts have exhibited clear improvements, in both reliability and resolution, relative to the raw model output.

The HIGHLANDER (HIGH-performance computing to support smart LAND sERvices) project started in 2018, funded under the Connecting Europe Facility (CEF) – Telecommunication Sector Programme of the European Union. One of its main goals is the data processing for more intelligent and sustainable management of natural resources and the territory. And one component of this, managed by ECMWF, is exploiting the CINECA HPC capacity to extract maximum benefit from the ecPoint technique. The specific aims here are to improve probabilistic 24-h rainfall and 2m temperature representation in sub-seasonal forecasts and in the ERA5 reanalysis. ecPoint benefits tend to be more significant when working at a lower resolution, so downscaling from 36km in the sub-seasonal forecast and 31 km in ERA5 can in principle deliver greater improvements for users (relative to raw model and reanalysis output) than we have seen in the Medium-Range forecast products.

The final ecPoint sub-seasonal products cover lead times of 16 to 30 days. They provide more reliable climatological representations, for points on the land surface than raw model output (e.g. numbers of dry or wet days, days of freezing temperatures, which are both relevant for agricultural applications). Meanwhile, ERA5 ecPoint products are the first global probabilistic reanalysis products to have incorporated bias-corrected uncertainty information at point scale. ecPoint products for both systems comprise 24-h accumulated rainfall and daily minimum, maximum and mean 2m temperature, for percentiles (1, 2,..99) and (derived from these) probabilities of exceeding certain thresholds. Global outputs are created, but a particular focus is Italy, and surrounding Mediterranean areas, to assist with agricultural planning, to deliver benefits in both economic and resource availability terms.

In this presentation, we will describe ECMWF activities in HIGHLANDER and the methods applied to create the final probabilistic forecast and reanalysis products.

How to cite: Gascón, E., Vintzileos, A., and Hewson, T.: New probabilistic point forecast products ("ecPoint") for sub-seasonal forecasts and the ERA5 reanalysis -  the HIGHLANDER project, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-457, https://doi.org/10.5194/ems2022-457, 2022.

10:15–10:30
|
EMS2022-231
|
Online presentation
Otto Hyvärinen and Andrea Vajda

The skilful forecasts of snow depth and the snow cover on the sub-seasonal and seasonal scale would be useful for many sectors. In the EU H2020 e-shape project we developed and piloted sub-seasonal and seasonal forecasts involving the snow. The final products were tailored forecasts of winter street maintenance for the City of Helsinki and forecasts of winter tyre season and safe driving conditions in Finland for the tyre company Vianor. We used the extended-range forecasts of the ECMWF and SEAS5 long-range forecasts of ECMWF available from C3S (at the reduced spatial resolution). For the evaluation, seasonal forecasts from MARS (at the original resolution) were also used. On the seasonal scale, the different spatial resolutions of the CDS and MARS can influence the results of the surface-based variables, such as snow, more than, for example, 2m temperature. 

As snow is somewhat slowly evolving surface phenomenon, its forecasts might remain skilful longer than atmospheric variables, such as 2m temperature. There are also seasonal differences in predictability of snow. This is explained partly by the amount of snow present, but we also examine if the melting snow in spring is more predictable than the transient snow in autumn before the permanent snow cover.  

We tested several bias-adjustment methods, such as the mean bias removal and the parametric quantile mapping (QM), but, based on the preliminary results, we concentrated on non-parametric empirical QM (EQM) and ensemble model output statistics (EMOS). As a non-parametric method, EQM is very flexible and does not require many preconditions on the data, but it does not ensure forecast reliability and coherence and is therefore not a wholly satisfactory method. The distributions of weekly and monthly values are rather Gaussian and encourage using EMOS, but while the non-Gaussian aspects of the weekly and monthly distributions can be mitigated using the censored or truncated Gaussian distributions, the model can break when only small amounts of snow are present. Also, a constant spread should be used in EMOS, as standard deviation of ensemble members is no longer a good estimate of uncertainty for longer time scales.  

We used both in-situ observations and the ERA5 reanalysis for verification and the problem of representativeness of observation for verification was examined. Using point-like in-situ observations is too optimistic for verification of sub-seasonal and seasonal forecasts, and smoothed analysis of ERA5, interpolated to the same resolution as the forecasts, gives more realistic results. However, the interpretation of the ERA5-based results might be a bit challenging for the end-user, who is often interested in the very small-scale features and would like to “zoom in” as much as possible. Here training and co-design with the end-users are needed to fully exploit the value of forecasts. 

How to cite: Hyvärinen, O. and Vajda, A.: Bias adjustment and skill assessment of sub-seasonal and seasonal snow depth forecasts for Finland, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-231, https://doi.org/10.5194/ems2022-231, 2022.

Poster introduction
Display time: Thu, 8 Sep 08:00–Fri, 9 Sep 14:00

Posters: Fri, 9 Sep, 11:00–13:00 | b-IT poster area

Chairperson: Andrea Montani
P6
|
EMS2022-280
|
Onsite presentation
An Improved Version of the Localized Mixture Coefficients Particle Filter Applied to the Regional ICON-LAM Model at DWD
(withdrawn)
Nora Schenk, Anne Walter, and Roland Potthast
P7
|
EMS2022-529
|
Onsite presentation
Emmanouil Flaounas and Platon Patlakas

The Mediterranean Basin is a region characterized by intense cyclonic activity associated with events of extreme and adverse weather, often having high social and economic impact. The genesis and further development of these cyclones is strongly dependent to preceding Rossby wave breaking over the Atlantic Ocean. However, the accurate reproduction of such Rossby wave breaking is a challenging issue for numerical weather prediction (NWP) limiting the predictability of Mediterranean cyclones to lead times of typically no more than 5 days.

To better understand the sensitivity of forecast systems in predicting Mediterranean cyclogenesis and for further advancing with adequate ensemble approaches for NWP, we have developed a new scheme of stochastic parameter perturbation of physical tendencies (SPPT). The new SPPT scheme has been implemented into WRF and consists of random perturbations which are applied solely to coherent 3D objects of potential vorticity (PV) components that are produced by physical parametrisations. Given the invertibility trait of PV, these 3D objects are expected to significantly affect the forecasted atmospheric state with inherent uncertainties to physical parametrisations and consequent model errors.

A scenario tested for the needs of the study is the Mediterranean tropical-like cyclone (medicane) Zorbas that took place in September 2018; an event characterized by difficulties in adequately forecasting the cyclogenesis stage. Overall, our results quantify the sensitivity of NWP of Mediterranean cyclogenesis and highlight our scheme as an attractive alternative to classic approaches producing significant ensemble spread.

How to cite: Flaounas, E. and Patlakas, P.: Providing a physical basis to SPPT through the identification of weather features as coherent objects of potential vorticty anomalies: application to Mediterranean cyclogenesis, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-529, https://doi.org/10.5194/ems2022-529, 2022.

P8
|
EMS2022-654
|
Onsite presentation
Malte Schmidt, Jan Bondy, Vanessa Fundel, and Ulrich Blahak

Ensemble prediction systems have evolved as a standard in modern weather prediction. At the same time, with an increasing number of members and higher spatiotemporal resolution, the amount of data produced is growing fast. However, not all operational users are able to process the increasing amount of data, which calls for methods to reduce ensemble information.

The SINFONY project at Deutscher Wetterdienst (DWD) focuses on the probabilistic forecasting and Nowcasting-NWP combination of precipitation, with the aim of better representing convective heavy rainfall events. Ensemble reduction of SINFONY output data is based on two concepts. Firstly, it aims to compact the information of an ensemble into a new, combined member (the “pseudo-deterministic” member). The second approach is to retain most of the information in a member-reduced ensemble that also contains the newly created pseudo-deterministic member. This postprocessing of an ensemble can be helpful to users that have limited computational power at their disposal but still want to benefit from the probabilistic information of the ensemble. Another application of the pseudo-deterministic product could be its visualisation as a map with locally the most probable precipitation scenario.

The pseudo-deterministic member is defined as the locally most probable forecast of the ensemble identified by a k-means-based clustering of the members in limited areas and blending the resulting best local forecasts back together. This leads to a mixed forecast that is supposed to have higher statistical skill averaged over the model domain (here, Germany) compared to the weather model’s deterministic member. In addition, the clustering can also be used for the identification of precipitation scenarios that differ significantly from the locally most probable precipitation. As a result, a reduced ensemble can be derived that contains a large part of the forecast distribution. In this poster, we present and evaluate the developed algorithm for the ensemble reduction and explore how skill depends on the number of reduced ensemble members in convective weather situations. 

How to cite: Schmidt, M., Bondy, J., Fundel, V., and Blahak, U.: “Pseudo-deterministic” precipitation products, a clustering-based approach to combine and reduce ensemble information, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-654, https://doi.org/10.5194/ems2022-654, 2022.

P9
|
EMS2022-386
|
Onsite presentation
|
Hyuncheol Shin, Eun Jung Kim, Sug-gyeong Yun, Hyun-Suk Kang, Young Cheol Kwon, and Jong-Kil Park

A multi-model ensemble prediction system that integrates UM (Unified Model) global and ensemble models, ECMWF global and ensemble models, and KIM (Korean Integrated Model) global model was established and its performance was evaluated. KIM is KMA’s new generation model which is based on the cubed sphere grid system and has 12km horizontal resolution and 91 vertical levels. It was developed over 9 years from 2011 to 2019 and operationally launched in April 2020.
The optimal mean field was produced by weighted average of 5 models, where the weights were given inversely proportional to the error of each model.
As a result of comparing RMSE (Root Mean Square Error) of the multi-model ensemble with 5 member models, a multiple-model ensemble showed better performance than any other member model. It was better than ECMWF ensemble model which showed the best performance among member models. In RMSE score, Mean Surface pressure was improved by 3.1% and 500hPa geopotential height was improved by 2.1% against ECMWF ensemble model. 
The performance of a multi-model ensemble by various weight calculation methods which are used for weighted averaging was compared. It was found that horizontally domain-averaged weight, having the different value for the forecast time gave the best performance. Giving the detailed and complex weights differently for each forecast time and each grid point rather degraded the performance of a multi-model ensemble.
In BIAS verification, it was found that the BIAS of the multi-model ensemble showed the value between the maximum BIAS and the minimum BIAS of member models. Therefore, it was found that when the BIAS of the member models was distributed in a balanced positive and negative directions without being biased in one direction, the multi-model ensemble showed the smallest BIAS.

How to cite: Shin, H., Kim, E. J., Yun, S., Kang, H.-S., Kwon, Y. C., and Park, J.-K.: Evaluation of a Multi-Model Ensemble Prediction System, EMS Annual Meeting 2022, Bonn, Germany, 5–9 Sep 2022, EMS2022-386, https://doi.org/10.5194/ems2022-386, 2022.

Supporters & sponsors