Editorial Type:
Article
Article Type:
Research Article

Analysis of the Spread–Skill Relations Using the ECMWF Ensemble Prediction System over Europe

Simon C. Scherrer Swiss Federal Office of Meteorology and Climatology (MeteoSwiss), Zurich, Switzerland

Search for other papers by Simon C. Scherrer in
Current site
Google Scholar
PubMed Close
,
Christof Appenzeller Swiss Federal Office of Meteorology and Climatology (MeteoSwiss), Zurich, Switzerland

Search for other papers by Christof Appenzeller in
Current site
Google Scholar
PubMed Close
,
Pierre Eckert Swiss Federal Office of Meteorology and Climatology (MeteoSwiss), Geneva, Switzerland

Search for other papers by Pierre Eckert in
Current site
Google Scholar
PubMed Close
, and
Daniel Cattani Swiss Federal Office of Meteorology and Climatology (MeteoSwiss), Geneva, Switzerland

Search for other papers by Daniel Cattani in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jun 2004
DOI:
https://doi.org/10.1175/1520-0434(2004)019<0552:AOTSRU>2.0.CO;2
Page(s):
552–565
Restricted access

Abstract

The Ensemble Prediction System (EPS) of the European Centre for Medium-Range Weather Forecasts (ECMWF) was used to analyze various aspects of the ensemble-spread forecast-skill relation. It was shown that synoptic-scale upper-air spread measures can be used as first estimators of local forecast skill, although the relation was weaker than expected. The synoptic-scale spread measures were calculated based on upper-air fields (Z500 and T850) over western Europe for the period June 1997 to December 2000. The spread–skill relations for the operational ECMWF EPS were tested using several different spread definitions including a neural network-based measure. It was shown that spreads based on upper-air root-mean-square (rms) measures showed a strong seasonal cycle unlike anomaly correlation (AC)-based measures. The deseasonalized spread–skill correlations for the upper-air fields were found to be useful even for longer lead times (168–240 h). Roughly 68%–83% of small or large spread was linked to the corresponding high or low skill. A comparison with a perfect model approach showed the potential for improving the ECMWF EPS spread–skill relations by up to 25–30 correlation percentage points for long lead times.

Local forecasts issued by operational forecasters for the Swiss Alpine region, as well as station precipitation forecasts for Geneva were used to test the limits of the synoptic-scale upper-air spread as an estimator of local surface skill. A weak relation was found for all upper-air spread measures used. Although the probabilistic EPS direct model precipitation forecast for Geneva exhibited a considerable bias, the spread–skill relation was recovered at least up to 144 h. A neural network downscaling technique was able to correct the precipitation forecast bias, but did not increase the synoptic-scale spread surface-skill relation.

Corresponding author address: Simon C. Scherrer, MeteoSwiss, Kraehbuehlstrasse 58, Postfach 514, CH-8044 Zurich, Switzerland. Email: simon.scherrer@meteoswiss.ch

Abstract

The Ensemble Prediction System (EPS) of the European Centre for Medium-Range Weather Forecasts (ECMWF) was used to analyze various aspects of the ensemble-spread forecast-skill relation. It was shown that synoptic-scale upper-air spread measures can be used as first estimators of local forecast skill, although the relation was weaker than expected. The synoptic-scale spread measures were calculated based on upper-air fields (Z500 and T850) over western Europe for the period June 1997 to December 2000. The spread–skill relations for the operational ECMWF EPS were tested using several different spread definitions including a neural network-based measure. It was shown that spreads based on upper-air root-mean-square (rms) measures showed a strong seasonal cycle unlike anomaly correlation (AC)-based measures. The deseasonalized spread–skill correlations for the upper-air fields were found to be useful even for longer lead times (168–240 h). Roughly 68%–83% of small or large spread was linked to the corresponding high or low skill. A comparison with a perfect model approach showed the potential for improving the ECMWF EPS spread–skill relations by up to 25–30 correlation percentage points for long lead times.

Local forecasts issued by operational forecasters for the Swiss Alpine region, as well as station precipitation forecasts for Geneva were used to test the limits of the synoptic-scale upper-air spread as an estimator of local surface skill. A weak relation was found for all upper-air spread measures used. Although the probabilistic EPS direct model precipitation forecast for Geneva exhibited a considerable bias, the spread–skill relation was recovered at least up to 144 h. A neural network downscaling technique was able to correct the precipitation forecast bias, but did not increase the synoptic-scale spread surface-skill relation.

Corresponding author address: Simon C. Scherrer, MeteoSwiss, Kraehbuehlstrasse 58, Postfach 514, CH-8044 Zurich, Switzerland. Email: simon.scherrer@meteoswiss.ch

Save
Cover Weather and Forecasting
Weather and Forecasting

  • Atger, F., 1999: The skill of ensemble prediction systems. Mon. Wea. Rev, 127 , 1941–1953.

  • Barker, T. W., 1991: The relationship between spread and forecast error in extended range forecasts. J. Climate, 4 , 733–742.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Brankovic, C., Palmer T. N. , Molteni F. , Tibaldi S. , and Cubasch U. , 1990: Extended-range predictions with ECMWF models: Time-lagged ensemble forecasting. Quart. J. Roy. Meteor. Soc, 116 , 867–912.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distribution of the ECMWF Ensemble Prediction System. Mon. Wea. Rev, 125 , 99–119.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Buizza, R., and Palmer T. N. , 1995: The singular-vector structure of the atmospheric general circulation. J. Atmos. Sci, 52 , 1434–1456.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Buizza, R., and Palmer T. N. , 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev, 126 , 2502–2518.

  • Buizza, R., and Hollingsworth A. , 2000: Severe weather prediction using the ECMWF EPS. ECMWF Newsletter, No. 89, 2–12.

  • Chessa, P. A., and Lalaurette F. , 2001: Verification of the ECMWF Ensemble Prediction System forecasts: A study of large-scale patterns. Wea. Forecasting, 16 , 611–619.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Eckert, P., and Cattani D. , 1997: Classification of ECMWF ensemble forecast members with the help of a neural network. Report on expert meeting on ensemble prediction system (17–18 June 1996), ECMWF, 75 pp. [Available from Library, European Centre for Medium-Range Weather Forecasts, Shinfield Park, Reading, Berkshire RG2 9AX, United Kingdom.].

    • Search Google Scholar
    • Export Citation

  • Eckert, P., Cattani D. , and Ambühl J. , 1996: Classification of ensemble forecasts by means of an artificial neural network. Meteor. Appl, 3 , 169–178.

    • Search Google Scholar
    • Export Citation

  • Epstein, E. S., 1969: Stochastic dynamic prediction. Tellus, 21 , 739–759.

  • Jewson, S., cited 2003: Use of likelihood for measuring the skill of probabilistic forecasts. [Available online at http://arxiv.org/PS_cache/physics/pdf/0308/0308046.pdf.].

    • Search Google Scholar
    • Export Citation

  • Ledermann W. Ed., , 1984: Statistics. Vol. 6. Handbook of Applicable Mathematics, J. Wiley and Sons, 1102 pp.

  • Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev, 102 , 409–418.

  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci, 20 , 130–141.

  • Molteni, F., Buizza R. , Palmer T. N. , and Petroliagis T. , 1996: The ECMWF Ensemble Prediction System: Methodology and validation. Quart. J. Roy. Meteor. Soc, 122 , 73–119.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Orrell, D., Smith L. , Barkmeijer J. , and Palmer T. N. , 2001: Model error in weather forecasting. Nonlinear Processes Geophys, 8 , 357–371.

  • Ott, E., 1993: Chaos in Dynamical Systems. Cambridge University Press, 385 pp.

  • Palmer, T. N., 2000: Predicting uncertainty in forecasts of weather and climate. Rep. Prog. Phys, 63 , 71–116.

  • Palmer, T. N., Mureau R. , and Molteni F. , 1990: The Monte Carlo forecast. Weather, 45 , 198–207.

  • Persson, A., 2001: User guide to ECMWF forecast products. Meteorological Bulletin M3.2, ECMWF, 113 pp.

  • Roulston, M. S., and Smith L. A. , 2002: Evaluating probabilistic forecasts using information theory. Mon. Wea. Rev, 130 , 1653–1660.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Roulston, M. S., and Smith L. A. , 2003: Combining dynamical and statistical ensembles. Tellus, 55A , 16–30.

  • Simmons, A. J., and Coauthors, 2000: Forecasting system performance in summer 1999. ECMWF Tech. Memo. 322, ECMWF, 31 pp.

  • Strauss, B., and Lanzinger A. , 1995: Validation of the ECMWF Ensemble Prediction System. Proc. Seminar on Predictability, Vol. II, Reading, United Kingdom, ECMWF, 157–166.

    • Search Google Scholar
    • Export Citation

  • Tennekes, H., Baede A. P. M. , and Opsteegh J. D. , 1987: Forecasting forecast skill. Proc. Workshop on Predictability in the Medium and Extended Range, Reading, United Kingdom, ECMWF, 277– 302.

    • Search Google Scholar
    • Export Citation

  • Toth, Z., and Kalnay E. , 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc, 74 , 2317–2330.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Toth, Z., Zhu Y. , and Marchok T. , 2001: The use of ensembles to identify forecasts with small and large uncertainty. Wea. Forecasting, 16 , 463–477.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 1995: Statistical Methods in the Atmosphere. International Geophysics Series, Vol. 59, Academic Press, 467 pp.

  • Wilson, L. J., 1995: Verification of weather element forecasts from an ensemble prediction system. Proc. Fifth Workshop on Meteorological Operational Systems, Reading, United Kingdom, ECMWF, 114–126.

    • Search Google Scholar
    • Export Citation

  • Ziehmann, C., 2001: Skill prediction of local weather forecasts based on the ECMWF ensemble. Nonlinear Processes Geophys, 8 , 419–428.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1121 413 74
PDF Downloads 656 139 12