Editorial Type:
Article
Article Type:
Research Article

Improving Probabilistic Ensemble Forecasts of Convection through the Application of QPF–POP Relationships

Christopher J. Schaffer Department of Geological and Atmospheric Sciences, Iowa State University, Ames, Iowa

Search for other papers by Christopher J. Schaffer in
Current site
Google Scholar
PubMed Close
,
William A. Gallus Jr. Department of Geological and Atmospheric Sciences, Iowa State University, Ames, Iowa

Search for other papers by William A. Gallus Jr. in
Current site
Google Scholar
PubMed Close
, and
Moti Segal Department of Agronomy, Iowa State University, Ames, Iowa

Search for other papers by Moti Segal in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jun 2011
DOI:
https://doi.org/10.1175/2010WAF2222447.1
Page(s):
319–336
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

Four new approaches of postprocessing quantitative precipitation forecasts (QPFs) from model ensemble output were used to generate probability of precipitation (POP) tables in order to develop a forecasting method that could outperform a traditional method that relies upon calibration of POP forecasts derived using equal weighting of ensemble members. Early warm season 10-member ensemble output from the NOAA Hazardous Weather Testbed Spring Experiments was used, with 29 cases serving as a training set to create the POP tables and 20 cases used as a test set. The new approaches use QPF–POP relationships based on two properties termed precipitation amount characteristic (PAC) and ensemble member agreement. Exploratory results are presented for 20-km grid spacing and selectively for 4-km grid spacing. In the first approach, POPs were based on a binned PAC and the number of ensemble members with 6-h precipitation accumulations greater than given thresholds. In a second approach, a neighborhood method was used to find the number of points in a given neighborhood area around each of the domain grid points with precipitation amounts greater than a given threshold, while also considering the binned PAC representative of the neighborhood. A third approach synthesized the previous methods and led to an increase in skill relative to the individual methods, and a fourth approach using a combination of methods produced forecasts with even greater skill. All of the forecasts from the four approaches were improved statistically significantly compared to the calibrated traditional method’s forecasts at 20-km grid spacing. The second approach on its own showed skill comparable to that obtained by a traditional calibrated 10-member ensemble, so adopting this approach alone could potentially save computer resources that could then be used for model refinements, only sacrificing the increased skill that could have been obtained by using the fourth approach.

Current affiliation: National Weather Service, Goodland, Kansas.

Corresponding author address: Christopher J. Schaffer, National Weather Service, 920 Armory Rd., Goodland, KS 67735. E-mail: christopher.schaffer@noaa.gov

Abstract

Four new approaches of postprocessing quantitative precipitation forecasts (QPFs) from model ensemble output were used to generate probability of precipitation (POP) tables in order to develop a forecasting method that could outperform a traditional method that relies upon calibration of POP forecasts derived using equal weighting of ensemble members. Early warm season 10-member ensemble output from the NOAA Hazardous Weather Testbed Spring Experiments was used, with 29 cases serving as a training set to create the POP tables and 20 cases used as a test set. The new approaches use QPF–POP relationships based on two properties termed precipitation amount characteristic (PAC) and ensemble member agreement. Exploratory results are presented for 20-km grid spacing and selectively for 4-km grid spacing. In the first approach, POPs were based on a binned PAC and the number of ensemble members with 6-h precipitation accumulations greater than given thresholds. In a second approach, a neighborhood method was used to find the number of points in a given neighborhood area around each of the domain grid points with precipitation amounts greater than a given threshold, while also considering the binned PAC representative of the neighborhood. A third approach synthesized the previous methods and led to an increase in skill relative to the individual methods, and a fourth approach using a combination of methods produced forecasts with even greater skill. All of the forecasts from the four approaches were improved statistically significantly compared to the calibrated traditional method’s forecasts at 20-km grid spacing. The second approach on its own showed skill comparable to that obtained by a traditional calibrated 10-member ensemble, so adopting this approach alone could potentially save computer resources that could then be used for model refinements, only sacrificing the increased skill that could have been obtained by using the fourth approach.

Current affiliation: National Weather Service, Goodland, Kansas.

Corresponding author address: Christopher J. Schaffer, National Weather Service, 920 Armory Rd., Goodland, KS 67735. E-mail: christopher.schaffer@noaa.gov
Save
Cover Weather and Forecasting
Weather and Forecasting

  • Baldwin, M. E., and Mitchell K. E. , 1997: The NCEP hourly multisensory U.S. precipitation analysis for operations and GCIP research. Preprints, 13th Conf. on Hydrology, Long Beach, CA, Amer. Meteor. Soc., 54–55.

    • Search Google Scholar
    • Export Citation

  • Buizza, R., Hollingsworth A. , Lalaurette F. , and Ghelli A. , 1999: Probabilistic predictions of precipitation using the ECMWF Ensemble Prediction System. Wea. Forecasting, 14, 168–189.

    • Search Google Scholar
    • Export Citation

  • Chakraborty, A., and Krishnamurti T. N. , 2006: Improved seasonal climate forecasts of the South Asian summer monsoon using a suite of 13 coupled ocean–atmosphere models. Mon. Wea. Rev., 134, 1697–1721.

    • Search Google Scholar
    • Export Citation

  • Clark, A. J., Gallus W. A. Jr., Xue M. , and Kong F. , 2009: A comparison of precipitation forecast skill between small convection-allowing and large convection-parameterizing ensembles. Wea. Forecasting, 24, 1121–1140.

    • Search Google Scholar
    • Export Citation

  • Ebert, E. E., 2001: Ability of a poor man’s ensemble to predict the probability and distribution of precipitation. Mon. Wea. Rev., 129, 2461–2480.

    • Search Google Scholar
    • Export Citation

  • Ebert, E. E., 2008: Fuzzy verification of high resolution gridded forecasts: A review and proposed framework. Meteor. Appl., 15, 51–64.

    • Search Google Scholar
    • Export Citation

  • Ebert, E. E., 2009: Neighborhood verification: A strategy for rewarding close forecasts. Wea. Forecasting, 24, 1498–1510.

  • Gallus, W. A., Jr., 2002: Impact of verification grid-box size on warm-season QPF skill measures. Wea. Forecasting, 17, 1296–1302.

  • Gallus, W. A., Jr., and Segal M. , 2004: Does increased predicted warm-season rainfall indicate enhanced likelihood of rain occurrence? Wea. Forecasting, 19, 1127–1135.

    • Search Google Scholar
    • Export Citation

  • Gallus, W. A., Jr., Baldwin M. E. , and Elmore K. L. , 2007: Evaluation of probabilistic precipitation forecasts determined from Eta and AVN forecasted amounts. Wea. Forecasting, 22, 207–215.

    • Search Google Scholar
    • Export Citation

  • Gilleland, E., Ahijevych D. , Brown B. G. , Casati B. , and Ebert E. E. , 2009: Intercomparison of spatial forecast verification methods. Wea. Forecasting, 24, 1416–1430.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., and Colucci S. J. , 1997: Verification of Eta–RSM short-range ensemble forecasts. Mon. Wea. Rev., 125, 1312–1327.

  • Hamill, T. M., and Whitaker J. S. , 2006: Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Wea. Rev., 134, 3209–3229.

    • Search Google Scholar
    • Export Citation

  • Kong, F., and Coauthors, 2007: Preliminary analysis on the real-time storm-scale ensemble forecasts produced as a part of the NOAA Hazardous Weather Testbed 2007 Spring Experiment. Preprints, 22nd Conf. on Weather Analysis and Forecasting/18th Conf. on Numerical Weather Prediction, Park City, UT, Amer. Meteor. Soc., 3B.2. [Available online at http://ams.confex.com/ams/pdfpapers/124667.pdf.]

    • Search Google Scholar
    • Export Citation

  • Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev., 102, 409–418.

  • Mass, C. F., Ovens D. , Westrick K. , and Colle B. A. , 2002: Does increasing horizontal resolution produce more skillful forecasts? Bull. Amer. Meteor. Soc., 83, 407–430.

    • Search Google Scholar
    • Export Citation

  • Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595–600.

  • Roberts, N. M., and Lean H. W. , 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Mon. Wea. Rev., 136, 78–97.

    • Search Google Scholar
    • Export Citation

  • Schwartz, B. E., and Benjamin S. G. , 2000: Verification of RUC2 precipitation forecasts using the NCEP multisensory analysis. Preprints, Fourth Symp. on Integrated Observing Systems, Long Beach, CA, Amer. Meteor. Soc., 182–185.

    • Search Google Scholar
    • Export Citation

  • Schwartz, C. S., and Coauthors, 2010: Toward improved convection-allowing ensembles: Model physics sensitivities and optimizing probabilistic guidance with small ensemble membership. Wea. Forecasting, 25, 263–280.

    • Search Google Scholar
    • Export Citation

  • Skamarock, W. C., 2004: Evaluating mesoscale NWP models using kinetic energy spectra. Mon. Wea. Rev., 132, 3019–3032.

  • Theis, S. E., Hense A. , and Damrath U. , 2005: Probabilistic precipitation forecasts from a deterministic model: A pragmatic approach. Meteor. Appl., 12, 257–268.

    • Search Google Scholar
    • Export Citation

  • Tustison, B., Harris D. , and Foufoula-Georgiou E. , 2001: Scale issues in verification of precipitation forecasts. J. Geophys. Res., 106, 11 775–11 784.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.

  • Wilson, L. J., and Vallée M. , 2002: The Canadian Updateable Model Output Statistics (UMOS) system: Design and development tests. Wea. Forecasting, 17, 206–222.

    • Search Google Scholar
    • Export Citation

  • Xue, M., and Coauthors, 2008: CAPS realtime storm-scale ensemble and high-resolution forecasts as part of the NOAA Hazardous Weather Testbed 2008 Spring Experiment. Preprints, 24th Conf. on Severe Local Storms, Savannah, GA, Amer. Meteor. Soc., 12.2. [Available online at http://ams.confex.com/ams/pdfpapers/142036.pdf.]

    • Search Google Scholar
    • Export Citation

  • Yussouf, N., and Stensrud D. J. , 2008: Reliable probabilistic quantitative precipitation forecasts from a short-range ensemble forecasting system during the 2005/06 cool season. Mon. Wea. Rev., 136, 2157–2172.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 536 305 59
PDF Downloads 209 44 3