Editorial Type:
Article
Article Type:
Research Article

Confidence Interval Estimation for Quantitative Precipitation Forecasts (QPF) Using Short-Range Ensemble Forecasts (SREF)

Jung-Sun Im NOAA/Hydrometeorological Prediction Center/I.M. System Group, Camp Springs, Maryland

Search for other papers by Jung-Sun Im in
Current site
Google Scholar
PubMed Close
,
Keith Brill NOAA/Hydrometeorological Prediction Center, Camp Springs, Maryland

Search for other papers by Keith Brill in
Current site
Google Scholar
PubMed Close
, and
Edwin Danaher NOAA/Hydrometeorological Prediction Center, Camp Springs, Maryland

Search for other papers by Edwin Danaher in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Feb 2006
DOI:
https://doi.org/10.1175/WAF902.1
Page(s):
24–41
Restricted access

Abstract

The Hydrometeorological Prediction Center (HPC) at the NCEP has produced a suite of deterministic quantitative precipitation forecasts (QPFs) for over 40 yr. While the operational forecasts have proven to be useful in their present form, they offer no information concerning the uncertainties of individual forecasts. The purpose of this study is to develop a methodology to quantify the uncertainty in manually produced 6-h HPC QPFs (HQPFs) using NCEP short-range ensemble forecasts (SREFs). Results presented herein show the SREFs can predict the uncertainty of HQPFs. The correlation between HQPF absolute error (AE) and ensemble QPF spread (SP) is greater than 0.5 at 90.5% of grid points in the continental United States, exceeding 0.8 at 10% of these, for the 6-h forecast in winter. On the basis of the high correlation, the linear regression equations of AE on SP are derived at each point on a grid covering the United States. In addition, the regression equations for data categorized according to the observed and forecasted precipitation amounts are obtained and evaluated. Using the regression model equation parameters for 15 categorized ranges of HQPF at each horizontal grid point for each season and individual forecast lead time, an AE associated with an individual SP is predicted, as is the 95% confidence interval (CI) of the AE. Based on the AE CI forecast and the HQPF itself, the 95% CI of the HQPF is predicted as well. This study introduces an efficient and advanced method, providing an estimate of the uncertainty in the deterministic HQPF. Verification demonstrates the usefulness of the CI forecasts for a variety of classifications, such as season, CI range, HQPF, and forecast lead time.

Corresponding author address: Jung-Sun Im, NOAA/I.M. System Group, WWB, Rm. 403, 5200 Auth Rd., Camp Springs, MD 20746. Email: Jung-Sun.Im@noaa.gov

Abstract

The Hydrometeorological Prediction Center (HPC) at the NCEP has produced a suite of deterministic quantitative precipitation forecasts (QPFs) for over 40 yr. While the operational forecasts have proven to be useful in their present form, they offer no information concerning the uncertainties of individual forecasts. The purpose of this study is to develop a methodology to quantify the uncertainty in manually produced 6-h HPC QPFs (HQPFs) using NCEP short-range ensemble forecasts (SREFs). Results presented herein show the SREFs can predict the uncertainty of HQPFs. The correlation between HQPF absolute error (AE) and ensemble QPF spread (SP) is greater than 0.5 at 90.5% of grid points in the continental United States, exceeding 0.8 at 10% of these, for the 6-h forecast in winter. On the basis of the high correlation, the linear regression equations of AE on SP are derived at each point on a grid covering the United States. In addition, the regression equations for data categorized according to the observed and forecasted precipitation amounts are obtained and evaluated. Using the regression model equation parameters for 15 categorized ranges of HQPF at each horizontal grid point for each season and individual forecast lead time, an AE associated with an individual SP is predicted, as is the 95% confidence interval (CI) of the AE. Based on the AE CI forecast and the HQPF itself, the 95% CI of the HQPF is predicted as well. This study introduces an efficient and advanced method, providing an estimate of the uncertainty in the deterministic HQPF. Verification demonstrates the usefulness of the CI forecasts for a variety of classifications, such as season, CI range, HQPF, and forecast lead time.

Corresponding author address: Jung-Sun Im, NOAA/I.M. System Group, WWB, Rm. 403, 5200 Auth Rd., Camp Springs, MD 20746. Email: Jung-Sun.Im@noaa.gov

Save
Cover Weather and Forecasting
Weather and Forecasting

  • Accadia, C., Mariani S. , Casaioli M. , and Lavagnini A. , 2003: Sensitivity of precipitation forecast skill scores to bilinear interpolation and a simple nearest-neighbor average method on high-resolution verification grids. Wea. Forecasting, 18 , 918–932.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Barker, T. W., 1991: The relationship between spread and forecast error in extended-range forecasts. J. Climate, 4 , 733–742.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distributions of the ECMWF Ensemble Prediction System. Mon. Wea. Rev., 125 , 99–119.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Charba, J. P., Reynolds D. W. , McDonald B. E. , and Carter G. M. , 2003: Comparative verification of recent quantitative precipitation forecasts in the National Weather Service: A simple approach for scoring forecast accuracy. Wea. Forecasting, 18 , 161–183.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Du, J., and Coauthors, 2004: The NOAA/NWS/NCEP Short-Range Ensemble Forecast (SREF) system: Evaluation of an initial condition vs multiple model physics ensemble approach. Preprints, 16th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., CD-ROM, 21.3.

  • Ferrier, B. S., 2004: Modifications of two convective schemes used in the NCEP Eta Model. Preprints, 16th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., CD-ROM, J4.2.

  • Fread, D. L., and Coauthors, 1995: Modernization in the National Weather Service river and flood program. Wea. Forecasting, 10 , 477–484.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Fulton, R. A., Breidenbach J. P. , Seo D-J. , Miller D. A. , and O'Bannon T. , 1998: The WSR-88D rainfall algorithm. Wea. Forecasting, 13 , 377–395.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Grimit, E. P., and Mass C. F. , 2002: Initial results of a mesoscale short-range ensemble forecasting system over the Pacific Northwest. Mon. Wea. Rev., 17 , 192–205.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., and Colucci S. J. , 1998: Evaluation of Eta–RSM ensemble probabilistic precipitation forecasts. Mon. Wea. Rev., 126 , 711–724.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Henkel, A., and Peterson C. , 1996: Can deterministic quantitative precipitation forecasts in mountainous regions be specified in a rapid, climatologically-consistent manner with Mountain Mapper functioning as the tool for mechanical specification, quality control, and verification? Abstracts, Fifth National Heavy Precipitation Workshop, State College, PA, NOAA/NWS, 31 pp.

  • Hoke, J. E., Reynolds D. W. , Danaher E. , and McCarthy K. C. , 2000: The Hydrometeorological Prediction Center—Its future role in quantitative precipitation forecasting. Preprints, 15th Conf. on Hydrology, Long Beach, CA, Amer. Meteor. Soc., 243–246.

    • Search Google Scholar
    • Export Citation

  • Hou, D., Kalnay E. , and Droegemeier K. K. , 2001: Objective verification of the SAMEX '98 ensemble forecasts. Mon. Wea. Rev., 129 , 73–91.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Houtekamer, P. L., 1993: Global and local skill forecasts. Mon. Wea. Rev., 121 , 1834–1846.

  • Janjić, Z. I., 1994: The step-mountain Eta coordinate model: Further developments of the convection, viscous sublayer, and turbulence closure schemes. Mon. Wea. Rev., 122 , 927–945.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Juang, H-M. H., Hong S-Y. , and Kanamitsu M. , 1997: The NCEP Regional Spectral Model: An update. Bull. Amer. Meteor. Soc., 78 , 2125–2143.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Kain, J., and Fritsch J. M. , 1993: Convective parameterization for mesoscale models: The Kain–Fritsch scheme. The Representation of Cumulus Convection in Numerical Models of the Atmosphere, Meteor. Monogr., No. 46, Amer. Meteor. Soc., 165–170.

    • Crossref
    • Export Citation

  • McDonald, B. E., and Graziano T. M. , 2000: The NWS QPF verification program. Preprints, 15th Conf. on Probability and Statistics in the Atmospheric Sciences, Asheville, NC, Amer. Meteor. Soc., 61–64.

  • McDonald, B. E., and Graziano T. M. , 2001: The National Precipitation Verification Unit (NPVU): Operational implementation. Preprints, Symp. on Precipitation Prediction: Extreme Events and Mitigation, Albuquerque, NM, Amer. Meteor. Soc., 71–74.

  • Mesinger, F., 1996: Improvements in quantitative precipitation forecasting with the Eta regional model at the National Centers for Environmental Prediction: The 48-km upgrade. Bull. Amer. Meteor. Soc., 77 , 2637–2649.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Olson, D. A., Junker N. W. , and Korty B. , 1995: Evaluation of 33 years of quantitative precipitation forecasting. Wea. Forecasting, 10 , 498–511.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Rogers, E., and Coauthors, 1996: Changes to the operational “early” Eta analysis forecast system at the National Centers for Environmental Prediction. Wea. Forecasting, 11 , 391–413.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Scherrer, S. C., Appenzeller C. , Eckert P. , and Cattani D. , 2004: Analysis of the spread–skill relations using the ECMWF Ensemble Prediction System over Europe. Wea. Forecasting, 19 , 552–565.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Steel, R. G. D., Torrie J. H. , and Dickey D. A. , 1997: Principles and Procedures of Statistics: A Biometrical Approach. 3d ed. McGraw-Hill Series in Probability and Statistics, McGraw-Hill, 666 pp.

    • Search Google Scholar
    • Export Citation

  • Stensrud, D. J., and Yussouf N. , 2003: Short-range ensemble predictions of 2-m temperature and dewpoint temperature over New England. Mon. Wea. Rev., 131 , 2510–2524.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Stensrud, D. J., and Coauthors, 1999: Using ensembles for short-range forecasting. Mon. Wea. Rev., 127 , 433–446.

  • Toth, Z., and Kalnay E. , 1997: Ensemble forecasting at NCEP and the breeding method. Mon. Wea. Rev., 125 , 3297–3319.

  • Toth, Z., Zhu Y. , and Marchok T. , 2001: The use of ensembles to identify forecasts with small and large uncertainty. Wea. Forecasting, 16 , 463–477.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Whitaker, J. S., and Loughe A. F. , 1998: The relationship between ensemble spread and ensemble mean skill. Mon. Wea. Rev., 126 , 3292–3302.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences: An Introduction. Academic Press, 467 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1873 1241 323
PDF Downloads 537 63 0