Short-Range Probabilistic Quantitative Precipitation Forecasts over the Southwest United States by the RSM Ensemble System

Huiling Yuan Department of Civil and Environmental Engineering, University of California, Irvine, Irvine, California

Search for other papers by Huiling Yuan in
Current site
Google Scholar
PubMed
Close
,
Steven L. Mullen Department of Atmospheric Sciences, The University of Arizona, Tucson, Arizona

Search for other papers by Steven L. Mullen in
Current site
Google Scholar
PubMed
Close
,
Xiaogang Gao Department of Civil and Environmental Engineering, University of California, Irvine, Irvine, California

Search for other papers by Xiaogang Gao in
Current site
Google Scholar
PubMed
Close
,
Soroosh Sorooshian Department of Civil and Environmental Engineering, University of California, Irvine, Irvine, California

Search for other papers by Soroosh Sorooshian in
Current site
Google Scholar
PubMed
Close
,
Jun Du Environmental Modeling Center, National Centers for Environmental Prediction, Washington, D.C

Search for other papers by Jun Du in
Current site
Google Scholar
PubMed
Close
, and
Hann-Ming Henry Juang Environmental Modeling Center, National Centers for Environmental Prediction, Washington, D.C

Search for other papers by Hann-Ming Henry Juang in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The National Centers for Environmental Prediction (NCEP) Regional Spectral Model (RSM) is used to produce twice-daily (0000 and 1200 UTC), high-resolution ensemble forecasts to 24 h. The forecasts are performed at an equivalent horizontal grid spacing of 12 km for the period 1 November 2002 to 31 March 2003 over the southwest United States. The performance of 6-h accumulated precipitation is assessed for 32 U.S. Geological Survey hydrologic catchments. Multiple accuracy and skill measures are used to evaluate probabilistic quantitative precipitation forecasts. NCEP stage-IV precipitation analyses are used as “truth,” with verification performed on the stage-IV 4-km grid. The RSM ensemble exhibits a ubiquitous wet bias. The bias manifests itself in areal coverage, frequency of occurrence, and total accumulated precipitation over every region and during every 6-h period. The biases become particularly acute starting with the 1800–0000 UTC interval, which leads to a spurious diurnal cycle and the 1200 UTC cycle being more adversely affected than the 0000 UTC cycle. Forecast quality and value exhibit marked variability over different hydrologic regions. The forecasts are highly skillful along coastal California and the windward slopes of the Sierra Nevada Mountains, but they generally lack skill over the Great Basin and the Colorado basin except over mountain peaks. The RSM ensemble is able to discriminate precipitation events and provide useful guidance to a wide range of users over most regions of California, which suggests that mitigation of the conditional biases through statistical postprocessing would produce major improvements in skill.

* Current affiliation: NOAA/Earth System Research Laboratory, Global Systems Division, and National Research Council Associate, Boulder, Colorado

Corresponding author address: Huiling Yuan, NOAA/ESRL, R/GSD7, 325 Broadway, Boulder, CO 80305–3328. Email: huiling.yuan@noaa.gov

Abstract

The National Centers for Environmental Prediction (NCEP) Regional Spectral Model (RSM) is used to produce twice-daily (0000 and 1200 UTC), high-resolution ensemble forecasts to 24 h. The forecasts are performed at an equivalent horizontal grid spacing of 12 km for the period 1 November 2002 to 31 March 2003 over the southwest United States. The performance of 6-h accumulated precipitation is assessed for 32 U.S. Geological Survey hydrologic catchments. Multiple accuracy and skill measures are used to evaluate probabilistic quantitative precipitation forecasts. NCEP stage-IV precipitation analyses are used as “truth,” with verification performed on the stage-IV 4-km grid. The RSM ensemble exhibits a ubiquitous wet bias. The bias manifests itself in areal coverage, frequency of occurrence, and total accumulated precipitation over every region and during every 6-h period. The biases become particularly acute starting with the 1800–0000 UTC interval, which leads to a spurious diurnal cycle and the 1200 UTC cycle being more adversely affected than the 0000 UTC cycle. Forecast quality and value exhibit marked variability over different hydrologic regions. The forecasts are highly skillful along coastal California and the windward slopes of the Sierra Nevada Mountains, but they generally lack skill over the Great Basin and the Colorado basin except over mountain peaks. The RSM ensemble is able to discriminate precipitation events and provide useful guidance to a wide range of users over most regions of California, which suggests that mitigation of the conditional biases through statistical postprocessing would produce major improvements in skill.

* Current affiliation: NOAA/Earth System Research Laboratory, Global Systems Division, and National Research Council Associate, Boulder, Colorado

Corresponding author address: Huiling Yuan, NOAA/ESRL, R/GSD7, 325 Broadway, Boulder, CO 80305–3328. Email: huiling.yuan@noaa.gov

Save
  • Benjamin, S. G., and Coauthors, 2004: An hourly assimilation—Forecast cycle: The RUC. Mon. Wea. Rev., 132 , 495518.

  • Buizza, R., 2001: Accuracy and potential economic value of categorical and probabilistic forecasts of discrete events. Mon. Wea. Rev., 129 , 23292345.

    • Search Google Scholar
    • Export Citation
  • Charba, J. P., D. W. Reynolds, B. E. McDonald, and G. M. Carter, 2003: Comparative verification of recent quantitative precipitation forecasts in the National Weather Service: A simple approach for scoring forecast accuracy. Wea. Forecasting, 18 , 161183.

    • Search Google Scholar
    • Export Citation
  • Droegemeier, K. K., and Coauthors, 2000: Hydrological aspects of weather prediction and flood warnings: Report of the ninth prospectus development team of the U.S. weather research program. Bull. Amer. Meteor. Soc., 81 , 26652680.

    • Search Google Scholar
    • Export Citation
  • Du, J., and M. S. Tracton, 2001: Implementation of a real-time short-range ensemble forecasting system at NCEP: An update. Preprints, Ninth Conf. on Mesoscale Processes, Ft. Lauderdale, FL, Amer. Meteor. Soc., 355–356.

  • Du, J., J. McQueen, G. DiMego, Z. Toth, D. Jovic, B. Zhou, and H. Chuang, 2006: New dimension of NCEP Short-Range Ensemble Forecasting (SREF) system: Inclusion of WRF members. Preprints, WMO Expert Team Meeting on Ensemble Prediction System, Exeter, United Kingdom, 5 pp. [Available online at http://wwwt.emc.ncep.noaa.gov/mmb/SREF/reference.html.].

  • Efron, B., and R. J. Tibshirani, 1993: An Introduction to the Bootstrap. Chapman and Hall, 436 pp.

  • Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14 , 155167.

  • Hamill, T. M., and J. Juras, 2007: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., in press.

    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., J. S. Whitaker, and S. L. Mullen, 2006: Reforecasts, an important data set for improving weather predictions. Bull. Amer. Meteor. Soc., 87 , 3346.

    • Search Google Scholar
    • Export Citation
  • Hand, D. J., and R. J. Till, 2001: A simple generalization of the area under the ROC curve for multiple class classification problems. Mach. Learn., 45 , 171186.

    • Search Google Scholar
    • Export Citation
  • Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15 , 559570.

    • Search Google Scholar
    • Export Citation
  • Hong, S-Y., and H-L. Pan, 1998: Convective trigger function for a mass-flux cumulus parameterization scheme. Mon. Wea. Rev., 126 , 25992620.

    • Search Google Scholar
    • Export Citation
  • Hong, S-Y., and A. Leetmaa, 1999: An evaluation of the NCEP RSM for regional climate modeling. J. Climate, 12 , 592609.

  • Jolliffe, I. T., and D. B. Stephenson, 2003: Forecast Verification:. A Practitioner’s Guide in Atmospheric Science. Wiley and Sons, 240 pp.

    • Search Google Scholar
    • Export Citation
  • Juang, H-M. H., and M. Kanamitsu, 1994: The NMC nested regional spectral model. Mon. Wea. Rev., 122 , 326.

  • Lee, M-S., Y-H. Kuo, D. M. Barker, and E. Lim, 2006: Incremental analysis updates initialization technique applied to 10-km MM5 and MM5 3DVAR. Mon. Wea. Rev., 134 , 13891404.

    • Search Google Scholar
    • Export Citation
  • Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30 , 291303.

  • McGinley, J. A., S. Albers, D. Birkenheuer, B. Shaw, and P. Schultz, 2000: The LAPS water in all phases analysis: The approach and impacts on numerical prediction. Preprints, Fifth Int. Symp. on Tropospheric Profiling, Adelaide, Australia, Amer. Meteor. Soc., 133–135.

  • Richardson, D. S., 2000: Skill and economic value of the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 126 , 649667.

  • Serreze, M., M. Clark, R. Armstrong, D. McGinnis, and R. Pulwarty, 1999: Characteristics of western U.S. snowpack telemetry (SNOTEL) data. Water Resour. Res., 35 , 21452160.

    • Search Google Scholar
    • Export Citation
  • Shaw, B. L., S. Albers, D. Birkenheuer, J. Brown, J. McGinley, P. Schultz, J. Smart, and E. Szoke, 2004: Application of the Local Analysis and Prediction System (LAPS) diabatic initialization of mesoscale numerical weather prediction models for the IHOP-2002 field experiment. Preprints, 20th Conf. on Weather Analysis and Forecasting, Seattle, WA, Amer. Meteor. Soc., CD-ROM, P3.7.

  • Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74 , 23172330.

  • Toth, Z., and E. Kalnay, 1997: Ensemble forecasting at NCEP and the breeding method. Mon. Wea. Rev., 125 , 32973319.

  • Tracton, M. S., and J. Du, 2001: Short-Range Ensemble Forecasting (SREF) at the National Centers for Environmental Prediction. A report to WMO ensemble expert meeting, 10 pp. [Available online at http://wwwt.emc.ncep.noaa.gov/mmb/SREF/Tracton_Du.forWMO2001.doc.].

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2d ed. Elsevier Academic Press, 627 pp.

  • Yuan, H., S. L. Mullen, X. Gao, S. Sorooshian, J. Du, and H. H. Juang, 2005a: Verification of probabilistic quantitative precipitation forecasts over the southwest United States during winter 2002/03 by the RSM ensemble system. Mon. Wea. Rev., 133 , 279294.

    • Search Google Scholar
    • Export Citation
  • Yuan, H., S. L. Mullen, X. Gao, and S. Sorooshian, 2005b: Calibration of probabilistic quantitative precipitation forecasts from the RSM ensemble forecasts over hydrologic regions. Preprints, 19th Conf. on Hydrology, San Diego, CA, Amer. Meteor. Soc., CD-ROM, J3.4.

  • Zhu, Y., Z. Toth, R. Wobus, D. Richardson, and K. Mylne, 2002: The economic value of ensemble-based weather forecasts. Bull. Amer. Meteor. Soc., 83 , 7383.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 432 151 11
PDF Downloads 72 27 2