Ensemble-Based Forecast Uncertainty Analysis of Diverse Heavy Rainfall Events

Russ S. Schumacher National Center for Atmospheric Research, * Boulder, Colorado, and Department of Atmospheric Sciences, Texas A&M University, College Station, Texas

Search for other papers by Russ S. Schumacher in
Current site
Google Scholar
PubMed
Close
and
Christopher A. Davis National Center for Atmospheric Research,* Boulder, Colorado

Search for other papers by Christopher A. Davis in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

This study examines widespread heavy rainfall over 5-day periods in the central and eastern United States. First, a climatology is presented that identifies events in which more than 100 mm of precipitation fell over more than 800 000 km2 in 5 days. This climatology shows that such events are most common in the cool season near the Gulf of Mexico coast and are rare in the warm season. Then, the focus turns to the years 2007 and 2008, when nine such events occurred in the United States, all of them leading to flooding. Three of these were associated with warm-season convection, three took place in the cool season, and three were caused by landfalling tropical cyclones. Global ensemble forecasts from the European Centre for Medium-Range Weather Forecasts Ensemble Prediction System are used to assess forecast skill and uncertainty for these nine events, and to identify the types of weather systems associated with their relative levels of skill and uncertainty. Objective verification metrics and subjective examination are used to determine how far in advance the ensemble identified the threat of widespread heavy rains. Specific conclusions depend on the rainfall threshold and the metric chosen, but, in general, predictive skill was highest for rainfall associated with tropical cyclones and lowest for the warm-season cases. In almost all cases, the ensemble provides very skillful 5-day forecasts when initialized at the beginning of the event. In some of the events—particularly the tropical cyclones and strong baroclinic cyclones—the ensemble still shows considerable skill in 96–216-h precipitation forecasts. In other cases, however, the skill drops off much more rapidly as lead time increases. In particular, forecast skill at long lead times was the lowest and spread was the largest in the two cases associated with meso-α-scale to synoptic-scale vortices that were cut off from the primary upper-level jet. In these cases, it appears that when the vortex is present in the initial conditions, the resulting precipitation forecasts are quite accurate and certain, but at longer lead times when the model is required to both develop and correctly evolve the vortex, forecast quality is low and uncertainty is large. These results motivate further investigation of the events that were poorly predicted.

Corresponding author address: Dr. Russ Schumacher, Dept. of Atmospheric Sciences, Texas A&M University, College Station, TX 77843. Email: russ.schumacher@tamu.edu

Abstract

This study examines widespread heavy rainfall over 5-day periods in the central and eastern United States. First, a climatology is presented that identifies events in which more than 100 mm of precipitation fell over more than 800 000 km2 in 5 days. This climatology shows that such events are most common in the cool season near the Gulf of Mexico coast and are rare in the warm season. Then, the focus turns to the years 2007 and 2008, when nine such events occurred in the United States, all of them leading to flooding. Three of these were associated with warm-season convection, three took place in the cool season, and three were caused by landfalling tropical cyclones. Global ensemble forecasts from the European Centre for Medium-Range Weather Forecasts Ensemble Prediction System are used to assess forecast skill and uncertainty for these nine events, and to identify the types of weather systems associated with their relative levels of skill and uncertainty. Objective verification metrics and subjective examination are used to determine how far in advance the ensemble identified the threat of widespread heavy rains. Specific conclusions depend on the rainfall threshold and the metric chosen, but, in general, predictive skill was highest for rainfall associated with tropical cyclones and lowest for the warm-season cases. In almost all cases, the ensemble provides very skillful 5-day forecasts when initialized at the beginning of the event. In some of the events—particularly the tropical cyclones and strong baroclinic cyclones—the ensemble still shows considerable skill in 96–216-h precipitation forecasts. In other cases, however, the skill drops off much more rapidly as lead time increases. In particular, forecast skill at long lead times was the lowest and spread was the largest in the two cases associated with meso-α-scale to synoptic-scale vortices that were cut off from the primary upper-level jet. In these cases, it appears that when the vortex is present in the initial conditions, the resulting precipitation forecasts are quite accurate and certain, but at longer lead times when the model is required to both develop and correctly evolve the vortex, forecast quality is low and uncertainty is large. These results motivate further investigation of the events that were poorly predicted.

Corresponding author address: Dr. Russ Schumacher, Dept. of Atmospheric Sciences, Texas A&M University, College Station, TX 77843. Email: russ.schumacher@tamu.edu

Save
  • Alpert, J. C., Carlis D. L. , Ballish B. A. , and Kumar V. K. , 2009: Using pseudo RAOB observations to study GFS skill score dropouts. Preprints, 23rd Conf. on Weather Analysis and Forecasting/19th Conf. on Numerical Weather Prediction, Omaha, NE, Amer. Meteor. Soc., 5A.6. [Available online at http://ams.confex.com/ams/pdfpapers/154268.pdf].

    • Search Google Scholar
    • Export Citation
  • Arndt, D. S., Basara J. B. , McPherson R. A. , Illston B. G. , McManus G. D. , and Demko D. B. , 2009: Observations of the overland reintensification of Tropical Storm Erin (2007). Bull. Amer. Meteor. Soc., 90 , 10791093.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bartels, D. L., and Maddox R. A. , 1991: Midlevel cyclonic vortices generated by mesoscale convective systems. Mon. Wea. Rev., 119 , 104118.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Benjamin, S. G., and Coauthors, 2004: An hourly assimilation–forecast cycle: The RUC. Mon. Wea. Rev., 132 , 495518.

  • Berg, R., cited. 2009: Tropical Storm Ike. National Hurricane Center Tropical Cyclone Rep. AL092008, 55 pp. [Available online at http://www.nhc.noaa.gov/pdf/TCR-AL092008_Ike.pdf].

    • Search Google Scholar
    • Export Citation
  • Beven J. L. II, , and Kimberlain T. B. , cited. 2009: Tropical Storm Gustav. National Hurricane Center Tropical Cyclone Rep. AL072008, 36 pp. [Available online at http://www.nhc.noaa.gov/pdf/TCR-AL072008_Gustav.pdf].

    • Search Google Scholar
    • Export Citation
  • Bougeault, P., and Coauthors, 2010: The THORPEX Interactive Grand Global Ensemble (TIGGE). Bull. Amer. Meteor. Soc., in press.

  • Buizza, R., Bidlot J-R. , Wedi N. , Fuentes M. , Hamrud M. , Holt G. , and Vitart F. , 2007: The new ECMWF VAREPS (Variable Resolution Ensemble Prediction System). Quart. J. Roy. Meteor. Soc., 133 , 681695.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Carbone, R. E., Tuttle J. D. , Ahijevych D. A. , and Trier S. B. , 2002: Inferences of predictability associated with warm season precipitation episodes. J. Atmos. Sci., 59 , 20332056.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Corfidi, S. F., 2003: Cold pools and MCS propagation: Forecasting the motion of downwind-developing MCSs. Wea. Forecasting, 18 , 9971017.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Davis, C. A., Ahijevych D. A. , and Trier S. B. , 2002: Detection and prediction of warm season midtropospheric vortices by the Rapid Update Cycle. Mon. Wea. Rev., 130 , 2442.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dirmeyer, P. A., and Kinter J. L. III, 2009: The “Maya Express”: Floods in the U.S. Midwest. Eos, Trans. Amer. Geophys. Union, 90 , 101102.

  • ECMWF, cited. 2009a: The creation of perturbed analyses. [Available online at http://www.ecmwf.int/products/forecasts/guide/The_creation_of_perturbed_analyses.html].

    • Search Google Scholar
    • Export Citation
  • ECMWF, cited. 2009b: TIGGE model upgrades. [Available online at http://tigge.ucar.edu/documentation.htm].

  • Fritsch, J. M., and Carbone R. E. , 2004: Improving quantitative precipitation forecasts in the warm season: A USWRP research and development strategy. Bull. Amer. Meteor. Soc., 85 , 955965.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fritsch, J. M., Kane R. J. , and Chelius C. R. , 1986: The contribution of mesoscale convective weather systems to the warm-season precipitation in the United States. J. Appl. Meteor., 25 , 13331345.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Galarneau T. J. Jr., , Bosart L. F. , and Schumacher R. S. , 2010: Predecessor rain events ahead of tropical cyclones. Mon. Wea. Rev., in press.

    • Search Google Scholar
    • Export Citation
  • Giordano, L. A., and Fritsch J. M. , 1991: Strong tornadoes and flash-flood-producing rainstorms during the warm season in the mid-Atlantic region. Wea. Forecasting, 6 , 437455.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Goebbert, K. H., Schenkman A. D. , Shafer C. M. , and Snook N. A. , 2008: An overview of the summer 2007 excessive rain event in the Southern Plains. Preprints, 22nd Conf. on Hydrology, New Orleans, LA, Amer. Meteor. Soc., P1.2. [Available online at http://ams.confex.com/ams/pdfpapers/135330.pdf].

    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and Juras J. , 2006: Measuring forecast skill: Is it real skill or is it the varying climatology? Quart. J. Roy. Meteor. Soc., 132 , 29052923.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., Hagedorn R. , and Whitaker J. S. , 2008: Probabilistic forecast calibration using ECMWF and GFS ensemble reforecasts. Part II: Precipitation. Mon. Wea. Rev., 136 , 26202632.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • He, Y., Wetterhall F. , Cloke H. , Pappenberger F. , Wilson M. , Freer J. , and McGregor G. , 2009: Tracking the uncertainty in flood alerts driven by grand ensemble weather predictions. Meteor. Appl., 16 , 91101.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Higgins, R. W., Yao Y. , Yarosh E. S. , Janowiak J. E. , and Mo K. C. , 1997: Influence of the Great Plains low-level jet on summertime precipitation and moisture transport over the central United States. J. Climate, 10 , 481507.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Higgins, R. W., Shi W. , Yarosh E. , and Joce R. , 2000: Improved United States precipitation quality control system and analysis. NCEP/Climate Prediction Center Atlas No. 7. [Available online at http://www.cpc.ncep.noaa.gov/research_papers/ncep_cpc_atlas/7/index.html].

    • Search Google Scholar
    • Export Citation
  • Houze R. A. Jr., , 2004: Mesoscale convective systems. Rev. Geophys., 42 , RG4003. doi:10.1029/2004RG000150.

  • Jung, T., and Leutbecher M. , 2008: Scale-dependent verification of ensemble forecasts. Quart. J. Roy. Meteor. Soc., 134 , 973984.

  • Junker, N. W., Schneider R. S. , and Fauver S. L. , 1999: A study of heavy rainfall events during the Great Midwest Flood of 1993. Wea. Forecasting, 14 , 701712.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc., 77 , 437471.

  • Knippertz, P., and Fink A. H. , 2009: Prediction of dry-season precipitation in tropical West Africa and its relation to forcing from the extratropics. Wea. Forecasting, 24 , 10641084.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Konrad C. E. II, , 2001: The most extreme precipitation events over the eastern United States from 1950 to 1996: Considerations of scale. J. Hydrometeor., 2 , 309325.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20 , 130141.

  • Lorenz, E. N., 1969: The predictability of a flow which possesses many scales of motion. Tellus, 21 , 289307.

  • Maddox, R. A., Chappell C. F. , and Hoxit L. R. , 1979: Synoptic and meso-α scale aspects of flash flood events. Bull. Amer. Meteor. Soc., 60 , 115123.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Minnesota State Climatology Office, cited. 2009: Heavy rains fall on southeastern Minnesota: August 18–20, 2007. [Available online at http://climate.umn.edu/doc/journal/flash_floods/ff070820.htm].

    • Search Google Scholar
    • Export Citation
  • Mo, K. C., Paegle J. N. , and Higgins R. W. , 1997: Atmospheric processes associated with summer floods and droughts in the central United States. J. Climate, 10 , 30283046.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mullen, S. L., and Buizza R. , 2001: Quantitative precipitation forecasts over the United States by the ECMWF Ensemble Prediction System. Mon. Wea. Rev., 129 , 638663.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Olson, D. A., Junker N. W. , and Korty B. , 1995: Evaluation of 33 years of quantitative precipitation forecasting at the NMC. Wea. Forecasting, 10 , 498511.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pappenberger, F., Bartholmes J. , Thielen J. , Cloke H. L. , Buizza R. , and de Roo A. , 2008: New dimensions in early flood warning across the globe using grand-ensemble weather predictions. Geophys. Res. Lett., 35 , L10404. doi:10.1029/2008GL033837.

    • Search Google Scholar
    • Export Citation
  • Park, Y. Y., Buizza R. , and Leutbecher M. , 2008: TIGGE: Preliminary results on comparing and combining ensembles. Quart. J. Roy. Meteor. Soc., 134 , 20292050.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Romero, R., Martin A. , Homar V. , Alonso S. , and Ramis C. , 2006: Predictability of prototype flash flood events in the Western Mediterranean under uncertainties of the precursor upper-level disturbance. Adv. Geosci., 7 , 5563.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rotunno, R., and Snyder C. , 2008: A generalization of Lorenz’s model for the predictability of flows with many scales of motion. J. Atmos. Sci., 65 , 10631076.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schaake, J. C., Hamill T. M. , Buizza R. , and Clark M. , 2007: HEPEX: The Hydrological Ensemble Prediction Experiment. Bull. Amer. Meteor. Soc., 88 , 15411547.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schumacher, R. S., and Johnson R. H. , 2005: Organization and environmental properties of extreme-rain-producing mesoscale convective systems. Mon. Wea. Rev., 133 , 961976.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schumacher, R. S., and Johnson R. H. , 2006: Characteristics of United States extreme rain events during 1999–2003. Wea. Forecasting, 21 , 6985.

  • Stensrud, D. J., and Wandishin M. S. , 2000: The correspondence ratio in forecast evaluation. Wea. Forecasting, 15 , 593602.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stewart, S. R., and Beven J. L. II, cited. 2009: Tropical Storm Fay. National Hurricane Center Tropical Cyclone Rep. AL062008, 29 pp. [Available online at http://www.nhc.noaa.gov/pdf/TCR-AL062008_Fay.pdf].

    • Search Google Scholar
    • Export Citation
  • Thielen, J., Bogner K. , Pappenberger F. , Kalas M. , del Medico M. , and de Roo A. , 2009: Monthly-, medium-, and short-range flood warning: Testing the limits of predictability. Meteor. Appl., 16 , 7790.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, P. D., 1957: Uncertainty of initial state as a factor in the predictability of large-scale atmospheric flow patterns. Tellus, 9 , 275295.

    • Search Google Scholar
    • Export Citation
  • Tuttle, J. D., and Davis C. A. , 2006: Corridors of warm season precipitation in the central United States. Mon. Wea. Rev., 134 , 22972317.

  • USGS, cited. 2009: 2008 Iowa flood information page. [Available online at http://ia.water.usgs.gov/flood08/index.html].

  • Wandishin, M. S., Mullen S. L. , Stensrud D. J. , and Brooks H. E. , 2001: Evaluation of a short-range multimodel ensemble system. Mon. Wea. Rev., 129 , 729747.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Whitaker, J. S., and Loughe A. F. , 1998: The relationship between ensemble spread and ensemble mean skill. Mon. Wea. Rev., 126 , 32923302.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 2005: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 648 pp.

  • Zhang, F., Snyder C. , and Rotunno R. , 2003: Effects of moist convection on mesoscale predictability. J. Atmos. Sci., 60 , 11731185.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhang, F., Odins A. M. , and Nielsen-Gammon J. W. , 2006: Mesoscale predictability of an extreme warm-season precipitation event. Wea. Forecasting, 21 , 149166.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1945 845 136
PDF Downloads 365 94 19