• Albers, J. R., and M. Newman, 2019: A priori identification of skillful extratropical subseasonal forecasts. Geophys. Res. Lett., 46, 12 52712 536, https://doi.org/10.1029/2019GL085270.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Barlow, M., and Coauthors, 2019: North American extreme precipitation events and related large‐scale meteorological patterns: A review of statistical methods, dynamics, modeling, and trends. Climate Dyn., 53, 68356875, https://doi.org/10.1007/s00382-019-04958-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bolton, D., 1980: The computation of equivalent potential temperature. Mon. Wea. Rev., 108, 10461053, https://doi.org/10.1175/1520-0493(1980)108<1046:TCOEPT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Box, G. E. P., G. M. Jenkins, and G. C. Reinsel, 1994: Time Series Analysis, Forecasting and Control. 3rd ed. Prentice Hall, 592 pp.

  • Bukovsky, M. S., and D. J. Karoly, 2007: A brief evaluation of precipitation from the North American Regional Reanalysis. J. Hydrometeor., 8, 837846, https://doi.org/10.1175/JHM595.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Demargne, J., and Coauthors, 2014: The science of NOAA’s operational hydrologic ensemble forecast service. Bull. Amer. Meteor. Soc., 95, 7998, https://doi.org/10.1175/BAMS-D-12-00081.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Furrer, E., and R. Katz, 2007: Generalized linear modeling approach to stochastic weather generators. Climate Res., 34, 129144, https://doi.org/10.3354/cr034129.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Grotjahn, R., and Coauthors, 2016: North American extreme temperature events and related large scale meteorological patterns: A review of statistical methods, dynamics, modeling and trends. Climate Dyn., 46, 11511184, https://doi.org/10.1007/s00382-015-2638-6.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guan, H., and Coauthors, 2022: GEFSv12 reforecast dataset for supporting subseasonal and hydrometeorological applications. Mon. Wea. Rev., 150, 647665, https://doi.org/10.1175/MWR-D-21-0245.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., 2018: Practical aspects of statistical postprocessing. Statistical Postprocessing of Ensemble Forecasts, S. Vannitsem, D. S. Wilks, and J. Messner, Eds., Elsevier, 187218.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and J. S. Whitaker, 2006: Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Wea. Rev., 134, 32093229, https://doi.org/10.1175/MWR3237.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., J. S. Whitaker, and S. L. Mullen, 2006: Reforecasts, an important dataset for improving weather predictions. Bull. Amer. Meteor. Soc., 87, 3346, https://doi.org/10.1175/BAMS-87-1-33.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., G. T. Bates, J. S. Whitaker, D. R. Murray, M. Fiorino, T. J. Galarneau Jr., Y. Zhu, and W. Lapenta, 2013: NOAA’s second-generation global medium-range ensemble reforecast dataset. Bull. Amer. Meteor. Soc., 94, 15531565, https://doi.org/10.1175/BAMS-D-12-00014.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., M. Scheuerer, and G. T. Bates, 2015: Analog probabilistic precipitation forecasts using GEFS reforecasts and Climatology-Calibrated Precipitation Analyses. Mon. Wea. Rev., 143, 33003309, https://doi.org/10.1175/MWR-D-15-0004.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and Coauthors, 2022: The reanalysis for the Global Ensemble Forecast System, version 12. Mon. Wea. Rev., 150, 5979, https://doi.org/10.1175/MWR-D-21-0023.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Holsclaw, T., A. M. Greene, and A. W. Robertson, 2016: A Bayesian hidden Markov model of daily precipitation over South and East Asia. J. Hydrometeor., 17, 325, https://doi.org/10.1175/JHM-D-14-0142.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kenabatho, P. K., N. R. McIntyre, R. E. Chandler, and H. S. Wheater, 2012: Stochastic simulation of rainfall in the semi-arid Limpopo basin, Botswana. Int. J. Climatol., 32, 11131127, https://doi.org/10.1002/joc.2323.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kleeman, R., 2002: Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci., 59, 20572072, https://doi.org/10.1175/1520-0469(2002)059<2057:MDPUUR>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kravtsov, S., D. Kondrashov, and M. Ghil, 2005: Multi-level regression modeling of nonlinear processes: Derivation and applications to climatic variability. J. Climate, 18, 44044424, https://doi.org/10.1175/JCLI3544.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kravtsov, S., M. Ghil, and D. Kondrashov, 2010: Empirical model reduction and the modeling hierarchy in climate dynamics and the geosciences. Stochastic Physics and Climate Modeling, T. Palmer and P. Williams, Eds., Cambridge University Press, 3572.

    • Search Google Scholar
    • Export Citation
  • Kravtsov, S., N. Tilinina, Y. Zyulyaeva, and S. Gulev, 2016: Empirical modeling and stochastic simulation of sea-level pressure variability. J. Appl. Meteor. Climatol., 55, 11971219, https://doi.org/10.1175/JAMC-D-15-0186.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kravtsov, S., P. Roebber, and V. Brazauskas, 2017: A virtual climate library of surface temperature over North America for 1979–2015. Sci. Data, 4, 170155, https://doi.org/10.1038/sdata.2017.155.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kunkel, K. E., S. E. Stevens, L. E Stevens, and T. R. Karl, 2020: Observed climatological relationships of extreme daily precipitation events with precipitable water and vertical velocity in the contiguous United States. Geophys. Res. Lett., 47, e2019GL086721, https://doi.org/10.1029/2019GL086721.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Manzanas, R., A. Lucero, A. Weisheimer, and J. M. Gutierrez, 2018: Can bias correction and statistical downscaling methods improve the skill of seasonal precipitation forecasts? Climate Dyn., 50, 11611176, https://doi.org/10.1007/s00382-017-3668-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • McCullagh, P., and J. Nelder, 1989: Generalized Linear Models. Chapman and Hall, 532 pp.

  • Mesinger, F., and Coauthors, 2006: North American Regional Reanalysis. Bull. Amer. Meteor. Soc., 87, 343360, https://doi.org/10.1175/BAMS-87-3-343.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Newman, M., P. D. Sardeshmukh, C. R. Winkler, and J. S. Whitaker, 2003: A study of subseasonal predictability. Mon. Wea. Rev., 131, 17151732, https://doi.org/10.1175//2558.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Penland, C., 1996: A stochastic model of Indo-Pacific sea surface temperature anomalies. Physica D, 98, 534558, https://doi.org/10.1016/0167-2789(96)00124-8.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Penland, C., and P. D. Sardeshmukh, 1995: The optimal growth of tropical sea surface temperature anomalies. J. Climate, 8, 19992024, https://doi.org/10.1175/1520-0442(1995)008<1999:TOGOTS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Robertson, A. W., and M. Ghil, 1999: Large‐scale weather regimes and local climate over the western United States. J. Climate, 12, 17961813, https://doi.org/10.1175/1520-0442(1999)012<1796:LSWRAL>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Robertson, A. W., S. Kirshner, and P. Smyth, 2004: Downscaling of daily rainfall occurrence over northeast Brazil using a hidden Markov model. J. Climate, 17, 44074424, https://doi.org/10.1175/JCLI-3216.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Robertson, A. W., Y. Kushnir, U. Lall, and J. Nakamura, 2016: Weather and climatic drivers of extreme flooding events over the Midwest of the United States. Extreme Events: Observations, Modeling, and Economics, Geophys. Monogr., Vol. 214, Amer. Geophys. Union, https://doi.org/10.1002/9781119157052.ch9.

    • Search Google Scholar
    • Export Citation
  • Scheuerer, M., and T. M. Hamill, 2015: Statistical postprocessing of ensemble precipitation forecasts by fitting censored, shifted gamma distributions. Mon. Wea. Rev., 143, 45784596, https://doi.org/10.1175/MWR-D-15-0061.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sinha, P., U. C. Mohanty, S. C. Kar, S. K. Dash, A. W. Robertson, and M. K. Tippett, 2013: Seasonal prediction of the Indian summer monsoon rainfall using canonical correlation analysis of the NCMRWF global model products. Int. J. Climatol., 33, 16011614, https://doi.org/10.1002/joc.3536.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 2011: Statistical Methods in Atmospheric Sciences. 3rd ed. International Geophysics Series, Vol. 100, Academic Press, 704 pp.

    • Search Google Scholar
    • Export Citation
  • Winkler, C. R., M. Newman, and P. D. Sardeshmukh, 2001: A linear model of wintertime low‐frequency variability. Part I: Formulation and forecast skill. J. Climate, 14, 44744494, https://doi.org/10.1175/1520-0442(2001)014<4474:ALMOWL>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wold, S., and Coauthors, 1984: Chemometrics, Mathematics and Statistics in Chemistry. Reidel Publishing Company, 492 pp.

  • Yuan, H., P. Schultz, E. I. Tollerud, D. Hou, Y. Zhu, M. Pena, M. Charles, and Z. Toth, 2019: Pseudo-precipitation: A continuous precipitation variable. NOAA Tech. Memo. OAR GSD-62, https://doi.org/10.25923/3h37-gp49.

    • Search Google Scholar
    • Export Citation
  • Zhou, X., and Coauthors, 2022: The development of the NCEP Global Ensemble Forecast System Version 12. Wea. Forecasting, https://doi.org/10.1175/WAF-D-21-0112.1, in press.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zobel, Z., J. Wang, D. J. Wuebbles, and V. R. Kotamarthi, 2018: Evaluations of high-resolution dynamically downscaled ensembles over the contiguous United States. Climate Dyn., 50, 863884, https://doi.org/10.1007/s00382-017-3645-6.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 214 211 5
Full Text Views 66 66 3
PDF Downloads 58 58 0

Objective Methods for Thinning the Frequency of Reforecasts while Meeting Postprocessing and Model Validation Needs

Sergey KravtsovaUniversity of Wisconsin–Milwaukee, Milwaukee, Wisconsin

Search for other papers by Sergey Kravtsov in
Current site
Google Scholar
PubMed
Close
,
Paul RoebberaUniversity of Wisconsin–Milwaukee, Milwaukee, Wisconsin

Search for other papers by Paul Roebber in
Current site
Google Scholar
PubMed
Close
,
Thomas M. HamillbNOAA/Physical Sciences Laboratory, Boulder, Colorado

Search for other papers by Thomas M. Hamill in
Current site
Google Scholar
PubMed
Close
, and
James BrowncHydrologic Solutions Limited, Southgate Chambers, Winchester, Southampton, United Kingdom

Search for other papers by James Brown in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

This paper utilizes statistical and statistical–dynamical methodologies to select, from the full observational record, a minimal subset of dates that would provide representative sampling of local precipitation distributions across the contiguous United States (CONUS). The CONUS region is characterized by a great diversity of precipitation-producing systems, mechanisms, and large-scale meteorological patterns (LSMPs), which can provide favorable environment for local precipitation extremes. This diversity is unlikely to be adequately captured in methodologies that rely on grossly reducing the dimensionality of the data—by representing it in terms of a few patterns evolving in time—and thus requires data thinning techniques based on high-dimensional dynamical or statistical data modeling. We have built a novel high-dimensional empirical model of temperature and precipitation capable of producing statistically accurate surrogate realizations of the observed 1979–99 (training period) evolution of these fields. This model also provides skillful hindcasts of precipitation over the 2000–20 (validation) period. We devised a subsampling strategy based on the relative entropy of the empirical model’s precipitation (ensemble) forecasts over CONUS and demonstrated that it generates a set of dates that captures a majority of high-impact precipitation events, while substantially reducing a heavy-precipitation bias inherent in an alternative methodology based on the direct identification of large precipitation events in the Global Ensemble Forecast System (GEFS), version 12 reforecasts. The impacts of data thinning on the accuracy of precipitation statistical postprocessing, as well as on the calibration and validation of the Hydrologic Ensemble Forecast Service (HEFS) reforecasts are yet to be established.

Significance Statement

High-impact weather events are usually associated with extreme precipitation, which is notoriously difficult to predict even using highly resolved state-of-the-art numerical weather prediction models based on first physical principles. The same is true for statistical models that use past data to anticipate the future behavior likely to stem from an observed initial state. Here we use both types of models to identify the occurrences of the states, over the historical climate record, which are likely to lead to extreme precipitation events. We show that the overall statistics of precipitation over the contiguous United States is encapsulated in a greatly reduced set of such states, which could substantially alleviate the computational burden associated with testing of hydrological forecast models used for decision support.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Sergey Kravtsov, kravtsov@uwm.edu

Abstract

This paper utilizes statistical and statistical–dynamical methodologies to select, from the full observational record, a minimal subset of dates that would provide representative sampling of local precipitation distributions across the contiguous United States (CONUS). The CONUS region is characterized by a great diversity of precipitation-producing systems, mechanisms, and large-scale meteorological patterns (LSMPs), which can provide favorable environment for local precipitation extremes. This diversity is unlikely to be adequately captured in methodologies that rely on grossly reducing the dimensionality of the data—by representing it in terms of a few patterns evolving in time—and thus requires data thinning techniques based on high-dimensional dynamical or statistical data modeling. We have built a novel high-dimensional empirical model of temperature and precipitation capable of producing statistically accurate surrogate realizations of the observed 1979–99 (training period) evolution of these fields. This model also provides skillful hindcasts of precipitation over the 2000–20 (validation) period. We devised a subsampling strategy based on the relative entropy of the empirical model’s precipitation (ensemble) forecasts over CONUS and demonstrated that it generates a set of dates that captures a majority of high-impact precipitation events, while substantially reducing a heavy-precipitation bias inherent in an alternative methodology based on the direct identification of large precipitation events in the Global Ensemble Forecast System (GEFS), version 12 reforecasts. The impacts of data thinning on the accuracy of precipitation statistical postprocessing, as well as on the calibration and validation of the Hydrologic Ensemble Forecast Service (HEFS) reforecasts are yet to be established.

Significance Statement

High-impact weather events are usually associated with extreme precipitation, which is notoriously difficult to predict even using highly resolved state-of-the-art numerical weather prediction models based on first physical principles. The same is true for statistical models that use past data to anticipate the future behavior likely to stem from an observed initial state. Here we use both types of models to identify the occurrences of the states, over the historical climate record, which are likely to lead to extreme precipitation events. We show that the overall statistics of precipitation over the contiguous United States is encapsulated in a greatly reduced set of such states, which could substantially alleviate the computational burden associated with testing of hydrological forecast models used for decision support.

© 2022 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Sergey Kravtsov, kravtsov@uwm.edu

Supplementary Materials

    • Supplemental Materials (PDF 10.9 MB)
Save