Editorial Type:
Article
Article Type:
Research Article

Combining Spatial Statistical and Ensemble Information in Probabilistic Weather Forecasts

Veronica J. Berrocal Department of Statistics, University of Washington, Seattle, Washington

Search for other papers by Veronica J. Berrocal in
Current site
Google Scholar
PubMed Close
,
Adrian E. Raftery Department of Statistics, University of Washington, Seattle, Washington

Search for other papers by Adrian E. Raftery in
Current site
Google Scholar
PubMed Close
, and
Tilmann Gneiting Department of Statistics, University of Washington, Seattle, Washington

Search for other papers by Tilmann Gneiting in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Apr 2007
DOI:
https://doi.org/10.1175/MWR3341.1
Page(s):
1386–1402
Restricted access

Abstract

Forecast ensembles typically show a spread–skill relationship, but they are also often underdispersive, and therefore uncalibrated. Bayesian model averaging (BMA) is a statistical postprocessing method for forecast ensembles that generates calibrated probabilistic forecast products for weather quantities at individual sites. This paper introduces the spatial BMA technique, which combines BMA and the geostatistical output perturbation (GOP) method, and extends BMA to generate calibrated probabilistic forecasts of whole weather fields simultaneously, rather than just weather events at individual locations. At any site individually, spatial BMA reduces to the original BMA technique. The spatial BMA method provides statistical ensembles of weather field forecasts that take the spatial structure of observed fields into account and honor the flow-dependent information contained in the dynamical ensemble. The members of the spatial BMA ensemble are obtained by dressing the weather field forecasts from the dynamical ensemble with simulated spatially correlated error fields, in proportions that correspond to the BMA weights for the member models in the dynamical ensemble. Statistical ensembles of any size can be generated at minimal computational cost. The spatial BMA technique was applied to 48-h forecasts of surface temperature over the Pacific Northwest in 2004, using the University of Washington mesoscale ensemble. The spatial BMA ensemble generally outperformed the BMA and GOP ensembles and showed much better verification results than the raw ensemble, both at individual sites, for weather field forecasts, and for forecasts of composite quantities, such as average temperature in National Weather Service forecast zones and minimum temperature along the Interstate 90 Mountains to Sound Greenway.

Corresponding author address: Veronica J. Berrocal, Department of Statistics, University of Washington, Box 354320, Seattle, WA 98195-4320. Email: veronica@stat.washington.edu

Abstract

Forecast ensembles typically show a spread–skill relationship, but they are also often underdispersive, and therefore uncalibrated. Bayesian model averaging (BMA) is a statistical postprocessing method for forecast ensembles that generates calibrated probabilistic forecast products for weather quantities at individual sites. This paper introduces the spatial BMA technique, which combines BMA and the geostatistical output perturbation (GOP) method, and extends BMA to generate calibrated probabilistic forecasts of whole weather fields simultaneously, rather than just weather events at individual locations. At any site individually, spatial BMA reduces to the original BMA technique. The spatial BMA method provides statistical ensembles of weather field forecasts that take the spatial structure of observed fields into account and honor the flow-dependent information contained in the dynamical ensemble. The members of the spatial BMA ensemble are obtained by dressing the weather field forecasts from the dynamical ensemble with simulated spatially correlated error fields, in proportions that correspond to the BMA weights for the member models in the dynamical ensemble. Statistical ensembles of any size can be generated at minimal computational cost. The spatial BMA technique was applied to 48-h forecasts of surface temperature over the Pacific Northwest in 2004, using the University of Washington mesoscale ensemble. The spatial BMA ensemble generally outperformed the BMA and GOP ensembles and showed much better verification results than the raw ensemble, both at individual sites, for weather field forecasts, and for forecasts of composite quantities, such as average temperature in National Weather Service forecast zones and minimum temperature along the Interstate 90 Mountains to Sound Greenway.

Corresponding author address: Veronica J. Berrocal, Department of Statistics, University of Washington, Box 354320, Seattle, WA 98195-4320. Email: veronica@stat.washington.edu

Save
Cover Monthly Weather Review
Monthly Weather Review

  • Anderson, J. L., 1996: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate, 9 , 1518–1530.

    • Search Google Scholar
    • Export Citation

  • Buizza, R., 1997: Potential forecast skill of ensemble prediction and spread and skill distribution of the ECMWF ensemble prediction system. Mon. Wea. Rev., 125 , 99–119.

    • Search Google Scholar
    • Export Citation

  • Byrd, R. H., P. Lu, J. Nocedal, and C. Zhu, 1995: A limited memory algorithm for bound constrained optimization. SIAM J. Sci. Comput., 16 , 1190–1208.

    • Search Google Scholar
    • Export Citation

  • Chilès, J-P., and P. Delfiner, 1999: Geostatistics: Modeling Spatial Uncertainty. Wiley, 695 pp.

  • Cressie, N. A. C., 1993: Statistics for Spatial Data. rev. ed. Wiley, 900 pp.

  • Dempster, A. P., N. M. Laird, and D. B. Rubin, 1977: Maximum likelihood from incomplete data via the EM algorithm. J. Roy. Stat. Soc. B, 39 , 1–39.

    • Search Google Scholar
    • Export Citation

  • Du, J., S. Mullen, and F. Sanders, 2000: Removal of distortion error from an ensemble forecast. Mon. Wea. Rev., 128 , 3347–3351.

  • Eckel, F. A., and C. F. Mass, 2005: Aspects of effective mesoscale, short-range ensemble forecasting. Wea. Forecasting, 20 , 328–350.

  • Epstein, E. S., 1969: Stochastic dynamic prediction. Tellus, 21 , 739–759.

  • Fortin, V., A-C. Favre, and M. Saïd, 2006: Probabilistic forecasting from ensemble prediction systems: Improving upon the best-member method by using a different weight and dressing kernel for each member. Quart. J. Roy. Meteor. Soc., 132 , 1349–1369.

    • Search Google Scholar
    • Export Citation

  • Gel, Y., A. E. Raftery, and T. Gneiting, 2004a: Calibrated probabilistic mesoscale weather field forecasting: The geostatistical output perturbation (GOP) method (with discussion). J. Amer. Stat. Assoc., 99 , 575–588.

    • Search Google Scholar
    • Export Citation

  • Gel, Y., A. E. Raftery, T. Gneiting, and V. J. Berrocal, 2004b: Calibrated probabilistic mesoscale weather field forecasting: The geostatistical output perturbation (GOP) method: Rejoinder. J. Amer. Stat. Assoc., 99 , 588–590.

    • Search Google Scholar
    • Export Citation

  • Glahn, H. R., and D. A. Lowry, 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11 , 1203–1211.

    • Search Google Scholar
    • Export Citation

  • Gneiting, T., 1999: Correlation functions for atmospheric data analysis. Quart. J. Roy. Meteor. Soc., 125 , 2449–2464.

  • Gneiting, T., and A. E. Raftery, 2005: Weather forecasting using ensemble methods. Science, 310 , 248–249.

  • Gneiting, T., A. E. Raftery, A. H. Westveld, and T. Goldman, 2005: Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon. Wea. Rev., 133 , 1098–1118.

    • Search Google Scholar
    • Export Citation

  • Gneiting, T., H. Ševčíková, D. B. Percival, M. Schlather, and Y. Jiang, 2006: Fast and exact simulation of large Gaussian lattice systems in ℝ2: Exploring the limits. J. Comput. Graph. Stat., 15 , 483–501.

    • Search Google Scholar
    • Export Citation

  • Grell, G. A., J. Dudhia, and D. R. Stauffer, 2004: A description of the fifth-generation Penn State/NCAR Mesoscale Model (MM5). NCAR Tech. Note NCAR/TN-398+STR, 121 pp. [Available from MMM Division, NCAR, P.O. Box 3000, Boulder, CO 80307.].

  • Grimit, E. P., and C. F. Mass, 2002: Initial results of a mesoscale short-range ensemble forecasting system over the Pacific Northwest. Wea. Forecasting, 17 , 192–205.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev., 129 , 550–560.

  • Hamill, T. M., and S. J. Colucci, 1997: Verification of Eta-RSM short-range ensemble forecasts. Mon. Wea. Rev., 125 , 1312–1327.

  • Hamill, T. M., J. S. Whitaker, and X. Wei, 2004: Ensemble reforecasting: Improving medium-range forecast skill using retrospective forecasts. Mon. Wea. Rev., 132 , 1434–1447.

    • Search Google Scholar
    • Export Citation

  • Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15 , 559–570.

    • Search Google Scholar
    • Export Citation

  • Hoeting, J. A., D. M. Madigan, A. E. Raftery, and C. T. Volinsky, 1999: Bayesian model averaging: A tutorial. Stat. Sci., 14 , 382–401. [A corrected version is available online at www.stat.washington.edu/www/research/online/hoeting1999.pdf.].

    • Search Google Scholar
    • Export Citation

  • Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126 , 796–811.

    • Search Google Scholar
    • Export Citation

  • Houtekamer, P. L., and H. L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129 , 123–137.

    • Search Google Scholar
    • Export Citation

  • Houtekamer, P. L., L. Lefaivre, J. Derome, H. Ritchie, and H. L. Mitchell, 1996: A system simulation approach to ensemble prediction. Mon. Wea. Rev., 124 , 1225–1242.

    • Search Google Scholar
    • Export Citation

  • Ihaka, R., and R. Gentleman, 1996: R: A language for data analysis and graphics. J. Comput. Graph. Stat., 5 , 299–314.

  • Leith, C. E., 1974: Theoretical skill of Monte Carlo forecasts. Mon. Wea. Rev., 102 , 409–418.

  • Mitchell, H. L., C. Charette, C. Chouinard, and B. Brasnett, 1990: Revised interpolation statistics for the Canadian data assimilation procedure: Their derivation and application. Mon. Wea. Rev., 118 , 1591–1614.

    • Search Google Scholar
    • Export Citation

  • Molteni, R., R. Buizza, T. N. Palmer, and T. Petroliagis, 1996: The ECMWF ensemble system: Methodology and validation. Quart. J. Roy. Meteor. Soc., 122 , 73–119.

    • Search Google Scholar
    • Export Citation

  • Paciorek, C. J., and M. J. Schervish, 2006: Spatial modelling using a new class of nonstationary covariance functions. Environmetrics, 17 , 483–506.

    • Search Google Scholar
    • Export Citation

  • Palmer, T. N., 2002: The economic value of ensemble forecasts as a tool for assessment: From days to decades. Quart. J. Roy. Meteor. Soc., 128 , 747–774.

    • Search Google Scholar
    • Export Citation

  • Purser, R. J., W. S. Wu, D. F. Parrish, and N. M. Roberts, 2003: Numerical aspects of the application of recursive filters to variational statistical analysis. Part II: Spatially inhomogeneous and anisotropic general covariances. Mon. Wea. Rev., 131 , 1536–1548.

    • Search Google Scholar
    • Export Citation

  • Raftery, A. E., T. Gneiting, F. Balabdaoui, and M. Polakowski, 2005: Using Bayesian model averaging to calibrate forecast ensembles. Mon. Wea. Rev., 133 , 1155–1174.

    • Search Google Scholar
    • Export Citation

  • Richardson, D. S., 2000: Skill and relative economic value of the ECMWF ensemble prediction system. Quart. J. Roy. Meteor. Soc., 126 , 649–667.

    • Search Google Scholar
    • Export Citation

  • Roulston, M. S., and L. A. Smith, 2003: Combining dynamical and statistical ensembles. Tellus, 55A , 16–30.

  • Scherrer, S. C., C. Appenzeller, P. Eckert, and D. Cattani, 2004: Analysis of the spread-skill relations using the ECMWF ensemble prediction system over Europe. Wea. Forecasting, 19 , 552–565.

    • Search Google Scholar
    • Export Citation

  • Schlather, M., 2001: Simulation and analysis of random fields. R News, 1 , 2. 18–20.

  • Sloughter, J. M., A. E. Raftery, T. Gneiting, and C. Fraley, 2007: Probabilistic quantitative precipitation forecasting using Bayesian model averaging. Mon. Wea. Rev., in press.

    • Search Google Scholar
    • Export Citation

  • Smith, L. A., and J. A. Hansen, 2004: Extending the limits of ensemble forecast verification with the minimum spanning tree. Mon. Wea. Rev., 132 , 1522–1528.

    • Search Google Scholar
    • Export Citation

  • Stensrud, D. J., H. E. Brooks, J. Du, M. S. Tracton, and E. Rogers, 1999: Using ensembles for short-range forecasting. Mon. Wea. Rev., 127 , 433–446.

    • Search Google Scholar
    • Export Citation

  • Talagrand, O., R. Vautard, and B. Strauss, 1997: Evaluation of probabilistic prediction systems. Proc. ECMWF Workshop on Predictability, Reading, United Kingdom, ECMWF, 1–25.

  • Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at the NMC: The generation of perturbations. Bull. Amer. Meteor. Soc., 74 , 2317–2330.

    • Search Google Scholar
    • Export Citation

  • Wandishin, M. S., S. L. Mullen, D. J. Stensrud, and H. E. Brooks, 2001: Evaluation of a short-range multimodel ensemble system. Mon. Wea. Rev., 129 , 729–747.

    • Search Google Scholar
    • Export Citation

  • Wang, X., and C. H. Bishop, 2005: Improvement of ensemble reliability with a new dressing kernel. Quart. J. Roy. Meteor. Soc., 131 , 965–986.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2002: Smoothing forecast ensembles with fitted probability distributions. Quart. J. Roy. Meteor. Soc., 128 , 2821–2836.

  • Wilks, D. S., 2004: The minimum spanning tree histogram as a verification tool for multidimensional ensemble forecasts. Mon. Wea. Rev., 132 , 1329–1340.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2d ed. Elsevier Academic, 627 pp.

  • Wilson, L. J., S. Beauregard, A. E. Raftery, and R. Verret, 2007: Calibrated surface temperature forecasts from the Canadian ensemble prediction system using Bayesian model averaging. Mon. Wea. Rev., 135 , 1364–1385.

    • Search Google Scholar
    • Export Citation

  • Wood, A. T. A., and G. Chan, 1994: Simulation of stationary Gaussian processes in [0, 1]d. J. Comput. Graph. Stat., 3 , 409–432.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1358 281 16
PDF Downloads 687 204 14