Intercomparison of Global Research and Operational Forecasts

Jennifer C. Roman Department of Meteorology, University of Utah, Salt Lake City, Utah

Search for other papers by Jennifer C. Roman in
Current site
Google Scholar
PubMed
Close
,
Gonzalo Miguez-Macho Department of Environmental Sciences, Rutgers–The State University of New Jersey, New Brunswick, New Jersey

Search for other papers by Gonzalo Miguez-Macho in
Current site
Google Scholar
PubMed
Close
,
Lee A. Byerle Department of Meteorology, University of Utah, Salt Lake City, Utah

Search for other papers by Lee A. Byerle in
Current site
Google Scholar
PubMed
Close
, and
Jan Paegle Department of Meteorology, University of Utah, Salt Lake City, Utah

Search for other papers by Jan Paegle in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Current limitations of atmospheric predictive skill are investigated through comparison of correlation and error statistics of operational and research global models for two winter seasons. In 1993, bias-corrected models produced anomaly correlations of 0.6 after 6.5–7 days, with relatively little forecast skill beyond that point. In 2003, the forecast skill of a more developed, higher-resolution operational model has been extended 36 h, while the skill of the unchanged, low-resolution research model has been extended 6 h. This implies more predictable patterns in 2003 or model and initial state improvements made since 1993. The relative importance of improved model resolution/physics and improved initial state to the lengthening of forecast skill is diagnosed through the evaluation of rms evolution of analyzed and forecast differences of 500-mb height and meridional wind. Results indicate that forecast sensitivity to initial data is less important than is the sensitivity to the model used. However, the sensitivity to model used (rms of model forecast differences) is smaller than the rms forecast error of either model, indicating model forecasts are more similar to each other than to reality. In 1993, anomaly correlations of model forecasts to each other reach 0.6 by roughly 8 days; that is, the models predict each other's behavior 1.5 days longer than they predict that of the real atmosphere. Correlations of model errors to each other quantify this similarity, with correlations exceeding the asymptotic value of 0.5 through the 14-day forecasts. Investigations of initial state error evolution by wavenumber show long waves (0–15) account for 50% more of the total uncertainty growth in 14-day research model integrations than do short waves (16–42). Results indicate current predictive skill may be impacted by model sophistication, but error pattern similarities suggest a common deficiency of models, perhaps in the initial state uncertainty.

Corresponding author address: Dr. Jan Paegle, Department of Meteorology, Rm. 819, University of Utah, 135 S. 1460 E., Salt Lake City, UT 84112-0110. Email: jpaegle@met.utah.edu

Abstract

Current limitations of atmospheric predictive skill are investigated through comparison of correlation and error statistics of operational and research global models for two winter seasons. In 1993, bias-corrected models produced anomaly correlations of 0.6 after 6.5–7 days, with relatively little forecast skill beyond that point. In 2003, the forecast skill of a more developed, higher-resolution operational model has been extended 36 h, while the skill of the unchanged, low-resolution research model has been extended 6 h. This implies more predictable patterns in 2003 or model and initial state improvements made since 1993. The relative importance of improved model resolution/physics and improved initial state to the lengthening of forecast skill is diagnosed through the evaluation of rms evolution of analyzed and forecast differences of 500-mb height and meridional wind. Results indicate that forecast sensitivity to initial data is less important than is the sensitivity to the model used. However, the sensitivity to model used (rms of model forecast differences) is smaller than the rms forecast error of either model, indicating model forecasts are more similar to each other than to reality. In 1993, anomaly correlations of model forecasts to each other reach 0.6 by roughly 8 days; that is, the models predict each other's behavior 1.5 days longer than they predict that of the real atmosphere. Correlations of model errors to each other quantify this similarity, with correlations exceeding the asymptotic value of 0.5 through the 14-day forecasts. Investigations of initial state error evolution by wavenumber show long waves (0–15) account for 50% more of the total uncertainty growth in 14-day research model integrations than do short waves (16–42). Results indicate current predictive skill may be impacted by model sophistication, but error pattern similarities suggest a common deficiency of models, perhaps in the initial state uncertainty.

Corresponding author address: Dr. Jan Paegle, Department of Meteorology, Rm. 819, University of Utah, 135 S. 1460 E., Salt Lake City, UT 84112-0110. Email: jpaegle@met.utah.edu

Save
  • Bath, L. M., Dias M. A. , Williamson D. L. , Williamson G. S. , and Wolski R. J. , 1987: User's guide to NCAR CCM1. Tech. Rep. NCAR/TN-286+IA, 173 pp.

    • Search Google Scholar
    • Export Citation
  • Baumhefner, D., and Downey P. , 1978: Forecast intercomparisons from three numerical weather prediction models. Mon. Wea. Rev, 106 , 12451279.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Buchmann, J., Buja L. E. , Nogues-Paegle J. , and Paegle J. , 1995: The dynamical basis of regional vertical motion fields surrounding localized tropical heating. J. Climate, 8 , 12171234.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Byerle, L. A., and Paegle J. , 2003: Description of the seasonal cycle of low-level flows flanking the Andes and their interannual variability. Meteorologica, 27 , 7188.

    • Search Google Scholar
    • Export Citation
  • Gibson, J. K., Kallberg P. , Uppala S. , Nomura A. , Hernandez A. , and Serrano E. , 1997: ERA description. ECMWF Re-Analysis Project Report Series, No. 1, 58 pp.

    • Search Google Scholar
    • Export Citation
  • Hacker, J. P., Krayenhoff E. S. , and Stull R. B. , 2003: Ensemble experiments on numerical weather prediction error and uncertainty for a North Pacific forecast failure. Wea. Forecasting, 18 , 1231.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hartmann, D. L., Buizza R. , and Palmer T. N. , 1995: Singular vectors: The effect of spatial scale on linear growth of disturbances. J. Atmos. Sci, 52 , 38853894.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc, 77 , 437471.

  • Lorenz, E. N., 1969: The predictability of a flow which possesses many scales of motion. Tellus, 21 , 289307.

  • Miguez-Macho, G., and Paegle J. , 1999a: Optimal observation distribution for numerical weather prediction. Preprints, Third Symp. on Integrated Observing Systems, Dallas, TX, Amer. Meteor. Soc., 18–23.

    • Search Google Scholar
    • Export Citation
  • Miguez-Macho, G., and Paegle J. , 1999b: Optimal observation distribution for numerical weather prediction. Preprints, 13th Conf. on Numerical Weather Prediction, Denver, CO, Amer. Meteor. Soc., 23–26.

    • Search Google Scholar
    • Export Citation
  • Miguez-Macho, G., and Paegle J. , 2000: Sensitivity of a global forecast model to initializations with reanalysis datasets. Mon. Wea. Rev, 128 , 38793889.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Miguez-Macho, G., and Paegle J. , 2001: Sensitivity of North American numerical weather prediction to initial state uncertainty in selected upstream subdomains. Mon. Wea. Rev, 129 , 20052022.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nicolini, M., Waldron K. M. , and Paegle J. , 1993: Diurnal variations of low-level jets, vertical motion, and precipitation: A model case study. Mon. Wea. Rev, 121 , 25882610.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nogues-Paegle, J., Mo K. C. , and Paegle J. , 1998: Predictability of the NCEP–NCAR reanalysis model during austral summer. Mon. Wea. Rev, 126 , 31353152.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Paegle, J., 1989: A variable resolution global model based upon Fourier and finite element representation. Mon. Wea. Rev, 117 , 583606.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Paegle, J., and Horel J. , 1991: The influence of observational uncertainty upon wind-based analyses. Preprints, Ninth Conf. on Numerical Weather Prediction, Denver, CO, Amer. Meteor. Soc., 779–782.

    • Search Google Scholar
    • Export Citation
  • Paegle, J., Yang Q. , and Wang M. , 1997: Predictability in limited area and global models. Meteor. Atmos. Phys, 63 , 5369.

  • Palmer, T. N., Gelaro R. , Barkmeijer J. , and Buizza R. , 1998: Singular vectors, metrics, and adaptive observations. J. Atmos. Sci, 55 , 633653.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rabier, F., Klinker E. , Courtier P. , and Hollingsworth A. , 1996: Sensitivity of forecast errors to initial conditions. Quart. J. Roy. Meteor. Soc, 122 , 121150.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Reynolds, C. A., Webster P. J. , and Kalnay E. , 1994: Random error growth in NMC's global forecasts. Mon. Wea. Rev, 122 , 12811305.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Simmons, A. J., and Hollingsworth A. , 2002: Some aspects of the improvement in skill of numerical weather prediction. Quart. J. Roy. Meteor. Soc, 128 , 647677.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, P. D., 1957: Uncertainty of initial state as a factor in the predictability of large scale atmospheric flow patterns. Tellus, 9 , 275295.

    • Search Google Scholar
    • Export Citation
  • Vukicevic, T., and Paegle J. , 1989: The influence of one-way interacting lateral boundary conditions on predictability of flow in bounded numerical models. Mon. Wea. Rev, 117 , 340350.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Warner, T. T., Peterson R. A. , and Treadon R. E. , 1997: A tutorial on lateral boundary conditions as a basic and potentially serious limitation to regional numerical weather prediction. Bull. Amer. Meteor. Soc, 78 , 25992617.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • White, B. G., Paegle J. , Steenburgh W. J. , Horel J. D. , Swanson R. T. , Cook L. K. , Onton D. J. , and Miles J. G. , 1999: Short-term forecast validation of six models. Wea. Forecasting, 14 , 84108.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 323 163 21
PDF Downloads 38 21 3