Another Approach to Forecasting Forecast Skill

W. Y. Chen Climate Analysis Center, NOAA/NWS/NMC, Washington, D.C.

Search for other papers by W. Y. Chen in
Current site
Google Scholar
PubMed
Close
Full access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

The skill of a medium-range numerical forecast can fluctuate widely from day to day. Providing an a priori estimate of the skill of the forecast is therefore important. Existing approaches include Monte Carlo Forecasting and Lagged Average Forecasting, both of which employ the spread between members of an ensemble of forecasts as a predictor. Instead of working with an ensemble, a new approach to predicting forecast skill is proposed that employs the persistence of the model forecast (within the latest integration) as the predictor. The correlation between this simple predictor and the forecast skill is found to be significant for the entire medium range, both over limited regions (e.g., the Pacific North America sector) and over the Northern Hemisphere.

Both root-mean-square and pattern correlation skill scores are used to assess the performance of the forecast and the degree of persistence. The statistical significance of the results is estimated using a Monte Carlo technique. Discrimination of forecast skill is demonstrated using the recent Dynamical Extended Range Forecast experiments carried out by the National Meteorological Center, and is confirmed in tests with independent data.

Abstract

The skill of a medium-range numerical forecast can fluctuate widely from day to day. Providing an a priori estimate of the skill of the forecast is therefore important. Existing approaches include Monte Carlo Forecasting and Lagged Average Forecasting, both of which employ the spread between members of an ensemble of forecasts as a predictor. Instead of working with an ensemble, a new approach to predicting forecast skill is proposed that employs the persistence of the model forecast (within the latest integration) as the predictor. The correlation between this simple predictor and the forecast skill is found to be significant for the entire medium range, both over limited regions (e.g., the Pacific North America sector) and over the Northern Hemisphere.

Both root-mean-square and pattern correlation skill scores are used to assess the performance of the forecast and the degree of persistence. The statistical significance of the results is estimated using a Monte Carlo technique. Discrimination of forecast skill is demonstrated using the recent Dynamical Extended Range Forecast experiments carried out by the National Meteorological Center, and is confirmed in tests with independent data.

Save