A Single-Station Approach to Model Output Statistics Temperature Forecast Error Assessment

Andrew A. Taylor School of Meteorology, University of Oklahoma, Norman, Oklahoma

Search for other papers by Andrew A. Taylor in
Current site
Google Scholar
PubMed
Close
and
Lance M. Leslie School of Meteorology, University of Oklahoma, Norman, Oklahoma

Search for other papers by Lance M. Leslie in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Error characteristics of model output statistics (MOS) temperature forecasts are calculated for over 200 locations around the continental United States. The forecasts are verified on a station-by-station basis for the year 2001. Error measures used include mean algebraic error (bias), mean absolute error (MAE), relative frequency of occurrence of bias and MAE values, and the daily forecast errors themselves. A case study examining the spatial and temporal evolution of MOS errors is also presented.

The error characteristics presented here, together with the case study, provide a more detailed evaluation of MOS performance than may be obtained from regionally averaged error statistics. Knowledge concerning locations where MOS forecasts have large errors or biases and why those errors or biases exist is of great value to operational forecasters. Not only does such knowledge help improve their forecasts, but forecaster performance is often compared to MOS predictions. Examples of biases in MOS forecast errors are illustrated by examining two stations in detail. Significant warm and cold biases are found in maximum temperature forecasts for Los Angeles, California (LAX), and minimum temperature forecasts for Las Vegas, Nevada (LAS), respectively. MAE values for MOS temperature predictions calculated in this study suggest that coastal stations tend to have lower MAE values and lower variability in their errors, while forecasts with high MAE and error variability are more frequent in the interior of the United States. Therefore, MAE values from samples of MOS forecasts are directly proportional to the variance in the observations. Additionally, it is found that daily maximum temperature forecast errors exhibit less variability during the summer months than they do over the rest of the year, and that forecasts for any one station rarely follow a consistent temporal pattern for more than two or three consecutive days. These inconsistent error patterns indicate that forecasting temperatures based on recent trends in MOS forecast errors at an individual station is usually not a good strategy. As shown in earlier studies by other authors and demonstrated again here, MOS temperature forecasts are often inaccurate in the vicinity of strong temperature gradients, for locations affected by shallow cold air masses, or for stations in regions of anomalously warm or cold temperatures.

Finally, a case study is presented examining the spatial and temporal distributions of MOS temperature forecast errors across the United States from 13 to 15 February 2001. During this period, two surges of cold arctic air moved south into the United States. In contrast to error trends at individual stations, nationwide spatial and temporal patterns of MOS forecast errors could prove to be a powerful forecasting tool. Nationwide plots of errors in MOS forecasts would be useful if made available in real time to operational forecasters.

Corresponding author address: Andrew A. Taylor, School of Meteorology, University of Oklahoma, Rm. 1310, 100 E. Boyd St., Norman, OK 73019. Email: aataylor@ou.edu

Abstract

Error characteristics of model output statistics (MOS) temperature forecasts are calculated for over 200 locations around the continental United States. The forecasts are verified on a station-by-station basis for the year 2001. Error measures used include mean algebraic error (bias), mean absolute error (MAE), relative frequency of occurrence of bias and MAE values, and the daily forecast errors themselves. A case study examining the spatial and temporal evolution of MOS errors is also presented.

The error characteristics presented here, together with the case study, provide a more detailed evaluation of MOS performance than may be obtained from regionally averaged error statistics. Knowledge concerning locations where MOS forecasts have large errors or biases and why those errors or biases exist is of great value to operational forecasters. Not only does such knowledge help improve their forecasts, but forecaster performance is often compared to MOS predictions. Examples of biases in MOS forecast errors are illustrated by examining two stations in detail. Significant warm and cold biases are found in maximum temperature forecasts for Los Angeles, California (LAX), and minimum temperature forecasts for Las Vegas, Nevada (LAS), respectively. MAE values for MOS temperature predictions calculated in this study suggest that coastal stations tend to have lower MAE values and lower variability in their errors, while forecasts with high MAE and error variability are more frequent in the interior of the United States. Therefore, MAE values from samples of MOS forecasts are directly proportional to the variance in the observations. Additionally, it is found that daily maximum temperature forecast errors exhibit less variability during the summer months than they do over the rest of the year, and that forecasts for any one station rarely follow a consistent temporal pattern for more than two or three consecutive days. These inconsistent error patterns indicate that forecasting temperatures based on recent trends in MOS forecast errors at an individual station is usually not a good strategy. As shown in earlier studies by other authors and demonstrated again here, MOS temperature forecasts are often inaccurate in the vicinity of strong temperature gradients, for locations affected by shallow cold air masses, or for stations in regions of anomalously warm or cold temperatures.

Finally, a case study is presented examining the spatial and temporal distributions of MOS temperature forecast errors across the United States from 13 to 15 February 2001. During this period, two surges of cold arctic air moved south into the United States. In contrast to error trends at individual stations, nationwide spatial and temporal patterns of MOS forecast errors could prove to be a powerful forecasting tool. Nationwide plots of errors in MOS forecasts would be useful if made available in real time to operational forecasters.

Corresponding author address: Andrew A. Taylor, School of Meteorology, University of Oklahoma, Rm. 1310, 100 E. Boyd St., Norman, OK 73019. Email: aataylor@ou.edu

Save
  • Brenner, I. S., 1986: Biases in MOS forecasts of maximum and minimum temperatures at Phoenix, Arizona. Wea. Forecasting, 1 , 226229.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Carter, G. M., Dallavalle J. P. , and Glahn H. R. , 1989: Statistical forecasts based on the National Meteorological Center’s numerical weather prediction system. Wea. Forecasting, 4 , 401412.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dallavalle, J. P., Erickson M. C. , and Maloney J. C. III, 2004: Model output statistics (MOS) guidance for short-range projections. Preprints, 20th Conf. on Weather Analysis and Forecasting and 18th Conf. on Numerical Weather Prediction, Seattle, WA, Amer. Meteor. Soc., CD-ROM, 6.1.

  • Erickson, M. C., Dallavalle J. P. , and Carroll K. L. , 2002: The new AVN/MRF MOS development and model changes: A volatile mix? Preprints, 16th Conf. on Probability and Statistics in the Atmospheric Sciences, Orlando, FL, Amer. Meteor. Soc., 82–87.

  • Glahn, H. R., and Lowry D. A. , 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11 , 12031211.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jacks, E., Bower J. B. , Dagostaro V. J. , Dallavalle J. P. , Erickson M. C. , and Su J. C. , 1990: New NGM-based MOS guidance for maximum/minimum temperature, probability of precipitation, cloud amount, and surface wind. Wea. Forecasting, 5 , 128138.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kanamitsu, M., 1989: Description of the NMC global data assimilation and forecast system. Wea. Forecasting, 4 , 335342.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Klein, W. H., and Glahn H. R. , 1974: Forecasting local weather by means of model output statistics. Bull. Amer. Meteor. Soc., 55 , 12171227.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Klein, W. H., and Hammons G. A. , 1975: Maximum/minimum temperature forecasts based on model output statistics. Mon. Wea. Rev., 103 , 796806.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Klein, W. H., Lewis B. M. , and Enger I. , 1959: Objective prediction of five-day mean temperatures during winter. J. Meteor., 16 , 672682.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Koziara, M. C., Renard R. J. , and Thompson W. J. , 1983: Estimating marine fog probability using a model output statistics scheme. Mon. Wea. Rev., 111 , 23332340.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • McCutchan, M. H., 1978: A model for predicting synoptic weather types based on model output statistics. J. Appl. Meteor., 17 , 14661475.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Phillips, N. A., 1979: The Nested Grid Model. NOAA Tech. Rep. NWS 22, 80 pp.

  • Schultz, P., and Warner T. T. , 1982: Characteristics of summertime circulations and pollutant ventilation in the Los Angeles Basin. J. Appl. Meteor., 21 , 672682.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 1995: Statistical Methods in the Atmospheric Sciences. Academic Press, 467 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 285 98 7
PDF Downloads 193 51 4