Editorial Type:
Article
Article Type:
Research Article

Operational Consensus Forecasts

Frank Woodcock Australian Bureau of Meteorology Research Centre, Melbourne, Victoria, Australia

Search for other papers by Frank Woodcock in
Current site
Google Scholar
PubMed Close
and
Chermelle Engel Australian Bureau of Meteorology Research Centre, Melbourne, Victoria, Australia

Search for other papers by Chermelle Engel in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Feb 2005
DOI:
https://doi.org/10.1175/WAF-831.1
Page(s):
101–111
Restricted access

Abstract

The objective consensus forecasting (OCF) system is an automated operational forecasting system that adapts to underlying numerical model upgrades within 30 days and generally outperforms direct model output (DMO) and model output statistics (MOS) forecasts. It employs routinely available DMO and MOS guidance combined after bias correction using a mean absolute error (MAE)-weighted average algorithm.

OCF generates twice-daily forecasts of screen-level temperature maxima and minima, ground-level temperature minima, evaporation, sunshine hours, and rainfall and its probability for day 0 to day 6 for up to 600 Australian sites.

Extensive real-time trials of temperature forecasts yielded MAEs at days 0–2 about 40% lower than those from its component MOS and DMO forecasts. MAEs were also lower at day 1 than matching official forecasts of maxima and minima by 8% and 10% and outperformed official forecasts at over 71% and 75% of sites, respectively. MAEs of weighted average consensus outperformed simple average forecasts by about 5%.

Corresponding author address: Frank Woodcock, Australian Bureau of Meteorology Research Centre, P.O. Box 1289 K, Melbourne, Victoria 3001, Australia. Email: F.Woodcock@bom.gov.au

Abstract

The objective consensus forecasting (OCF) system is an automated operational forecasting system that adapts to underlying numerical model upgrades within 30 days and generally outperforms direct model output (DMO) and model output statistics (MOS) forecasts. It employs routinely available DMO and MOS guidance combined after bias correction using a mean absolute error (MAE)-weighted average algorithm.

OCF generates twice-daily forecasts of screen-level temperature maxima and minima, ground-level temperature minima, evaporation, sunshine hours, and rainfall and its probability for day 0 to day 6 for up to 600 Australian sites.

Extensive real-time trials of temperature forecasts yielded MAEs at days 0–2 about 40% lower than those from its component MOS and DMO forecasts. MAEs were also lower at day 1 than matching official forecasts of maxima and minima by 8% and 10% and outperformed official forecasts at over 71% and 75% of sites, respectively. MAEs of weighted average consensus outperformed simple average forecasts by about 5%.

Corresponding author address: Frank Woodcock, Australian Bureau of Meteorology Research Centre, P.O. Box 1289 K, Melbourne, Victoria 3001, Australia. Email: F.Woodcock@bom.gov.au

Save
Cover Weather and Forecasting
Weather and Forecasting

  • Aksu, C., and Gunter S. I. , 1992: An empirical analysis of the accuracy of SA, OLS, ERLS and NRLS combination forecasts. Int. J. Forecasting, 8 , 27–43.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bosart, L. F., 1975: SUNYA experimental results in forecasting daily temperature and precipitation. Mon. Wea. Rev., 103 , 1013–1020.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Bourke, W., Hart T. , Steinle P. , Seaman R. , Embery G. , Naughton M. , and Rikus L. , 1995: Evolution of the Bureau of Meteorology's Global Assimilation and Prediction System. Part 2: Resolution enhancements and case studies. Aust. Meteor. Mag., 44 , 19–40.

    • Search Google Scholar
    • Export Citation

  • Brown, B. G., and Murphy A. H. , 1996: Improving forecasting performance by combining forecasts: The example of road-surface temperature forecasts. Meteor. Appl., 3 , 257–265.

    • Search Google Scholar
    • Export Citation

  • Clemen, R. T., 1989: Combining forecasts: A review and annotated bibliography. Int. J. Forecasting, 5 , 559–583.

  • Clemen, R. T., and Winkler R. L. , 1985: Limits for the precision and value of information from dependent sources. Operations Res., 33 , 427–442.

  • Ebert, E. E., 2001: Ability of a poor man's ensemble to predict the probability and distribution of precipitation. Mon. Wea. Rev., 129 , 2461–2480.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Erickson, M. C., Dallaville J. P. , and Carroll K. L. , 2002: The new AVN/MRF MOS development and model changes: A volatile mix? Preprints, 16th Conf. on Probability and Statistics in the Atmospheric Sciences, Orlando, FL, Amer. Meteor. Soc., 82–87.

  • Ezekiel, M., and Fox H. A. , 1970: Methods of Correlation and Regression Analysis. 3d ed. Wiley, 548 pp.

  • Forsythe, G. E., Malcolm M. A. , and Moler C. B. , 1977: Computer Methods for Mathematical Computations. Prentice Hall, 259 pp.

  • Fraedrich, K., and Leslie L. M. , 1987: Combining predictive schemes in short-term forecasting. Mon. Wea. Rev., 115 , 1640–1644.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Fritsch, J. M., Hilliker J. , Ross J. , and Vislocky R. L. , 2000: Model consensus. Wea. Forecasting, 15 , 571–582.

  • Garthwaite, P. H., 1994: An interpretation of partial least squares. J. Amer. Stat. Assoc., 89 , 122–127.

  • Gerding, S., and Myers B. , 2003: Adaptive data fusion of meteorological forecast modules. Preprints, Third Conf. on Artificial Intelligence Applications, Long Beach, CA, Amer. Meteor. Soc., CD-ROM, 4.8.

  • Glahn, H. R., and Lowry D. A. , 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11 , 1203–1211.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Gupta, S., and Wilton P. C. , 1987: Combination of forecasts: An extension. Manage. Sci., 33 , 356–372.

  • Jacks, E., Bower J. B. , Dagostaro V. J. , Dallaville J. P. , Erickson M. C. , and Su J. C. , 1990: New NGM-based MOS guidance for maxima and minima temperature, probability of precipitation, cloud amount, and surface wind. Wea. Forecasting, 5 , 128–138.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Jackson, J., 1991: A User's Guide to Principal Components. Wiley, 569 pp.

  • Krishnamurti, T. N., Kishtawal T. E. , Shin D. W. , and Williford C. E. , 2000: Improving tropical precipitation forecasts from a multimodel superensemble. J. Climate, 13 , 4217–4227.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Mao, Q., McNider R. T. , Mueller S. F. , and Juang H. H. , 1999: An optimal model output calibration algorithm suitable for objective temperature forecasting. Wea. Forecasting, 14 , 190–202.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Mass, C. F., 2003: IFPS and the future of the National Weather Service. Wea. Forecasting, 18 , 75–79.

  • Nicholls, N., 2004: The changing nature of Australian droughts. Climate Change, 63 , 323–326.

  • Puri, K., Dietachmayer G. S. , Mills G. A. , Davidson N. E. , Bowen R. , and Logan L. W. , 1998: The new BMRC Limited Area Prediction System, LAPS. Aust. Meteor. Mag., 47 , 203–223.

    • Search Google Scholar
    • Export Citation

  • Sanders, F., 1973: Skill in forecasting daily temperature and precipitation: Some experimental results. Bull. Amer. Meteor. Soc., 54 , 1171–1179.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Seaman, R., Bourke W. , Steinle P. , Hart T. , Embery G. , Naughton M. , and Rikus L. , 1995: Evolution of the Bureau of Meteorology's Global Assimilation and Prediction System. Part 1: Analysis and initialisation. Aust. Meteor. Mag., 44 , 1–18.

    • Search Google Scholar
    • Export Citation

  • Stensrud, D. J., and Skindlov J. A. , 1996: Gridpoint predictions of high temperature from a mesoscale model. Wea. Forecasting, 11 , 103–110.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Thompson, P. D., 1977: How to improve accuracy by combining independent forecasts. Mon. Wea. Rev., 105 , 228–229.

  • Vislocky, R. L., and Young G. S. , 1989: The use of perfect prog forecasts to improve model output statistics forecasts of precipitation. Wea. Forecasting, 4 , 202–209.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Vislocky, R. L., and Fritsch J. M. , 1995: Improved model output statistics forecasts through model consensus. Bull. Amer. Meteor. Soc., 76 , 1157–1163.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Wilson, L. J., and Vallée M. , 2002: The Canadian Updatable Model Output Statistics (UMOS) system: Design and development tests. Wea. Forecasting, 17 , 206–222.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Winkler, R. L., and Clemen R. T. , 1992: The sensitivity of weights in combining forecasts. Operations Res., 40 , 609–614.

  • Winkler, R. L., Murphy A. H. , and Katz R. W. , 1977: The consensus of subjective probability forecasts: Are two heads better than one? Preprints, Fifth Conf. on Probability and Statistics, Las Vegas, NV, Amer. Meteor. Soc., 57−62.

  • Wonnacott, T. H., and Wonnacott R. J. , 1972: Introductory Statistics. Wiley, 510 pp.

  • Woodcock, F., 1984: Australian experimental model output statistics forecasts of daily maximum and minimum temperature. Mon. Wea. Rev., 112 , 2112–2121.

    • Crossref
    • Search Google Scholar
    • Export Citation

  • Woodcock, F., and Southern B. , 1983: The use of linear regression to improve official temperature forecasts. Aust. Meteor. Mag., 31 , 57–62.

    • Search Google Scholar
    • Export Citation

  • Young, G., 2002: Combining forecasts for superior prediction. Preprints, 16th Conf. on Probability and Statistics in the Atmospheric Sciences, Orlando, FL, Amer. Meteor. Soc., 107–111.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1100 321 21
PDF Downloads 586 202 8