Editorial Type:
Article
Article Type:
Research Article

Adaptive Evolutionary Programming

Paul J. Roebber Atmospheric Science Group, Department of Mathematical Sciences, and School of Freshwater Sciences, University of Wisconsin–Milwaukee, Milwaukee, Wisconsin

Search for other papers by Paul J. Roebber in
Current site
Google Scholar
PubMed Close
Print Publication:
01 May 2015
DOI:
https://doi.org/10.1175/MWR-D-14-00095.1
Page(s):
1497–1505
Restricted access

Abstract

Previous work has shown that evolutionary programming is an effective method for constructing skillful forecast ensembles. Here, two prototype adaptive methods are developed and tested, using minimum temperature forecast data for Chicago, Illinois, to determine whether they are capable of incorporating improvements to forecast inputs (as might occur with changes to operational forecast models and data assimilation methods) and to account for short-term changes in predictability (as might occur for particular flow regimes). Of the two methods, the mixed-mode approach, which uses a slow mode to evolve the overall ensemble structure and a fast mode to adjust coefficients, produces the best results. When presented with better operational guidance, the mixed-mode method shows a reduction of 0.57°F in root-mean-square error relative to a fixed evolutionary program ensemble. Several future investigations are needed, including the optimization of training intervals based on flow regime and improvements to the adjustment of fast-mode coefficients. Some remarks on the appropriateness of this method for other ensemble forecast problems are also provided.

Corresponding author address: Paul J. Roebber, Department of Mathematical Sciences, University of Wisconsin–Milwaukee, P.O. Box 413, Milwaukee, WI 53201-0413. E-mail: roebber@uwm.edu

Abstract

Previous work has shown that evolutionary programming is an effective method for constructing skillful forecast ensembles. Here, two prototype adaptive methods are developed and tested, using minimum temperature forecast data for Chicago, Illinois, to determine whether they are capable of incorporating improvements to forecast inputs (as might occur with changes to operational forecast models and data assimilation methods) and to account for short-term changes in predictability (as might occur for particular flow regimes). Of the two methods, the mixed-mode approach, which uses a slow mode to evolve the overall ensemble structure and a fast mode to adjust coefficients, produces the best results. When presented with better operational guidance, the mixed-mode method shows a reduction of 0.57°F in root-mean-square error relative to a fixed evolutionary program ensemble. Several future investigations are needed, including the optimization of training intervals based on flow regime and improvements to the adjustment of fast-mode coefficients. Some remarks on the appropriateness of this method for other ensemble forecast problems are also provided.

Corresponding author address: Paul J. Roebber, Department of Mathematical Sciences, University of Wisconsin–Milwaukee, P.O. Box 413, Milwaukee, WI 53201-0413. E-mail: roebber@uwm.edu
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Baars, J. A., and C. F. Mass, 2005: Performance of National Weather Service forecasts compared to operational, consensus, and weighted model output statistics. Wea. Forecasting, 20, 1034–1047, doi:10.1175/WAF896.1.

    • Search Google Scholar
    • Export Citation

  • Bradshaw, W. E., and C. M. Holzapfel, 2006: Evolutionary response to rapid climate change. Science, 312, 1477–1478, doi:10.1126/science.1127000.

    • Search Google Scholar
    • Export Citation

  • Cheng, W. Y. Y., and W. J. Steenburgh, 2007: Strengths and weaknesses of MOS, running-mean bias removal, and Kalman filter techniques for improving model forecasts over the western United States. Wea. Forecasting, 22, 1304–1318, doi:10.1175/2007WAF2006084.1.

    • Search Google Scholar
    • Export Citation

  • Crochet, P., 2004: Adaptive Kalman filtering of 2-metre temperature and 10-metre wind-speed forecasts in Iceland. Meteor. Appl., 11, 173–187, doi:10.1017/S1350482704001252.

    • Search Google Scholar
    • Export Citation

  • Delle Monache, L., T. Nipen, Y. Liu, G. Roux, and R. Stull, 2011: Kalman filter and analog schemes to postprocess numerical weather predictions. Mon. Wea. Rev., 139, 3554–3570, doi:10.1175/2011MWR3653.1.

    • Search Google Scholar
    • Export Citation

  • Fogel, L. J., 1999: Intelligence through Simulated Evolution: Forty Years of Evolutionary Programming. Wiley Series on Intelligent Systems, John Wiley, 162 pp.

  • Greybush, S. J., S. E. Haupt, and G. S. Young, 2008: The regime dependence of optimally weighted ensemble model consensus forecasts of surface temperature. Wea. Forecasting, 23, 1146–1161, doi:10.1175/2008WAF2007078.1.

    • Search Google Scholar
    • Export Citation

  • Hillis, W. D., 1990: Co-evolving parasites improve simulated evolution as an optimization procedure. Physica D, 42, 228–234, doi:10.1016/0167-2789(90)90076-2.

    • Search Google Scholar
    • Export Citation

  • Hoffman, R. R., J. W. Coffey, K. M. Ford, and J. D. Novak, 2006: A method for eliciting, preserving, and sharing the knowledge of forecasters. Wea. Forecasting, 21, 416–428, doi:10.1175/WAF927.1.

    • Search Google Scholar
    • Export Citation

  • Homleid, M., 1995: Diurnal corrections of short-term surface temperature forecasts using the Kalman filter. Wea. Forecasting, 10, 689–707, doi:10.1175/1520-0434(1995)010<0689:DCOSTS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Huang, L. X., G. A. Isaac, and G. Sheng, 2012: Integrating NWP forecasts and observation data to improve nowcasting accuracy. Wea. Forecasting, 27, 938–953, doi:10.1175/WAF-D-11-00125.1.

    • Search Google Scholar
    • Export Citation

  • Monteith, K., J. Carroll, K. Seppi, and T. Martinez, 2011: Turning Bayesian model averaging into Bayesian model combination. Proc. 2011 Int. Joint Conf. on Neural Networks, San Jose, CA, IEEE, 2657–2663.

  • Nipen, T. N., G. West, and R. B. Stull, 2011: Updating short-term probabilistic weather forecasts of continuous variables using recent observations. Wea. Forecasting, 26, 564–571, doi:10.1175/WAF-D-11-00022.1.

    • Search Google Scholar
    • Export Citation

  • Persson, A., 1991: Kalman filtering—A new approach to adaptive statistical interpretation of numerical meteorological forecasts. Lectures presented at the WMO Training Workshop on the Interpretation of NWP Products in Terms of Local Weather Phenomena and Their Verification, H. R. Glahn et al., Eds., WMO/TD 421, WMO PSMP Rep. Series 34, XX-27–XX-32. [Available online at http://library.wmo.int/pmb_ged/wmo-td_421.pdf.]

  • Raftery, A. E., T. Gneiting, F. Balabdaoui, and M. Polakowski, 2005: Using Bayesian model averaging to calibrate forecast ensembles. Mon. Wea. Rev., 133, 1155–1174, doi:10.1175/MWR2906.1.

    • Search Google Scholar
    • Export Citation

  • Roebber, P. J., 2010: Seeking consensus: A new approach. Mon. Wea. Rev., 138, 4402–4415, doi:10.1175/2010MWR3508.1.

  • Roebber, P. J., 2013: Using evolutionary programming to generate skillful extreme value probabilistic forecasts. Mon. Wea. Rev., 141, 3170–3185, doi:10.1175/MWR-D-12-00285.1.

    • Search Google Scholar
    • Export Citation

  • Roebber, P. J., 2015a: Evolving ensembles. Mon. Wea. Rev., 143, 471–490, doi:10.1175/MWR-D-14-00058.1.

  • Roebber, P. J., 2015b: Using evolutionary programs to maximize minimum temperature forecast skill. Mon. Wea. Rev., 143, 1506–1516,doi:10.1175/MWR-D-14-00096.1.

    • Search Google Scholar
    • Export Citation

  • Ross, G. H., 1987: An updateable model output statistics scheme. Extended abstracts of papers presented at the WMO Workshop on Significant Weather Elements Prediction and Objective Interpretation Methods, WMO PSMP Rep. Series 25, 25–28.

  • Simonsen, C., 1991: Self adaptive model output statistics based on Kalman filtering. Lectures presented at the WMO Training Workshop on the Interpretation of NWP Products in Terms of Local Weather Phenomena and Their Verification, H. R. Glahn et al., Eds., WMO/TD 421, WMO PSMP Rep. Series 34, XX-33–XX-37.

  • Wilson, L. J., and M. Vallée, 2002: The Canadian Updateable Model Output Statistics (UMOS) system: Design and development tests. Wea. Forecasting, 17, 206–222, doi:10.1175/1520-0434(2002)017<0206:TCUMOS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 588 373 33
PDF Downloads 180 59 3