Improving the Analog Ensemble Wind Speed Forecasts for Rare Events

Stefano Alessandrini National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Stefano Alessandrini in
Current site
Google Scholar
PubMed
Close
,
Simone Sperati Ricerca sul Sistema Energetico, Milano, Italy

Search for other papers by Simone Sperati in
Current site
Google Scholar
PubMed
Close
, and
Luca Delle Monache Center For Western Weather and Water Extremes, Scripps Institution of Oceanography, University of California, San Diego, La Jolla, California

Search for other papers by Luca Delle Monache in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

An analog-based ensemble technique, the analog ensemble (AnEn), has been applied successfully to generate probabilistic predictions of meteorological variables, wind and solar power, energy demand, and the optimal bidding in the day-ahead energy market. The AnEn method uses a historical time series of past forecasts from a meteorological model or other prediction systems and observations of the quantity to be predicted. For each forecast lead time, the ensemble set of predictions is a set of observations from the past. These observations are those concurrent with the past forecasts at the same lead time, chosen across the past runs most similar to the current forecast. Recent applications have demonstrated that the AnEn introduces a conditional negative bias when predicting events in the right tail of the forecast distribution of wind speed, particularly when the training dataset is short. This underestimation increases when the predicted event occurs less frequently in the available historical data. A new bias correction for the AnEn using wind observations from more than 500 U.S. stations is tested to reduce the AnEn’s underestimation of rare events. It is shown that the conditional negative bias introduced by the AnEn in its standard application is significantly reduced by our novel approach. Also, the overall probabilistic AnEn performances improve when predicting wind speed higher than 10 m s−1 as demonstrated by lower values of the continuous ranked probability score. These improvements can be attributed to an increased reliability achieved by introducing the proposed bias correction algorithm.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Stefano Alessandrini, alessand@ucar.edu

Abstract

An analog-based ensemble technique, the analog ensemble (AnEn), has been applied successfully to generate probabilistic predictions of meteorological variables, wind and solar power, energy demand, and the optimal bidding in the day-ahead energy market. The AnEn method uses a historical time series of past forecasts from a meteorological model or other prediction systems and observations of the quantity to be predicted. For each forecast lead time, the ensemble set of predictions is a set of observations from the past. These observations are those concurrent with the past forecasts at the same lead time, chosen across the past runs most similar to the current forecast. Recent applications have demonstrated that the AnEn introduces a conditional negative bias when predicting events in the right tail of the forecast distribution of wind speed, particularly when the training dataset is short. This underestimation increases when the predicted event occurs less frequently in the available historical data. A new bias correction for the AnEn using wind observations from more than 500 U.S. stations is tested to reduce the AnEn’s underestimation of rare events. It is shown that the conditional negative bias introduced by the AnEn in its standard application is significantly reduced by our novel approach. Also, the overall probabilistic AnEn performances improve when predicting wind speed higher than 10 m s−1 as demonstrated by lower values of the continuous ranked probability score. These improvements can be attributed to an increased reliability achieved by introducing the proposed bias correction algorithm.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Stefano Alessandrini, alessand@ucar.edu
Save
  • Alessandrini, S., F. Davò, S. Sperati, M. Benini, and L. Delle Monache, 2014: Comparison of the economic impact of different wind power forecast systems for producers. Adv. Sci. Res., 11, 4953, https://doi.org/10.5194/asr-11-49-2014.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Alessandrini, S., L. Delle Monache, S. Sperati, and J. N. Nissen, 2015a: A novel application of an analog ensemble for short-term wind power forecasting. Renewable Energy, 76, 768781, https://doi.org/10.1016/j.renene.2014.11.061.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Alessandrini, S., L. Delle Monache, S. Sperati, and G. Cervone, 2015b: An analog ensemble for short-term probabilistic solar power forecast. Appl. Energy, 157, 95110, https://doi.org/10.1016/j.apenergy.2015.08.011.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Alessandrini, S., L. Delle Monache, C. M. Rozoff, and W. E. Lewis, 2018: Probabilistic prediction of tropical cyclone intensity with an analog ensemble. Mon. Wea. Rev., 146, 17231744, https://doi.org/10.1175/MWR-D-17-0314.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Anderson, J. L., 1996: A method for producing and evaluating probabilistic forecasts from ensemble model integrations. J. Climate, 9, 15181530, https://doi.org/10.1175/1520-0442(1996)009<1518:AMFPAE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brier, G. W., 1950: Verification of forecasts expressed in terms of probability. Mon. Wea. Rev., 78, 13, https://doi.org/10.1175/1520-0493(1950)078<0001:VOFEIT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Carney, M., and P. Cunningham, 2006: Evaluating density forecasting models. Trinity College Dublin, Department of Computer Science, Tech. Rep. TCD-CS-2006-21, 12 pp.

    • Crossref
    • Export Citation
  • Cervone, G., L. Clemente-Harding, S. Alessandrini, and L. Delle Monache, 2017: Short-term photovoltaic power forecasting using Artificial Neural Networks and an Analog Ensemble. Renewable Energy, 108, 274286, https://doi.org/10.1016/j.renene.2017.02.052.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Davò, F., S. Alessandrini, S. Sperati, L. Delle Monache, D. Airoldi, and M. T. Vespucci, 2016: Post-processing techniques and principal component analysis for regional wind power and solar irradiance forecasting. Sol. Energy, 134, 327338, https://doi.org/10.1016/j.solener.2016.04.049.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Delle Monache, L., F. A. Eckel, D. L. Rife, B. Nagarajan, and K. Searight, 2013: Probabilistic weather prediction with an analog ensemble. Mon. Wea. Rev., 141, 34983516, https://doi.org/10.1175/MWR-D-12-00281.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Djalalova, I., L. Delle Monache, and J. Wilczak, 2015: PM2.5 analog forecast and Kalman filtering post-processing for the Community Multiscale Air Quality (CMAQ) model. Atmos. Environ., 119, 431442, https://doi.org/10.1016/j.atmosenv.2015.05.057.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Fortin, V., M. Abaza, F. Anctil, and R. Turcotte, 2014: Why should ensemble spread match the RMSE of the ensemble mean? J. Hydrometeor., 15, 17081713, https://doi.org/10.1175/JHM-D-14-0008.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Glahn, H. R., and D. A. Lowry, 1972: The use of model output statistics (MOS) in objective weather forecasting. J. Appl. Meteor., 11, 12031211, https://doi.org/10.1175/1520-0450(1972)011<1203:TUOMOS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., 2001: Interpretation of rank histograms for verifying ensemble forecasts. Mon. Wea. Rev., 129, 550560, https://doi.org/10.1175/1520-0493(2001)129<0550:IORHFV>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and J. S. Whitaker, 2006: Probabilistic quantitative precipitation forecasts based on reforecast analogs: Theory and application. Mon. Wea. Rev., 134, 32093229, https://doi.org/10.1175/MWR3237.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., M. Scheuerer, and G. T. Bates, 2015: Analog probabilistic precipitation forecasts using GEFS reforecasts and climatology-calibrated precipitation analyses. Mon. Wea. Rev., 143, 33003309, https://doi.org/10.1175/MWR-D-15-0004.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hersbach, H., 2000: Decomposition of the continuous ranked probability score for ensemble prediction systems. Wea. Forecasting, 15, 559570, https://doi.org/10.1175/1520-0434(2000)015<0559:DOTCRP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hopson, T. M., 2014: Assessing the ensemble spread–error relationship. Mon. Wea. Rev., 142, 11251142, https://doi.org/10.1175/MWR-D-12-00111.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Junk, C., L. Delle Monache, S. Alessandrini, G. Cervone, and L. von Bremen, 2015: Predictor-weighting strategies for probabilistic wind power forecasting with an analog ensemble. Meteor. Z., 24, 361379, https://doi.org/10.1127/metz/2015/0659.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Keller, J. D., L. Delle Monache, and S. Alessandrini, 2017: Statistical downscaling of a high-resolution precipitation reanalysis using the analog ensemble method. J. Appl. Meteor. Climatol., 56, 20812095, https://doi.org/10.1175/JAMC-D-16-0380.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mason, I. B., 1982: A model for the assessment of weather forecasts. Aust. Meteor. Mag., 30 (740), 291303.

  • Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595600, https://doi.org/10.1175/1520-0450(1973)012<0595:ANVPOT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Nagarajan, B., L. Delle Monache, J. Hacker, D. Rife, K. Searight, J. Knievel, and T. Nipen, 2015: An evaluation of analog-based post-processing methods across several variables and forecast models. Wea. Forecasting, 30, 16231643, https://doi.org/10.1175/WAF-D-14-00081.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • NCAR Research Applications Laboratory, 2014: Verification: Weather Forecast Verification Utilities. R package version 1.40, accessed 10 December 2018, https://CRAN.R-project.org/package=verification.

  • Plenković, I. O., L. Delle Monache, K. Horvath, and M. Hrastinski, 2018: Deterministic wind speed predictions with analog-based methods over complex topography. J. Appl. Meteor. Climatol., 57, 20472070, https://doi.org/10.1175/JAMC-D-17-0151.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sperati, S., S. Alessandrini, and L. Delle Monache, 2017: Gridded probabilistic weather forecasts with an analog ensemble. Quart. J. Roy. Meteor. Soc., 143, 28742885, https://doi.org/10.1002/qj.3137.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van den Dool, H. M., 1989: A new look at weather forecast through analogs. Mon. Wea. Rev., 117, 22302247, https://doi.org/10.1175/1520-0493(1989)117<2230:ANLAWF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wang, X., and C. H. Bishop, 2003: A comparison of breeding and ensemble transform Kalman filter ensemble forecast schemes. J. Atmos. Sci., 60, 11401158, https://doi.org/10.1175/1520-0469(2003)060<1140:ACOBAE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 751 234 17
PDF Downloads 912 279 23