Editorial Type:
Article
Article Type:
Research Article

Evaluation of IRI’s Seasonal Climate Forecasts for the Extreme 15% Tails

Anthony G. Barnston International Research Institute for Climate and Society, The Earth Institute at Columbia University, Palisades, New York

Search for other papers by Anthony G. Barnston in
Current site
Google Scholar
PubMed Close
and
Simon J. Mason International Research Institute for Climate and Society, The Earth Institute at Columbia University, Palisades, New York

Search for other papers by Simon J. Mason in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Aug 2011
DOI:
https://doi.org/10.1175/WAF-D-10-05009.1
Page(s):
545–554
Restricted access

Abstract

This paper evaluates the quality of real-time seasonal probabilistic forecasts of the extreme 15% tails of the climatological distribution of temperature and precipitation issued by the International Research Institute for Climate and Society (IRI) from 1998 through 2009. IRI’s forecasts have been based largely on a two-tiered multimodel dynamical prediction system. Forecasts of the 15% extremes have been consistent with the corresponding probabilistic forecasts for the standard tercile-based categories; however, nonclimatological forecasts for the extremes have been issued sparingly. Results indicate positive skill in terms of resolution and discrimination for the extremes forecasts, particularly in the tropics. Additionally, with the exception of some overconfidence for extreme above-normal precipitation and a strong cool bias for temperature, reliability analyses suggest generally good calibration. Skills for temperature are generally higher than those for precipitation, due both to correct forecasts of increased probabilities of extremely high (above the upper 15th percentile) temperatures associated with warming trends, and to better discrimination of interannual variability. However, above-normal temperature extremes were substantially underforecast, as noted also for the IRI’s tercile forecasts.

Corresponding author address: Anthony Barnston, International Research Institute for Climate and Society, P.O. Box 1000, 61 Rt. 9W, Columbia University, Palisades, NY 10964-8000. E-mail: tonyb@iri.columbia.edu

Abstract

This paper evaluates the quality of real-time seasonal probabilistic forecasts of the extreme 15% tails of the climatological distribution of temperature and precipitation issued by the International Research Institute for Climate and Society (IRI) from 1998 through 2009. IRI’s forecasts have been based largely on a two-tiered multimodel dynamical prediction system. Forecasts of the 15% extremes have been consistent with the corresponding probabilistic forecasts for the standard tercile-based categories; however, nonclimatological forecasts for the extremes have been issued sparingly. Results indicate positive skill in terms of resolution and discrimination for the extremes forecasts, particularly in the tropics. Additionally, with the exception of some overconfidence for extreme above-normal precipitation and a strong cool bias for temperature, reliability analyses suggest generally good calibration. Skills for temperature are generally higher than those for precipitation, due both to correct forecasts of increased probabilities of extremely high (above the upper 15th percentile) temperatures associated with warming trends, and to better discrimination of interannual variability. However, above-normal temperature extremes were substantially underforecast, as noted also for the IRI’s tercile forecasts.

Corresponding author address: Anthony Barnston, International Research Institute for Climate and Society, P.O. Box 1000, 61 Rt. 9W, Columbia University, Palisades, NY 10964-8000. E-mail: tonyb@iri.columbia.edu
Save
Cover Weather and Forecasting
Weather and Forecasting

  • Barnston, A. G., Mason S. J. , Goddard L. , DeWitt D. G. , and Zebiak S. E. , 2003: Multimodel ensembling in seasonal climate forecasting at IRI. Bull. Amer. Meteor. Soc., 84, 1783–1796.

    • Search Google Scholar
    • Export Citation

  • Barnston, A. G., Li S. , Mason S. J. , DeWitt D. G. , Goddard L. , and Gong X. , 2010: Verification of the first 11 years of IRI’s seasonal climate forecasts. J. Appl. Meteor. Climatol., 49, 493–520.

    • Search Google Scholar
    • Export Citation

  • Bengtsson, L., Schlese U. , Roeckner E. , Latif M. , Barnett T. P. , and Graham N. E. , 1993: A two-tiered approach to long-range climate forecasting. Science, 261, 1027–1029.

    • Search Google Scholar
    • Export Citation

  • Doblas-Reyes, F. J., Hagedorn R. , Palmer T. N. , and Morcrette J. J. , 2006: Impact of increasing greenhouse gas concentrations in seasonal ensemble forecasts. Geophys. Res. Lett., 33, L07708, doi:10.1029/2005GL025061.

    • Search Google Scholar
    • Export Citation

  • Goddard, L., Barnston A. G. , and Mason S. J. , 2003: Evaluation of the IRI’s “Net Assessment” seasonal climate forecasts: 1997–2001. Bull. Amer. Meteor. Soc., 84, 1761–1781.

    • Search Google Scholar
    • Export Citation

  • Gong, X., Barnston A. G. , and Ward M. N. , 2003: The effect of spatial aggregation on the skill of seasonal precipitation forecasts. J. Climate, 16, 3059–3071.

    • Search Google Scholar
    • Export Citation

  • Huang, J., Van den Dool H. M. , and Barnston A. G. , 1996: Long-lead seasonal temperature prediction using optimal climate normals. J. Climate, 9, 809–817.

    • Search Google Scholar
    • Export Citation

  • Janowiak, J. E., and Xie P. , 1999: CAMS–OPI: A global satellite–rain gauge merged product for real-time precipitation monitoring applications. J. Climate, 12, 3335–3342.

    • Search Google Scholar
    • Export Citation

  • Landman, W. A., and Goddard L. , 2002: Statistical recalibration of GCM forecasts over southern Africa using model output statistics. J. Climate, 15, 2038–2055.

    • Search Google Scholar
    • Export Citation

  • Liniger, M. A., Mathis H. , Appenzeller C. , and Doblas-Reyes F. J. , 2007: Realistic greenhouse gas forcing and seasonal forecasts. Geophys. Res. Lett., 34, L04705, doi:10.1029/2006GL028335.

    • Search Google Scholar
    • Export Citation

  • Livezey, R. E., and Timofeyeva M. M. , 2008: The first decade of long-lead U.S. seasonal forecasts—Insights from a skill analysis. Bull. Amer. Meteor. Soc., 89, 843–854.

    • Search Google Scholar
    • Export Citation

  • Mason, I., 1982: A model for assessment of weather forecasts. Aust. Meteor. Mag., 30, 291–303.

  • Mason, S. J., 2008: Understanding forecast verification statistics. Meteor. Appl., 15, 31–40.

  • Mason, S. J., and Weigel A. P. , 2009: A generic forecast verification framework for administrative purposes. Mon. Wea. Rev., 137, 331–349.

    • Search Google Scholar
    • Export Citation

  • Mason, S. J., Goddard L. , Graham N. E. , Yulaeva E. , Sun L. , and Arkin P. A. , 1999: The IRI seasonal climate prediction system and the 1997/98 El Niño event. Bull. Amer. Meteor. Soc., 80, 1853–1873.

    • Search Google Scholar
    • Export Citation

  • Mitchell, T. D., and Jones P. D. , 2005: An improved method of constructing a database of monthly climate observations and associated high-resolution grids. Int. J. Climatol., 25, 693–712.

    • Search Google Scholar
    • Export Citation

  • Murphy, A. H., 1973: A new vector partition of the probability score. J. Appl. Meteor., 12, 595–600.

  • Ndiaye, O., Goddard L. , and Ward M. N. , 2009: Using regional wind fields to improve general circulation model forecasts of July–September Sahel rainfall. Int. J. Climatol., 29, 1262–1275, doi:10.1002/joc.1767.

    • Search Google Scholar
    • Export Citation

  • New, M., Hulme M. , and Jones P. D. , 2000: Representing twentieth-century space–time climate variability. Part II: Development of a 1901–96 monthly grid of terrestrial surface climate. J. Climate, 13, 2217–2238.

    • Search Google Scholar
    • Export Citation

  • O’Lenic, E. A., Unger D. A. , Halpert M. S. , and Pelman K. S. , 2008: Developments in operational long-range climate prediction at CPC. Wea. Forecasting, 23, 496–515.

    • Search Google Scholar
    • Export Citation

  • Rajagopalan, B., Lall U. , and Zebiak S. E. , 2002: Categorical climate forecasts through regularization and optimal combination of multiple GCM ensembles. Mon. Wea. Rev., 130, 1792–1811.

    • Search Google Scholar
    • Export Citation

  • Robertson, A. W., Lall U. , Zebiak S. E. , and Goddard L. , 2004: Improved combination of multiple atmospheric GCM ensembles for seasonal prediction. Mon. Wea. Rev., 132, 2732–2744.

    • Search Google Scholar
    • Export Citation

  • Ropelewski, C. F., Janowiak J. E. , and Halpert M. S. , 1985: The analysis and display of real-time surface climate data. Mon. Wea. Rev., 113, 1101–1106.

    • Search Google Scholar
    • Export Citation

  • Tippett, M. K., Barlow M. , and Lyon B. , 2003: Statistical correction of central southwest Asia winter precipitation simulations. Int. J. Climatol., 23, 1421–1433.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2000: Diagnostic verification of the Climate Prediction Center long-lead outlooks, 1995–98. J. Climate, 13, 2389–2403.

    • Search Google Scholar
    • Export Citation

  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 648 pp.

  • Wilks, D. S., and Godfrey C. M. , 2002: Diagnostic verification of the IRI Net Assessment forecasts, 1997–2000. J. Climate, 15, 1369–1377.

    • Search Google Scholar
    • Export Citation

  • Xie, P. P., and Arkin P. A. , 1997: Global precipitation: A 17-year monthly analysis based on gauge observations, satellite estimations, and numerical model outputs. Bull. Amer. Meteor. Soc., 78, 2539–2558.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1543 1060 33
PDF Downloads 310 87 3