Article Type:
Research Article

On the Interpretation and Utility of Skill Information for Seasonal Climate Predictions

Arun Kumar NOAA/Climate Prediction Center, Camp Springs, Maryland

Search for other papers by Arun Kumar in
Current site
Google Scholar
PubMed Close
Print Publication:
01 May 2007
DOI:
https://doi.org/10.1175/MWR3385.1
Page(s):
1974–1984
Restricted access

Abstract

In recent years, there has been a steady increase in the emphasis on routine seasonal climate predictions and their potential for enhancing societal benefits and mitigating losses related to climate extremes. It is also suggested by the users, as well as by the producers of climate predictions, that for informed decision making, real-time seasonal climate predictions should be accompanied by a corresponding level of skill estimated from a sequence of the past history of forecasts. In this paper it is discussed whether conveying skill information to the user community can indeed deliver the promised benefits or whether issues inherent in the estimates of seasonal prediction skill may still lead to potential misinterpretation of the information content associated with seasonal predictions. Based on the analysis of atmospheric general circulation model simulations, certain well-known, but often underappreciated, issues inherent in the estimates of seasonal prediction skill from the past performance of seasonal forecasts are highlighted. These include the following: 1) the stability of estimated skill depends on the length of the time series over which seasonal forecasts are verified, leading to scenarios where error bars on the estimated skill could be of the same magnitude as the skill itself; 2) a single estimate of skill obtained from the verification over a given forecast time series, because of variation in the signal-to-noise ratio from one year to another, is generally not representative of seasonal prediction skill conditional to sea surface temperature anomalies on a case-by-case basis. These issues raise questions on the interpretation, presentation, and utilization of skill information for seasonal prediction efforts and present opportunities for increased dialogue and the exploration of ways for their optimal utilization by decision makers.

Corresponding author address: Dr. Arun Kumar, NOAA/NWS/NCEP, Climate Prediction Center, 5200 Auth Road, Rm. 800, Camp Springs, MD 20746. Email: arun.kumar@noaa.gov

Abstract

In recent years, there has been a steady increase in the emphasis on routine seasonal climate predictions and their potential for enhancing societal benefits and mitigating losses related to climate extremes. It is also suggested by the users, as well as by the producers of climate predictions, that for informed decision making, real-time seasonal climate predictions should be accompanied by a corresponding level of skill estimated from a sequence of the past history of forecasts. In this paper it is discussed whether conveying skill information to the user community can indeed deliver the promised benefits or whether issues inherent in the estimates of seasonal prediction skill may still lead to potential misinterpretation of the information content associated with seasonal predictions. Based on the analysis of atmospheric general circulation model simulations, certain well-known, but often underappreciated, issues inherent in the estimates of seasonal prediction skill from the past performance of seasonal forecasts are highlighted. These include the following: 1) the stability of estimated skill depends on the length of the time series over which seasonal forecasts are verified, leading to scenarios where error bars on the estimated skill could be of the same magnitude as the skill itself; 2) a single estimate of skill obtained from the verification over a given forecast time series, because of variation in the signal-to-noise ratio from one year to another, is generally not representative of seasonal prediction skill conditional to sea surface temperature anomalies on a case-by-case basis. These issues raise questions on the interpretation, presentation, and utilization of skill information for seasonal prediction efforts and present opportunities for increased dialogue and the exploration of ways for their optimal utilization by decision makers.

Corresponding author address: Dr. Arun Kumar, NOAA/NWS/NCEP, Climate Prediction Center, 5200 Auth Road, Rm. 800, Camp Springs, MD 20746. Email: arun.kumar@noaa.gov

Save
Cover Monthly Weather Review
Monthly Weather Review

  • Anderson, J. L., and W. F. Stern, 1996: Evaluating the potential predictability of ensemble forecasts. J. Climate, 9 , 260–269.

  • Anderson, T. W., 1984: An Introduction to Multivariate Statistical Analysis. 2d ed. Wiley, 675 pp.

  • Barnett, T. P., 1995: Monte Carlo climate forecasting. J. Climate, 8 , 1005–1022.

  • Chen, W., 2004: Significant change of extratropical natural variability associated with tropical ENSO anomaly. J. Climate, 17 , 2019–2030.

    • Search Google Scholar
    • Export Citation

  • Chervin, R. M., 1986: Interannual variability and seasonal climate variability. J. Atmos. Sci., 43 , 233–251.

  • Derome, J., and Coauthors, 2001: Seasonal predictions based on two dynamical systems. Atmos.–Ocean, 39 , 485–501.

  • Fawcett, R. J. B., D. A. Jones, and G. S. Beard, 2004: A verification of publicly-issued seasonal forecasts issued by the Australian Government Bureau of Meteorology: 1998–2003. Aust. Meteor. Mag., 54 , 1–13.

    • Search Google Scholar
    • Export Citation

  • Goddard, L., A. G. Barnston, and S. J. Mason, 2003: Evaluation of the IRI’s “net assessment” seasonal climate forecasts. Bull. Amer. Meteor. Soc., 84 , 1761–1781.

    • Search Google Scholar
    • Export Citation

  • Graham, N. E., and S. J. Mason, 2005: A method for ensemble expansion and improved definition of forecast distributions from climate simulations. Quart. J. Roy. Meteor. Soc., 131 , 939–963.

    • Search Google Scholar
    • Export Citation

  • Hartmann, H. C., T. C. Pagano, S. Sorooshian, and R. Bales, 2002: Confidence builders: Evaluating seasonal climate forecasts from user perspective. Bull. Amer. Meteor. Soc., 83 , 683–698.

    • Search Google Scholar
    • Export Citation

  • Harzallah, A., and R. Sadourny, 1995: Internal versus SST-forced variability as simulated by an atmospheric general circulation model. J. Climate, 8 , 474–495.

    • Search Google Scholar
    • Export Citation

  • Hoerling, M. P., and A. Kumar, 2002: Atmospheric response patterns associated with tropical forcing. J. Climate, 15 , 2184–2203.

  • Hunt, B. G., 2000: Multiseasonal hindcasts for 1972–92. Mon. Wea. Rev., 128 , 1474–1489.

  • Kanamitsu, M., and Coauthors, 2002a: NCEP dynamical seasonal forecast system 2000. Bull. Amer. Meteor. Soc., 83 , 1019–1037.

  • Kanamitsu, M., W. Ebisuzaki, J. Woollen, S-K. Yang, J. J. Hnilo, M. Fiorino, and G. L. Potter, 2002b: NCEP–DOE AMIP-II reanalysis (R-2). Bull. Amer. Meteor. Soc., 83 , 1631–1643.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., and M. P. Hoerling, 1995: Prospects and limitations of seasonal atmospheric GCM predictions. Bull. Amer. Meteor. Soc., 76 , 335–345.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., and M. P. Hoerling, 2000: Analysis of a conceptual model of seasonal climate variability and implications for seasonal predictions. Bull. Amer. Meteor. Soc., 81 , 255–264.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., W. Wang, M. P. Hoerling, A. Leetmaa, and M. Ji, 2001a: The sustained North American warming of 1997 and 1998. J. Climate, 14 , 345–353.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., A. G. Barnston, and M. P. Hoerling, 2001b: Seasonal predictions, probabilistic verifications, and ensemble size. J. Climate, 14 , 1671–1676.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., S. D. Schubert, and M. S. Suarez, 2003: Variability and predictability of 200-mb seasonal mean heights during summer and winter. J. Geophys. Res., 108 .4169, doi:10.1029/2002JD002728.

    • Search Google Scholar
    • Export Citation

  • Kunosaki, S., M. Sugi, A. Kitoh, C. Kobayashi, and K. Takano, 2001: Atmospheric seasonal predictability experiments by the JMA AGCM. J. Meteor. Soc. Japan, 79 , 1183–1206.

    • Search Google Scholar
    • Export Citation

  • Lau, N-C., 1985: Modeling the seasonal dependence of the atmospheric response to observed El Niños in 1962–1976. Mon. Wea. Rev., 113 , 1970–1996.

    • Search Google Scholar
    • Export Citation

  • Lau, N-C., 1997: Interactions between global SST anomalies and the midlatitude atmosphere. Bull. Amer. Meteor. Soc., 78 , 21–33.

  • Madden, R., 1976: Estimates of natural variability of time-averaged sea level pressure. Mon. Wea. Rev., 104 , 942–952.

  • Martineu, C., J-Y. Caneill, and R. Sadournay, 1999: Potential predictability of European winters from the analysis of seasonal simulations with an AGCM. J. Climate, 12 , 3033–3061.

    • Search Google Scholar
    • Export Citation

  • Nakaegawa, T., M. Kanamitsu, and T. M. Smith, 2004: Interdecadal trend of prediction skill in an ensemble AMIP-type experiment. J. Climate, 17 , 2881–2889.

    • Search Google Scholar
    • Export Citation

  • Palmer, T. N., and Coauthors, 2004: Development of a European multimodel ensemble system for seasonal-to-interannual prediction (DEMETER). Bull. Amer. Meteor. Soc., 85 , 853–872.

    • Search Google Scholar
    • Export Citation

  • Peng, P., and A. Kumar, 2005: A large ensemble analysis of the influence of tropical SSTs on seasonal atmospheric variability. J. Climate, 18 , 1068–1085.

    • Search Google Scholar
    • Export Citation

  • Peng, P., A. Kumar, A. G. Barnston, and L. Goddard, 2000: Simulation skills of the SST-forced global climate variability of the NCEP–MRF9 and the Scripps–MPI ECHAM3 models. J. Climate, 13 , 3657–3679.

    • Search Google Scholar
    • Export Citation

  • Phelps, M. W., A. Kumar, and J. J. O’Brien, 2004: Potential predictability in the NCEP/CPC dynamical seasonal forecast system. J. Climate, 17 , 3775–3785.

    • Search Google Scholar
    • Export Citation

  • Renshaw, A. C., D. P. Rowell, and C. K. Folland, 1998: Wintertime low-frequency weather variability in the North Pacific–American sector 1949–93. J. Climate, 11 , 1073–1093.

    • Search Google Scholar
    • Export Citation

  • Reynolds, R. W., and T. Smith, 1994: Improved global sea surface temperature analysis using optimum interpolation. J. Climate, 7 , 929–948.

    • Search Google Scholar
    • Export Citation

  • Rowell, D. P., 1998: Assessing potential seasonal predictability with an ensemble of multidecadal GCM simulations. J. Climate, 11 , 109–120.

    • Search Google Scholar
    • Export Citation

  • Saravanan, R., 1998: Atmospheric low-frequency variability and its relationship to midlatitude SST variability: Studies using the NCAR Climate System Model. J. Climate, 11 , 1386–1404.

    • Search Google Scholar
    • Export Citation

  • Sardeshmukh, P. D., G. P. Compo, and C. Penland, 2000: Changes of probability associated with El Niño. J. Climate, 13 , 4268–4286.

  • Shukla, J., and Coauthors, 2000: Dynamical seasonal prediction. Bull. Amer. Meteor. Soc., 81 , 2593–2606.

  • Stern, W., and K. Miyakoda, 1995: The feasibility of seasonal forecasts inferred from multiple GCM simulations. J. Climate, 8 , 1071–1085.

    • Search Google Scholar
    • Export Citation

  • Straus, D., J. Shukla, D. Paolino, S. Schubert, M. Suarez, A. Kumar, and P. Peigon, 2003: Predictability of the seasonal mean atmospheric circulation. J. Climate, 16 , 3629–3649.

    • Search Google Scholar
    • Export Citation

  • Trenberth, E. K., G. W. Branstrator, D. Karoly, A. Kumar, N-C. Lau, and C. Ropelewski, 1998: Progress during TOGA in understanding and modeling global teleconnections associated with tropical sea surface temperatures. J. Geophys. Res., 103 , C7. 14291–14324.

    • Search Google Scholar
    • Export Citation

  • Wang, X. L., and F. W. Zwiers, 1999: Interannual variability of precipitation in an ensemble of AMIP climate simulations conducted with the CCC GCM2. J. Climate, 12 , 1322–1335.

    • Search Google Scholar
    • Export Citation

  • Zheng, X., H. Nakamura, and J. A. Renwick, 2000: Potential predictability of seasonal means based on monthly time series of meteorological variables. J. Climate, 13 , 2591–2604.

    • Search Google Scholar
    • Export Citation

  • Zwiers, F. W., X. L. Wang, and J. Sheng, 2000: Effects of specifying boundary conditions in an ensemble of atmospheric GCM simulations. J. Geophys. Res., 105 , 7295–7315.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 182 67 13
PDF Downloads 116 51 19