Editorial Type:
Article
Article Type:
Research Article

Is There a Relationship between Potential and Actual Skill?

Arun Kumar NOAA/Climate Prediction Center, College Park, Maryland

Search for other papers by Arun Kumar in
Current site
Google Scholar
PubMed Close
,
Peitao Peng NOAA/Climate Prediction Center, College Park, Maryland

Search for other papers by Peitao Peng in
Current site
Google Scholar
PubMed Close
, and
Mingyue Chen NOAA/Climate Prediction Center, College Park, Maryland

Search for other papers by Mingyue Chen in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jun 2014
DOI:
https://doi.org/10.1175/MWR-D-13-00287.1
Page(s):
2220–2227
Restricted access

Abstract

In this paper, possible connections between actual and potential skill are discussed. Actual skill refers to when the prediction time series is validated against the observations as the verification while perfect skill refers to when the observed verification time series is replaced by one of the members from the ensemble of predictions. It is argued that (i) there need not be a relationship between potential and actual skill; (ii) potential skill is not constrained to be always greater than actual skill, and examples to the contrary can be found; and (iii) there are methods whereby statistical characteristics of predicted anomalies can be compared with the corresponding in the observations, and inferences about the validity of the (positive) gap between potential and actual skill as “room for improvement” can be better substantiated.

Corresponding author address: Dr. Arun Kumar, NOAA/Climate Prediction Center, 5830 University Research Court, College Park, MD 20740. E-mail: arun.kumar@noaa.gov

Abstract

In this paper, possible connections between actual and potential skill are discussed. Actual skill refers to when the prediction time series is validated against the observations as the verification while perfect skill refers to when the observed verification time series is replaced by one of the members from the ensemble of predictions. It is argued that (i) there need not be a relationship between potential and actual skill; (ii) potential skill is not constrained to be always greater than actual skill, and examples to the contrary can be found; and (iii) there are methods whereby statistical characteristics of predicted anomalies can be compared with the corresponding in the observations, and inferences about the validity of the (positive) gap between potential and actual skill as “room for improvement” can be better substantiated.

Corresponding author address: Dr. Arun Kumar, NOAA/Climate Prediction Center, 5830 University Research Court, College Park, MD 20740. E-mail: arun.kumar@noaa.gov
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Becker, E. J., H. M. van den Dool, and M. Pena, 2013: Short-term climate extremes: Prediction skill and predictability. J. Climate, 26, 512–531, doi:10.1175/JCLI-D-12-00177.1.

    • Search Google Scholar
    • Export Citation

  • Boer, G. J., V. V. Kharin, and W. J. Merryfield, 2013: Decadal predictability and forecast skill. Climate Dyn., 41, 1817–1833, doi:10.1007/s00382-013-1705-0.

    • Search Google Scholar
    • Export Citation

  • DelSole, T., A. Kumar, and B. Jha, 2013: Potential seasonal predictability: Comparison between empirical and dynamical model estimates. Geophys. Res. Lett., 40, 3200–3206, doi:10.1002/grl.50581.

    • Search Google Scholar
    • Export Citation

  • Eckel, F. A., and C. F. Mass, 2005: Aspects of effective mesoscale, short-range ensemble forecasting. Wea. Forecasting, 20, 328–350, doi:10.1175/WAF843.1.

    • Search Google Scholar
    • Export Citation

  • Holland, M. M., E. Blanchard-Wrigglesworth, J. Kay, and S. Vavrus, 2013: Initial-value predictability of Antarctic sea ice in the Community Climate System Model 3. Geophys. Res. Lett., 40, 2121–2124, doi:10.1002/grl.50410.

    • Search Google Scholar
    • Export Citation

  • Kirtman, B. P., and Coauthors, 2014: The North American Multimodel Ensemble: Phase-1 seasonal-to-interannual prediction; phase-2 toward developing intraseasonal prediction. Bull. Amer. Meteor. Soc., doi:10.1175/BAMS-D-12-00050.1, in press.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., and M. P. Hoerling, 1995: Prospects and limitations of seasonal atmospheric GCM predictions. Bull. Amer. Meteor. Soc., 76, 335–345, doi:10.1175/1520-0477(1995)076<0335:PALOSA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Kumar, A., and M. P. Hoerling, 2000: Analysis of a conceptual model of seasonal climate variability and implications for seasonal predictions. Bull. Amer. Meteor. Soc., 81, 255–264, doi:10.1175/1520-0477(2000)081<0255:AOACMO>2.3.CO;2.

    • Search Google Scholar
    • Export Citation

  • Mehta, V. M., M. J. Suarez, J. V. Manganello, and T. L. Delworth, 2000: Oceanic influence on the North Atlantic Oscillation and associated Northern Hemisphere climate variations: 1959–1993. Geophys. Res. Lett., 27, 121–124, doi:10.1029/1999GL002381.

    • Search Google Scholar
    • Export Citation

  • Peng, P., A. Kumar, and W. Wang, 2011: An analysis of seasonal predictability in coupled model forecasts. Climate Dyn., 36, 637–648, doi:10.1007/s00382-009-0711-8.

    • Search Google Scholar
    • Export Citation

  • Peng, P., A. Kumar, M. S. Halpert, and A. Barnston, 2012: An analysis of CPC’s operational 0.5-month lead seasonal outlooks. Wea. Forecasting, 27, 898–917, doi:10.1175/WAF-D-11-00143.1.

    • Search Google Scholar
    • Export Citation

  • Smith, T. M., R. W. Reynolds, T. C. Peterson, and J. Lawrimore, 2008: Improvements to NOAA’s historical merged land–ocean surface temperature analysis (1880–2006). J. Climate, 21, 2283–2296, doi:10.1175/2007JCLI2100.1.

    • Search Google Scholar
    • Export Citation

  • Waliser, D. E., K. M. Lau, W. Stern, and C. Jones, 2003: Potential predictability of the Madden–Julian Oscillation. Bull. Amer. Meteor. Soc., 84, 33–50, doi:10.1175/BAMS-84-1-33.

    • Search Google Scholar
    • Export Citation

  • Wang, W., M. Chen, and A. Kumar, 2013: Seasonal prediction of arctic sea ice external from a coupled dynamical forecast system. Mon. Wea. Rev., 141, 1375–1394, doi:10.1175/MWR-D-12-00057.1.

    • Search Google Scholar
    • Export Citation

  • Younas, W., and Y. Tang, 2013: PNA predictability at various time scales. J. Climate, 26, 9090–9114, doi:10.1175/JCLI-D-12-00609.1.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 639 225 20
PDF Downloads 553 171 13