An Assessment of the CFS Real-Time Seasonal Forecasts

Wanqiu Wang Climate Prediction Center, National Centers for Environmental Prediction, Camp Spring, Maryland

Search for other papers by Wanqiu Wang in
Current site
Google Scholar
PubMed
Close
,
Mingyue Chen Climate Prediction Center, National Centers for Environmental Prediction, Camp Spring, Maryland

Search for other papers by Mingyue Chen in
Current site
Google Scholar
PubMed
Close
, and
Arun Kumar Climate Prediction Center, National Centers for Environmental Prediction, Camp Spring, Maryland

Search for other papers by Arun Kumar in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

This study assesses the real-time seasonal forecasts for 2005–08 with the current National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS). The forecasts are compared with retrospective forecasts (or hindcasts) for 1981–2004 to examine the consistency of the forecast system, and with the Atmospheric Model Intercomparison Project (AMIP) simulations forced with observed sea surface temperatures (SSTs) to contrast the realized skill against the potential predictability due to the specification of the observed sea surface temperatures. The analysis focuses on the forecasts of SSTs, 2-m surface air temperature (T2M), and precipitation.

The CFS forecasts maintained a good level of prediction skill for SSTs in the tropical Pacific, the western Indian Ocean, and the northern Atlantic. The SST forecast skill is within the range of hindcast skill levels calculated with 4-yr windows, which can vary greatly associated with the interannual El Niño–Southern Oscillation (ENSO) variability. Overall, the SST forecast skill over the globe is comparable to the average of the hindcast skill. For the tropical eastern Pacific, however, the forecast skill at lead times longer than 2 months is less than the average hindcast skill due to the relatively weaker ENSO variability during the forecast period (2005–08). The forecasts and hindcasts show a similar level of precipitation skill over most of the globe. For T2M, the spatial distribution of skill differs substantially between the forecasts and hindcasts. In particular, the T2M skill of the forecasts for the Northern Hemisphere during its warm seasons is lower than that of the hindcasts.

Comparison with the AMIP simulations shows similar levels of precipitation skill over the tropical Pacific. Over the tropical Indian Ocean, the CFS forecasts show a substantially higher level of skill than the AMIP simulations for a large part of the period. This conforms with the results from previous studies that while interannual variability in the tropical Pacific atmosphere is slaved to the underlying SST anomalies, specification of SSTs (as for the AMIP simulations) in the Indian Ocean may lead to incorrect simulation of the atmospheric variability. Over the tropical Atlantic, the precipitation skill of both the CFS forecasts and AMIP simulations is low, suggesting that SSTs have less control over the atmospheric anomalies and the predictability is low.

The analysis reveals several deficiencies in the current CFS that need to be corrected for improved seasonal forecasting. For example, the CFS tends to consistently forecast larger ENSO amplitude and delayed transition between the ENSO phases. Forecasts of T2M also have a strong cold bias in Northern Hemisphere mid- to high latitudes during warm seasons. This error is due to initial soil moisture anomalies, which appear to be too wet compared with two other observational analyses. The strong impacts of soil moisture on the seasonal forecasts, and large discrepancies among the soil moisture analyses, call for more accurate specification of soil moisture. Furthermore, average forecast SST and T2M anomalies for 2005–08 show a cold bias over the entire globe, indicating that the model is unable to maintain the observed long-term warming trend.

Corresponding author address: Wanqiu Wang, NCEP/CPC, Rm. 605, 5200 Auth Rd., Camp Springs, MD 20746. Email: wanqiu.wang@noaa.gov

Abstract

This study assesses the real-time seasonal forecasts for 2005–08 with the current National Centers for Environmental Prediction (NCEP) Climate Forecast System (CFS). The forecasts are compared with retrospective forecasts (or hindcasts) for 1981–2004 to examine the consistency of the forecast system, and with the Atmospheric Model Intercomparison Project (AMIP) simulations forced with observed sea surface temperatures (SSTs) to contrast the realized skill against the potential predictability due to the specification of the observed sea surface temperatures. The analysis focuses on the forecasts of SSTs, 2-m surface air temperature (T2M), and precipitation.

The CFS forecasts maintained a good level of prediction skill for SSTs in the tropical Pacific, the western Indian Ocean, and the northern Atlantic. The SST forecast skill is within the range of hindcast skill levels calculated with 4-yr windows, which can vary greatly associated with the interannual El Niño–Southern Oscillation (ENSO) variability. Overall, the SST forecast skill over the globe is comparable to the average of the hindcast skill. For the tropical eastern Pacific, however, the forecast skill at lead times longer than 2 months is less than the average hindcast skill due to the relatively weaker ENSO variability during the forecast period (2005–08). The forecasts and hindcasts show a similar level of precipitation skill over most of the globe. For T2M, the spatial distribution of skill differs substantially between the forecasts and hindcasts. In particular, the T2M skill of the forecasts for the Northern Hemisphere during its warm seasons is lower than that of the hindcasts.

Comparison with the AMIP simulations shows similar levels of precipitation skill over the tropical Pacific. Over the tropical Indian Ocean, the CFS forecasts show a substantially higher level of skill than the AMIP simulations for a large part of the period. This conforms with the results from previous studies that while interannual variability in the tropical Pacific atmosphere is slaved to the underlying SST anomalies, specification of SSTs (as for the AMIP simulations) in the Indian Ocean may lead to incorrect simulation of the atmospheric variability. Over the tropical Atlantic, the precipitation skill of both the CFS forecasts and AMIP simulations is low, suggesting that SSTs have less control over the atmospheric anomalies and the predictability is low.

The analysis reveals several deficiencies in the current CFS that need to be corrected for improved seasonal forecasting. For example, the CFS tends to consistently forecast larger ENSO amplitude and delayed transition between the ENSO phases. Forecasts of T2M also have a strong cold bias in Northern Hemisphere mid- to high latitudes during warm seasons. This error is due to initial soil moisture anomalies, which appear to be too wet compared with two other observational analyses. The strong impacts of soil moisture on the seasonal forecasts, and large discrepancies among the soil moisture analyses, call for more accurate specification of soil moisture. Furthermore, average forecast SST and T2M anomalies for 2005–08 show a cold bias over the entire globe, indicating that the model is unable to maintain the observed long-term warming trend.

Corresponding author address: Wanqiu Wang, NCEP/CPC, Rm. 605, 5200 Auth Rd., Camp Springs, MD 20746. Email: wanqiu.wang@noaa.gov

Save
  • Anderson, D., and Coauthors, 2003: Comparison of the ECMWF seasonal forecast systems 1 and 2, including the relative performance for the 1997/8 El Niño. ECMWF Tech. Memo. 404, Reading, United Kingdom, 93 pp.

    • Search Google Scholar
    • Export Citation
  • Anderson, D., and Coauthors, 2007: Development of the ECMWF seasonal forecast System 3. Tech. ECMWF Memo. 503, Reading, United Kingdom, 56 pp.

    • Search Google Scholar
    • Export Citation
  • Balmaseda, M., and Anderson D. , 2009: Impact of initialization strategies and observations on seasonal forecast skill. Geophys. Res. Lett., 36 , L01701. doi:10.1029/2008GL035561.

    • Search Google Scholar
    • Export Citation
  • Barnston, A. G., Chelliah M. , and Goldenberg S. B. , 1997: Documentation of a highly ENSO-related SST region in the equatorial Pacific. Atmos.–Ocean, 35 , 367383.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Barnston, A. G., Mason S. J. , Goddard L. , Dewitt D. G. , and Zebiak S. E. , 2003: Multimodel ensembling in seasonal climate forecasting at IRI. Bull. Amer. Meteor. Soc., 84 , 17831796.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cai, M., Shin C. , van den Dool H. M. , Wang W. , Saha S. , and Kumar A. , 2009: The role of long-term trends in seasonal predictions: Implication of global warming in the NCEP CFS. Wea. Forecasting, 24 , 965973.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Doblas-Reyes, F. J., Hagedorn R. , and Palmer T. N. , 2005: The rationale behind the success of multi-model ensembles in seasonal forecasting—II: Calibration and combination. Tellus, 57A , 234252.

    • Search Google Scholar
    • Export Citation
  • Fan, Y., and van den Dool H. , 2004: Climate Prediction Center global monthly soil moisture data set at 0.5° resolution for 1948 to present. J. Geophys. Res., 109 , D10102. doi:10.1029/2003JD004345.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Folland, C. K., Colman A. W. , Rowell D. P. , and Davey M. K. , 2001: Predictability of Northeast Brazil rainfall and real-time forecast skill, 1987–98. J. Climate, 14 , 19371958.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Goldenberg, S. B., Landsea C. W. , Mestas-Nuñez A. M. , and Gray W. M. , 2001: The recent increase in Atlantic hurricane activity: Cause and implications. Science, 293 , 474479.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Graham, R. J., Gordon M. , McLean P. J. , Ineson S. , Huddleston M. R. , Davey M. K. , Brookshaw A. , and Barnes R. T. H. , 2005: A performance comparison of coupled and uncoupled versions of the Met Office seasonal prediction general circulation model. Tellus, 57A , 320339.

    • Search Google Scholar
    • Export Citation
  • Graham, R. J., and Coauthors, 2006: The 2005-06 winter in Europe and the United Kingdom: Part 1—How the Met Office forecast was produced and communicated. Weather, 61 , 327336. doi:10.1256/wea.181.06.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Grimm, A. M., Sahai A. K. , and Ropelewski C. F. , 2006: Interdecadal variations in AGCM simulation skills. J. Climate, 19 , 34063419.

  • Gueremy, J-F., Deque M. , Brau A. , and Piedelievre J-P. , 2005: Actual and potential skill of seasonal predictions using the CNRM contribution to DEMETER: Coupled versus uncoupled model. Tellus, 57A , 308319.

    • Search Google Scholar
    • Export Citation
  • Halpert, M. S., and Ropelewski C. F. , 1992: Surface temperature patterns associated with the Southern Oscillation. J. Climate, 5 , 577593.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Huang, J., van den Dool H. M. , and Georgakakos K. P. , 1996: Analysis of model-calculated soil moisture over the United States (1931–1993) and applications to long-range temperature forecasts. J. Climate, 9 , 13501362.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Janowiak, J. E., and Xie P. , 1999: CAMS–OPI: A global satellite–rain gauge merged product for real-time precipitation monitoring applications. J. Climate, 12 , 33353342.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ji, M., Kumar A. , and Leetmaa A. , 1994: A multiseason climate forecast system at the National Meteorological Center. Bull. Amer. Meteor. Soc., 75 , 569578.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kanamitsu, M., Ebisuzaki W. , Woollen J. , Yang S-K. , Hnilo J. J. , Fiorino M. , and Potter G. L. , 2002: NCEP–DOE AMIP-II Reanalysis (R-2). Bull. Amer. Meteor. Soc., 83 , 16311643.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Krishna Kumar, K., Hoerling M. P. , and Rajagopalan B. , 2005: Advancing dynamical prediction of Indian monsoon rainfall. Geophys. Res. Lett., 32 , L08704. doi:10.1029/2004GL021979.

    • Search Google Scholar
    • Export Citation
  • Kumar, A., 2009: Finite samples and uncertainty estimates for skill measures for seasonal predictions. Mon. Wea. Rev., 137 , 26222631.

  • Kumar, A., and Hoerling M. P. , 1998: Annual cycle of Pacific–North American seasonal predictability associated with different phases of ENSO. J. Climate, 11 , 32953308.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kumar, A., and Hoerling M. P. , 2000: Analysis of a conceptual model of seasonal climate variability and implications for seasonal prediction. Bull. Amer. Meteor. Soc., 81 , 255264.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kumar, A., Barnston A. G. , and Hoerling M. P. , 2001: Seasonal predictions, probabilistic verifications, and ensemble size. J. Climate, 14 , 16711676.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liu, Y., 2003: Prediction of monthly-seasonal precipitation using coupled SVD patterns between soil moisture and subsequent precipitation. Geophys. Res. Lett., 30 , 1827. doi:10.1029/2003GL017709.

    • Search Google Scholar
    • Export Citation
  • Luo, J-J., Behera S. , Masumoto Y. , Sakuma H. , and Yamagata T. , 2008: Successful prediction of the consecutive IOD in 2006 and 2007. Geophys. Res. Lett., 35 , L14S02. doi:10.1029/2007GL032793.

    • Search Google Scholar
    • Export Citation
  • Mathieu, P-P., Sutton R. T. , Dong B. , and Collins M. , 2004: Predictability of winter climate over the North Atlantic European region during. J. Climate, 17 , 19531974.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mesinger, F., and Coauthors, 2006: North American Regional Reanalysis. Bull. Amer. Meteor. Soc., 87 , 343360.

  • Nakaegawa, T., Kanamitsu M. , and Smith T. M. , 2004: Interdecadal trend of prediction skill in an ensemble AMIP-type experiment. J. Climate, 17 , 28812889.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • O’Lenic, E. A., Unger D. A. , Halpert M. S. , and Pelman K. S. , 2008: Developments in operational long-range climate prediction at CPC. Wea. Forecasting, 23 , 496515.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pacanowski, R. C., and Griffies S. M. , 1998: MOM 3.0 manual. NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, 668 pp.

  • Peng, P., Kumar A. , van den Dool H. , and Barnston A. G. , 2002: An analysis of multimodel ensemble predictions for seasonal climate anomalies. J. Geophys. Res., 107 , 4710. doi:10.1029/2002JD002712.

    • Search Google Scholar
    • Export Citation
  • Reynolds, W. R., Rayner N. A. , Smoth T. M. , Stokes D. C. , and Wang W. , 2002: An improved in situ and satellite SST analysis for climate. J. Climate, 15 , 16091625.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ropelewski, C. F., and Halpert M. S. , 1987: Global and regional scale precipitation patterns associated with the El Niño/Southern Oscillation (ENSO). Mon. Wea. Rev., 115 , 16061626.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ropelewski, C. F., Janowiak J. E. , and Halpert M. S. , 1985: The analysis and display of real time surface climate data. Mon. Wea. Rev., 113 , 11011106.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rowell, D. P., 1998: Assessing potential seasonal predictability with an ensemble of multidecadal GCM simulations. J. Climate, 11 , 109120.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Saha, S., and Coauthors, 2006: The NCEP Climate Forecast System. J. Climate, 19 , 34833517.

  • Saji, N. H., and Yamagata T. , 2003: Possible impacts of Indian Ocean dipole mode events on global climate. Climate Res., 25 , 151169.

  • Saunders, M. A., and Lea A. S. , 2008: Large contribution of sea surface warming to recent increase in Atlantic hurricane activity. Nature, 451 , 557560.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schubert, S. D., Suarez M. J. , Pegion P. J. , Koster R. D. , and Bacmeister J. T. , 2008: Potential predictability of long-term drought and pluvial conditions in the U.S. Great Plains. J. Climate, 21 , 802816.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stockdale, T. N., 1997: Coupled ocean–atmosphere forecasts in the presence of climate drift. Mon. Wea. Rev., 125 , 809818.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Syu, H-H., and Neelin D. , 2000: ENSO in a hybrid coupled model. Part II: Prediction with piggyback data assimilation. Climate Dyn., 16 , 3548.

  • Tang, Y., Deng Z. , Zhou X. , Cheng Y. , and Chen D. , 2008: Interdecadal variation of ENSO predictability in multiple models. J. Climate, 21 , 48114833.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van den Dool, H., and Rukhovets L. , 1991: Why do forecasts for “near normal” often fail? Wea. Forecasting, 6 , 7685.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van den Dool, H., and Toth Z. , 1994: On the weights for an ensemble-averaged 6–10-day forecast. Wea. Forecasting, 9 , 457465.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van Oldenborgh, G. J., Balmaseda M. A. , Ferranti L. , Stockdale T. N. , and Anderson D. L. T. , 2003: Did the ECMWF seasonal forecast model outperform a statistical model over the last 15 years? ECMWF Tech. Memo. 418, 32 pp.

    • Search Google Scholar
    • Export Citation
  • Wang, B., Ding Q. , Fu X. , Kang I-S. , Jin K. , Shukla J. , and Doblas-Reyes F. , 2005: Fundamental challenge in simulation and prediction of summer monsoon rainfall. Geophys. Res. Lett., 32 , L15711. doi:10.1029/2005GL022734.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wang, G., Kleeman R. , Smith N. , and Tseitkin F. , 2002: The BMRC coupled general circulation model ENSO forecast system. Mon. Wea. Rev., 130 , 975991.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wu, R., and Kirtman B. P. , 2005: Roles of Indian and Pacific Ocean air–sea coupling in tropical atmospheric variability. Climate Dyn., 25 , 155170.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1710 833 350
PDF Downloads 650 106 6