On the Correspondence between Mean Forecast Errors and Climate Errors in CMIP5 Models

H.-Y. Ma * Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Livermore, California

Search for other papers by H.-Y. Ma in
Current site
Google Scholar
PubMed
Close
,
S. Xie * Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Livermore, California

Search for other papers by S. Xie in
Current site
Google Scholar
PubMed
Close
,
S. A. Klein * Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Livermore, California

Search for other papers by S. A. Klein in
Current site
Google Scholar
PubMed
Close
,
K. D. Williams Met Office, Exeter, United Kingdom

Search for other papers by K. D. Williams in
Current site
Google Scholar
PubMed
Close
,
J. S. Boyle * Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Livermore, California

Search for other papers by J. S. Boyle in
Current site
Google Scholar
PubMed
Close
,
S. Bony L’Institut Pierre-Simon Laplace, Paris, France

Search for other papers by S. Bony in
Current site
Google Scholar
PubMed
Close
,
H. Douville Météo-France/CNRM, CNRS/GAME, Toulouse, France

Search for other papers by H. Douville in
Current site
Google Scholar
PubMed
Close
,
S. Fermepin L’Institut Pierre-Simon Laplace, Paris, France

Search for other papers by S. Fermepin in
Current site
Google Scholar
PubMed
Close
,
B. Medeiros National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by B. Medeiros in
Current site
Google Scholar
PubMed
Close
,
S. Tyteca Météo-France/CNRM, CNRS/GAME, Toulouse, France

Search for other papers by S. Tyteca in
Current site
Google Scholar
PubMed
Close
,
M. Watanabe ** Atmosphere and Ocean Research Institute, University of Tokyo, Tokyo, Japan

Search for other papers by M. Watanabe in
Current site
Google Scholar
PubMed
Close
, and
D. Williamson National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by D. Williamson in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The present study examines the correspondence between short- and long-term systematic errors in five atmospheric models by comparing the 16 five-day hindcast ensembles from the Transpose Atmospheric Model Intercomparison Project II (Transpose-AMIP II) for July–August 2009 (short term) to the climate simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5) and AMIP for the June–August mean conditions of the years of 1979–2008 (long term). Because the short-term hindcasts were conducted with identical climate models used in the CMIP5/AMIP simulations, one can diagnose over what time scale systematic errors in these climate simulations develop, thus yielding insights into their origin through a seamless modeling approach.

The analysis suggests that most systematic errors of precipitation, clouds, and radiation processes in the long-term climate runs are present by day 5 in ensemble average hindcasts in all models. Errors typically saturate after few days of hindcasts with amplitudes comparable to the climate errors, and the impacts of initial conditions on the simulated ensemble mean errors are relatively small. This robust bias correspondence suggests that these systematic errors across different models likely are initiated by model parameterizations since the atmospheric large-scale states remain close to observations in the first 2–3 days. However, biases associated with model physics can have impacts on the large-scale states by day 5, such as zonal winds, 2-m temperature, and sea level pressure, and the analysis further indicates a good correspondence between short- and long-term biases for these large-scale states. Therefore, improving individual model parameterizations in the hindcast mode could lead to the improvement of most climate models in simulating their climate mean state and potentially their future projections.

The National Center for Atmospheric Research is sponsored by the National Science Foundation.

Corresponding author address: Hsi-Yen Ma, Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Mail Code, L-103, 7000 East Avenue, Livermore, CA 94551-0808. E-mail: ma21@llnl.gov

Abstract

The present study examines the correspondence between short- and long-term systematic errors in five atmospheric models by comparing the 16 five-day hindcast ensembles from the Transpose Atmospheric Model Intercomparison Project II (Transpose-AMIP II) for July–August 2009 (short term) to the climate simulations from phase 5 of the Coupled Model Intercomparison Project (CMIP5) and AMIP for the June–August mean conditions of the years of 1979–2008 (long term). Because the short-term hindcasts were conducted with identical climate models used in the CMIP5/AMIP simulations, one can diagnose over what time scale systematic errors in these climate simulations develop, thus yielding insights into their origin through a seamless modeling approach.

The analysis suggests that most systematic errors of precipitation, clouds, and radiation processes in the long-term climate runs are present by day 5 in ensemble average hindcasts in all models. Errors typically saturate after few days of hindcasts with amplitudes comparable to the climate errors, and the impacts of initial conditions on the simulated ensemble mean errors are relatively small. This robust bias correspondence suggests that these systematic errors across different models likely are initiated by model parameterizations since the atmospheric large-scale states remain close to observations in the first 2–3 days. However, biases associated with model physics can have impacts on the large-scale states by day 5, such as zonal winds, 2-m temperature, and sea level pressure, and the analysis further indicates a good correspondence between short- and long-term biases for these large-scale states. Therefore, improving individual model parameterizations in the hindcast mode could lead to the improvement of most climate models in simulating their climate mean state and potentially their future projections.

The National Center for Atmospheric Research is sponsored by the National Science Foundation.

Corresponding author address: Hsi-Yen Ma, Program for Climate Model Diagnosis and Intercomparison, Lawrence Livermore National Laboratory, Mail Code, L-103, 7000 East Avenue, Livermore, CA 94551-0808. E-mail: ma21@llnl.gov
Save
  • Barton, N. P., S. A. Klein, J. S. Boyle, and Y. Y. Zhang, 2012: Arctic synoptic regimes: Comparing domain-wide Arctic cloud observations with CAM4 and CAM5 during similar dynamics. J. Geophys. Res., 117, D15205, doi:10.1029/2012JD017589.

    • Search Google Scholar
    • Export Citation
  • Bodas-Salcedo, A., and Coauthors, 2011: COSP: Satellite simulation software for model assessment. Bull. Amer. Meteor. Soc., 92, 10231043.

    • Search Google Scholar
    • Export Citation
  • Boyle, J., and Coauthors, 2005: Diagnosis of Community Atmospheric Model 2 (CAM2) in numerical weather forecast configuration at Atmospheric Radiation Measurement sites. J. Geophys. Res., 110, D15S15, doi:10.1029/2004JD005042.

    • Search Google Scholar
    • Export Citation
  • Boyle, J., S. A. Klein, G. Zhang, S. Xie, and X. Wei, 2008: Climate model forecast experiment for TOGA COARE. Mon. Wea. Rev., 136, 808832.

    • Search Google Scholar
    • Export Citation
  • Brown, A., S. Milton, M. Cullen, B. Golding, J. Mitchell, and A. Shelly, 2012: Unified modeling and prediction of weather and climate. Bull. Amer. Meteor. Soc., 93, 18651877.

    • Search Google Scholar
    • Export Citation
  • Dee, D. P., and Coauthors, 2011: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Quart. J. Roy. Meteor. Soc., 137, 553597.

    • Search Google Scholar
    • Export Citation
  • Doelling, D. R., and Coauthors, 2013: Geostationary enhanced temporal interpolation for CERES flux products. J. Atmos. Oceanic Technol., 30, 10721090.

    • Search Google Scholar
    • Export Citation
  • Dufresne, J.-L., and Coauthors, 2013: Climate change projections using the IPSL-CM5 Earth System Model: From CMIP3 to CMIP5. Climate Dyn., 40, 21232165, doi:10.1007/s00382-012-1636-1.

    • Search Google Scholar
    • Export Citation
  • Hannay, C., D. L. Williamson, J. J. Hack, J. T. Kiehl, S. A. Klein, C. S. Bretherton, and M. Kohler, 2009: Evaluation of forecasted southeast Pacific stratocumulus in the NCAR, GFDL, and ECMWF models. J. Climate, 22, 28712889.

    • Search Google Scholar
    • Export Citation
  • Huffman, G. J., and Coauthors, 2007: The TRMM Multisatellite Precipitation Analysis: Quasi-global, multi-year, combined-sensor precipitation estimates at fine scale. J. Hydrometeor., 8, 3855.

    • Search Google Scholar
    • Export Citation
  • Hurrell, J., G. A. Meehl, D. Bader, T. L. Delworth, B. Kirtman, and B. Wielicki, 2009: A unified modeling approach to climate system prediction. Bull. Amer. Meteor. Soc., 99, 18191832.

    • Search Google Scholar
    • Export Citation
  • Jiang, J. H., and Coauthors, 2012: Evaluation of cloud and water vapor simulations in CMIP5 climate models using NASA “A-Train” satellite observations. J. Geophys. Res.,117, D1410, doi:10.1029/2011JD017237.

  • Kamae, Y., and M. Watanabe, 2012: Tropospheric adjustment to increasing CO2: Its timescale and the role of land-sea contrast. Climate Dyn., 41, 3007–3024, doi:10.1007/s00382-012-1555-1.

    • Search Google Scholar
    • Export Citation
  • Kay, J. E., and Coauthors, 2012: Exposing global cloud biases in the Community Atmosphere Model (CAM) using satellite observations and their corresponding instrument simulators. J. Climate, 25, 51905207.

    • Search Google Scholar
    • Export Citation
  • Klein, S. A., X. Jiang, J. Boyle, S. Malyshev, and S. Xie, 2006: Diagnosis of the summertime warm and dry bias over the U.S. Southern Great Plains in the GFDL climate model using a weather forecasting approach. Geophys. Res. Lett., 33, L18805, doi:10.1029/2006GL027567.

    • Search Google Scholar
    • Export Citation
  • Klein, S. A., Y. Zhang, M. D. Zelinka, R. Pincus, J. Boyle, and P. J. Gleckler, 2013: Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator. J. Geophys. Res. Atmos., 118, 1329–1342, doi:10.1002/jgrd.50141.

    • Search Google Scholar
    • Export Citation
  • Li, J.-L. F., and Coauthors, 2012: An observationally based evaluation of cloud ice water in CMIP3 and CMIP5 GCMs and contemporary reanalyses using contemporary satellite data. J. Geophys. Res., 117, D16105, doi:10.1029/2012JD017640.

    • Search Google Scholar
    • Export Citation
  • Lin, J.-L., 2007: The double-ITCZ problem in IPCC AR4 coupled GCMs: Ocean–atmosphere feedback analysis. J. Climate, 20, 44974525.

  • Lin, Y., and Coauthors, 2012: TWP-ICE global atmospheric model intercomparison: convection responsiveness and resolution impact. J. Geophys. Res., 117, D09111, doi:10.1029/2011JD017018.

    • Search Google Scholar
    • Export Citation
  • Ma, H.-Y., C. R. Mechoso, Y. Xue, H. Xiao, C.-M. Wu, J.-L. Li, and F. De Sales, 2010: Impact of land surface processes on the South American warm season climate. Climate Dyn., 37, 187203, doi:10.1007/s00382-010-0813-3.

    • Search Google Scholar
    • Export Citation
  • Ma, H.-Y., S. Xie, J. S. Boyle, S. A. Klein, and Y. Zhang, 2013: Metrics and diagnostics for precipitation-related processes in climate model short-range hindcasts. J. Climate, 26, 15161534.

    • Search Google Scholar
    • Export Citation
  • Martin, G. M., S. F. Milton, C. A. Senior, M. E. Brooks, S. Ineson, T. Reichler, and J. Kim, 2010: Analysis and reduction of systematic errors through a seamless approach to modeling weather and climate. J. Climate, 23, 59335957.

    • Search Google Scholar
    • Export Citation
  • Martin, G. M., and Coauthors, 2011: The HadGEM2 family of Met Office Unified Model climate configurations. Geosci. Model Dev., 4, 723757.

    • Search Google Scholar
    • Export Citation
  • Medeiros, B., D. L. Williamson, C. Hannay, and J. G. Olson, 2012: Southeast Pacific stratocumulus in the Community Atmosphere Model. J. Climate, 25, 61756192.

    • Search Google Scholar
    • Export Citation
  • Nam, C., S. Bony, J.-L. Dufresne, and H. Chepfer, 2012: The ‘too few, too bright’ tropical low-cloud problem in CMIP5 models. Geophys. Res. Lett., 39, L21801, doi:10.1029/2012GL053421.

    • Search Google Scholar
    • Export Citation
  • Neale, R. B., J. Richter, S. Park, P. H. Lauritzen, S. J. Vavrus, P. J. Rasch, and M. Zhang, 2013: The mean climate of the Community Atmosphere Model (CAM4) in forced SST and fully coupled experiments. J. Climate, 26, 5150–5168.

    • Search Google Scholar
    • Export Citation
  • Phillips, T. J., and Coauthors, 2004: Evaluating parameterizations in general circulation models: Climate simulation meets weather prediction. Bull. Amer. Meteor. Soc., 85, 19031915.

    • Search Google Scholar
    • Export Citation
  • Rodwell, M. J., and T. N. Palmer, 2007: Using numerical weather prediction to assess climate models. Quart. J. Roy. Meteor. Soc., 133, 129146, doi:10.1002/qj.23.

    • Search Google Scholar
    • Export Citation
  • Rossow, W. B., and R. A. Schiffer, 1999: Advances in understanding clouds from ISCCP. Bull. Amer. Meteor. Soc., 80, 22612288.

  • Taylor, K. E., 2001: Summarizing multiple aspects of model performance in a single diagram. J. Geophys. Res., 106 (D7), 71837192.

  • Taylor, K. E., R. J. Stouffer, and G. A. Meehl, 2012: An overview of CMIP5 and the experiment design. Bull. Amer. Meteor. Soc., 93, 485498.

    • Search Google Scholar
    • Export Citation
  • Voldoire, A., and Coauthors, 2013: The CNRM-CM5.1 global climate model: Description and basic evaluation. Climate Dyn., 40, 20912121.

    • Search Google Scholar
    • Export Citation
  • Waliser, D. E., and Coauthors, 2012: The “Year” of Tropical Convection (May 2008–April 2010): Climate variability and weather highlights. Bull. Amer. Meteor. Soc., 93, 11891218.

    • Search Google Scholar
    • Export Citation
  • Watanabe, M., and Coauthors, 2010: Improved climate simulation by MIROC5: Mean states, variability, and climate sensitivity. J. Climate, 23, 63126335.

    • Search Google Scholar
    • Export Citation
  • Williams, K. D., and M. E. Brooks, 2008: Initial tendencies of cloud regimes in the Met Office Unified Model. J. Climate, 21, 833840.

    • Search Google Scholar
    • Export Citation
  • Williams, K. D., and Coauthors, 2013: The Transpose-AMIP II experiments and its application to the understanding of Southern Ocean cloud biases in climate models. J. Climate, 26, 32583274.

    • Search Google Scholar
    • Export Citation
  • Williamson, D. L., 2013: The effect of time steps and time-scales on parameterization suites. Quart. J. Roy. Meteor. Soc., 139, 548560, doi:10.1002/qj.1992.

    • Search Google Scholar
    • Export Citation
  • Williamson, D. L., and Coauthors, 2005: Moisture and temperature balances at the Atmospheric Radiation Measurement Southern Great Plains site in forecasts with the Community Atmosphere Model (CAM2). J. Geophys. Res., 110, D15S16, doi:10.1029/2004JD005109.

    • Search Google Scholar
    • Export Citation
  • Wood, R., 2012: Stratocumulus clouds. Mon. Wea. Rev., 140, 23732423.

  • Xie, S., M. Zhang, J. S. Boyle, R. T. Cederwall, G. L. Potter, and W. Lin, 2004: Impact of a revised convective triggering mechanism on Community Atmosphere Model, version 2, simulations: Results from short-range weather forecasts. J. Geophys. Res., 109, D14102, doi:10.1029/2004JD004692.

    • Search Google Scholar
    • Export Citation
  • Xie, S., J. Boyle, S. Klein, X. Liu, and S. Ghan, 2008: Simulations of Arctic mixed-phase clouds in forecasts with CAM3 and AM2 for M-PACE. J. Geophys. Res., 113, D04211, doi:10.1029/2007JD009225.

    • Search Google Scholar
    • Export Citation
  • Xie, S., H.-Y. Ma, J. S. Boyle, S. A. Klein, and Y. Zhang, 2012: On the correspondence between short- and long-time-scale systematic errors in CAM4/CAM5 for the Year of Tropical Convection. J. Climate, 25, 79377955.

    • Search Google Scholar
    • Export Citation
  • Xue, Y., R. Vasic, Z. Janjic, Y. M. Liu, and P. C. Chu, 2012: The impact of spring subsurface soil temperature anomaly in the western U.S. on North American summer precipitation: A case study using regional climate model downscaling. J. Geophys. Res., 117, D11103, doi:10.1029/2012JD017692.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2287 1375 49
PDF Downloads 575 91 12