The Art and Science of Climate Model Tuning

Frédéric Hourdin Laboratoire de Météorologie Dynamique, IPSL, CNRS, UPMC, Paris, France

Search for other papers by Frédéric Hourdin in
Current site
Google Scholar
PubMed
Close
,
Thorsten Mauritsen Max Planck Institute for Meteorology, Hamburg, Germany

Search for other papers by Thorsten Mauritsen in
Current site
Google Scholar
PubMed
Close
,
Andrew Gettelman National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Andrew Gettelman in
Current site
Google Scholar
PubMed
Close
,
Jean-Christophe Golaz National Oceanic and Atmospheric Administration/Geophysical Fluid Dynamics Laboratory, Princeton, New Jersey

Search for other papers by Jean-Christophe Golaz in
Current site
Google Scholar
PubMed
Close
,
Venkatramani Balaji Cooperative Institute for Climate Science, Princeton University, Princeton, New Jersey

Search for other papers by Venkatramani Balaji in
Current site
Google Scholar
PubMed
Close
,
Qingyun Duan Beijing Normal University, Beijing, China

Search for other papers by Qingyun Duan in
Current site
Google Scholar
PubMed
Close
,
Doris Folini Eidgenössische Technische Hochschule, Zurich, Switzerland

Search for other papers by Doris Folini in
Current site
Google Scholar
PubMed
Close
,
Duoying Ji Beijing Normal University, Beijing, China

Search for other papers by Duoying Ji in
Current site
Google Scholar
PubMed
Close
,
Daniel Klocke Deutscher Wetterdienst, Offenbach, Germany

Search for other papers by Daniel Klocke in
Current site
Google Scholar
PubMed
Close
,
Yun Qian Pacific Northwest National Laboratory, Richland, Washington

Search for other papers by Yun Qian in
Current site
Google Scholar
PubMed
Close
,
Florian Rauser Max Planck Institute for Meteorology, Hamburg, Germany

Search for other papers by Florian Rauser in
Current site
Google Scholar
PubMed
Close
,
Catherine Rio Laboratoire de Météorologie Dynamique, IPSL, CNRS, UPMC, Paris, France

Search for other papers by Catherine Rio in
Current site
Google Scholar
PubMed
Close
,
Lorenzo Tomassini Max Planck Institute for Meteorology, Hamburg, Germany

Search for other papers by Lorenzo Tomassini in
Current site
Google Scholar
PubMed
Close
,
Masahiro Watanabe University of Tokyo, Tokyo, Japan

Search for other papers by Masahiro Watanabe in
Current site
Google Scholar
PubMed
Close
, and
Daniel Williamson University of Exeter, Exeter, United Kingdom

Search for other papers by Daniel Williamson in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The process of parameter estimation targeting a chosen set of observations is an essential aspect of numerical modeling. This process is usually named tuning in the climate modeling community. In climate models, the variety and complexity of physical processes involved, and their interplay through a wide range of spatial and temporal scales, must be summarized in a series of approximate submodels. Most submodels depend on uncertain parameters. Tuning consists of adjusting the values of these parameters to bring the solution as a whole into line with aspects of the observed climate. Tuning is an essential aspect of climate modeling with its own scientific issues, which is probably not advertised enough outside the community of model developers. Optimization of climate models raises important questions about whether tuning methods a priori constrain the model results in unintended ways that would affect our confidence in climate projections. Here, we present the definition and rationale behind model tuning, review specific methodological aspects, and survey the diversity of tuning approaches used in current climate models. We also discuss the challenges and opportunities in applying so-called objective methods in climate model tuning. We discuss how tuning methodologies may affect fundamental results of climate models, such as climate sensitivity. The article concludes with a series of recommendations to make the process of climate model tuning more transparent.

Current affiliations: TomassiniMet Office, Exeter, United Kingdom; GolazLawrence Livermore National Laboratory, Livermore, California

The National Center for Atmospheric Research is supported by the National Science Foundation.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR E-MAIL: Frédéric Hourdin, frederic.hourdin@lmd.jussieu.fr

A supplement to this article is available online (10.1175/BAMS-D-15-00135.2)

Abstract

The process of parameter estimation targeting a chosen set of observations is an essential aspect of numerical modeling. This process is usually named tuning in the climate modeling community. In climate models, the variety and complexity of physical processes involved, and their interplay through a wide range of spatial and temporal scales, must be summarized in a series of approximate submodels. Most submodels depend on uncertain parameters. Tuning consists of adjusting the values of these parameters to bring the solution as a whole into line with aspects of the observed climate. Tuning is an essential aspect of climate modeling with its own scientific issues, which is probably not advertised enough outside the community of model developers. Optimization of climate models raises important questions about whether tuning methods a priori constrain the model results in unintended ways that would affect our confidence in climate projections. Here, we present the definition and rationale behind model tuning, review specific methodological aspects, and survey the diversity of tuning approaches used in current climate models. We also discuss the challenges and opportunities in applying so-called objective methods in climate model tuning. We discuss how tuning methodologies may affect fundamental results of climate models, such as climate sensitivity. The article concludes with a series of recommendations to make the process of climate model tuning more transparent.

Current affiliations: TomassiniMet Office, Exeter, United Kingdom; GolazLawrence Livermore National Laboratory, Livermore, California

The National Center for Atmospheric Research is supported by the National Science Foundation.

© 2017 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR E-MAIL: Frédéric Hourdin, frederic.hourdin@lmd.jussieu.fr

A supplement to this article is available online (10.1175/BAMS-D-15-00135.2)

Supplementary Materials

    • Supplemental Materials (PDF 227 KB)
Save
  • Arakawa, R. A., and W. H. Schubert, 1974: Interaction of a cumulus cloud ensemble with the large-scale environment. Part I. J. Atmos. Sci., 31, 674701, doi10.1175/1520-0469(1974)031<0674:IOACCE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ayotte, K. W., and Coauthors, 1996: An evaluation of neutral and convective planetary boundary-layer parameterizations relative to large eddy simulations. Bound.-Layer Meteor., 79, 131175, doi10.1007/BF00120078.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Balaji, V., R. Benson, B. Wyman, and I. Held, 2016: Coarse-grained component concurrency in Earth system modeling: Parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework. Geosci. Model Dev., 9, 36053616, doi10.5194/gmd-9-3605-2016.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bellprat, O., S. Kotlarski, D. Lüthi, and C. Schär, 2012: Objective calibration of regional climate models. J. Geophys. Res., 117, D23115, doi10.1029/2012JD018262.

    • Search Google Scholar
    • Export Citation
  • Bony, S., J.-L. Dufresne, H. Le Treut, J.-J. Morcrette, and C. Senior, 2004: On dynamic and thermodynamic components of cloud changes. Climate Dyn., 22, 7186, doi10.1007/s00382-003-0369-6.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Burnham, K. P., and D. R. Anderson, 2002: Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach. 2nd ed. Springer, 488 pp.

  • Cess, R. D., and Coauthors, 1989: Interpretation of cloud-climate feedback as produced by 14 atmospheric general circulation models. Science, 245, 513516, doi10.1126/science.245.4917.513.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Couvreux, F., F. Hourdin, and C. Rio, 2010: Resolved versus parametrized boundary-layer plumes. Part I: A parametrization-oriented conditional sampling in large-eddy simulations. Bound.-Layer Meteor., 134, 441458, doi10.1007/s10546-009-9456-5.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Currin, C., T. Mitchell, M. Morris, and D. Ylvisakerc, 1991: Bayesian prediction of deterministic functions, with applications to the design and analysis of computer experiments. J. Amer. Stat. Assoc., 86, 953963, doi10.1080/01621459.1991.10475138.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dalmedico, A. D., 2001: History and epistemology of models: Meteorology (1946–1963) as a case study. Arch. Hist. Exact Sci., 55, 395422, doi10.1007/s004070000032.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Edwards, N. R., D. Cameron, and J. Rougier, 2011: Precalibrating an intermediate complexity climate model. Climate Dyn., 37, 14691482, doi10.1007/s00382-010-0921-0.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Edwards, P. N., 2001: Representing the global atmosphere: Computer models, data, and knowledge about climate change. Changing the Atmosphere: Expert Knowledge and Environmental Governance, C. A. Miller and P. N. Edwards, Eds., MIT Press, 31–66.

  • Edwards, P. N., 2010: A Vast Machine: Computer Models, Climate Data, and The Politics of Global Warming. MIT Press, 552 pp.

  • Fisher, R. A., 1922: On the mathematical foundations of theoretical statistics. Philos. Trans. Roy. Soc., A222, 309368, doi10.1098/rsta.1922.0009.

    • Search Google Scholar
    • Export Citation
  • Forster, P. M., T. Andrews, P. Good, J. M. Gregory, L. S. Jackson, and M. Zelinka, 2013: Evaluating adjusted forcing and model spread for historical and future scenarios in the CMIP5 generation of climate models. J. Geophys. Res. Atmos., 118, 11391150, doi10.1002/jgrd.50174.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gettelman, A., J. E. Kay, and K. M. Shell, 2012: The evolution of climate sensitivity and climate feedbacks in the Community Atmosphere Model. J. Climate, 25, 14531469, doi10.1175/JCLI-D-11-00197.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Golaz, J.-C., J.-C. Golaz, and H. Levy, 2013: Cloud tuning in a coupled climate model: Impact on 20th century warming. Geophys. Res. Lett., 40, 22462251, doi10.1002/grl.50232.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hansen, J., and Coauthors, 2005: Efficacy of climate forcings. J. Geophys. Res., 110, D18104, doi10.1029/2005JD005776.

  • Haylock, R., and A. O’Hagan, 1996: On inference for outputs of computationally expensive algorithms with uncertainty on the inputs. Bayesian Statistics 5, J. M. Bernardo et al., Eds., Oxford University Press, 629–637.

  • Held, I. M., 2005: The gap between simulation and understanding in climate modeling. Bull. Amer. Meteor. Soc., 86, 16091614, doi10.1175/BAMS-86-11-1609.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Heymsfield, A. J., and L. J. Donner, 1990: A scheme for parameterizing ice-cloud water content in general circulation models. J. Atmos. Sci., 47, 18651877, doi10.1175/1520-0469(1990)047<1865:ASFPIC>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hourdin, F., and Coauthors, 2013a: Impact of the LMDZ atmospheric grid configuration on the climate and sensitivity of the IPSL-CM5A coupled model. Climate Dyn., 40, 21672192, doi10.1007/s00382-012-1411-3.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hourdin, F., and Coauthors, 2013b: LMDZ5B: The atmospheric component of the IPSL climate model with revisited parameterizations for clouds and convection. Climate Dyn., 40, 21932222, doi10.1007/s00382-012-1343-y.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jackson, C. S., M. K. Sen, G. Huerta, Y. Deng, and K. P. Bowman, 2008: Error reduction and convergence in climate prediction. J. Climate, 21, 66986709, doi10.1175/2008JCLI2112.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Jam, A., F. Hourdin, C. Rio, and F. Couvreux, 2013: Resolved versus parametrized boundary-layer plumes. Part III: Derivation of a statistical scheme for cumulus clouds. Bound.-Layer Meteor., 147, 421441, doi10.1007/s10546-012-9789-3.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kennedy, M., and A. O’Hagan, 2001: Bayesian calibration of computer models. J. Roy. Stat. Soc., 63B, 425464, doi10.1111/1467-9868.00294.

  • Kiehl, J. T., 2007: Twentieth century climate model response and climate sensitivity. Geophys. Res. Lett., 34, L22710, doi10.1029/2007GL031383.

  • Kim, D., A. H. Sobel, A. D. Del Genio, Y. Chen, S. J. Camargo, M.-S. Yao, M. Kelley, and L. Nazarenko, 2012: The tropical subseasonal variability simulated in the NASA GISS general circulation model. J. Climate, 25, 46414659, doi10.1175/JCLI-D-11-00447.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kim, D., and Coauthors, 2014: Process-oriented MJO simulation diagnostic: Moisture sensitivity of simulated convection. J. Climate, 27, 53795395, doi10.1175/JCLI-D-13-00497.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • L’Ecuyer, T. S., and Coauthors, 2015: The observed state of the energy budget in the early twenty-first century. J. Climate, 28, 83198346, doi10.1175/JCLI-D-14-00556.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liu, C., M. W. Moncrieff, and W. W. Grabowski, 2001: Hierarchical modelling of tropical convective systems using explicit and parametrized approaches. Quart. J. Roy. Meteor. Soc., 127, 493515, doi10.1002/qj.49712757213.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Loeb, N. G., B. A. Wielicki, D. R. Doelling, G. L. Smith, D. F. Keyes, S. Kato, N. Manalo-Smith, and T. Wong, 2009: Toward optimal closure of the earth’s top-of-atmosphere radiation budget. J. Climate, 22, 748766, doi10.1175/2008JCLI2637.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lynch, P., 2008: The origins of computer weather prediction and climate modeling. J. Comput. Phys., 227, 34313444, doi10.1016/j.jcp.2007.02.034.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Manabe, S., and K. Bryan, 1969: Climate calculations with a combined ocean-atmosphere model. J. Atmos. Sci., 26, 786789, doi10.1175/1520-0469(1969)026<0786:CCWACO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Manabe, S., and R. T. Wetherald, 1975: The effects of doubling the CO2 concentration on the climate of a general circulation model. J. Atmos. Sci., 32, 315, doi10.1175/1520-0469(1975)032<0003:TEODTC>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mauritsen, T., and Coauthors, 2012: Tuning the climate of a global model. J. Adv. Model. Earth Syst., 4, M00A01, doi10.1029/2012MS000154.

  • Murphy, J. M., D. M. H. Sexton, D. N. Barnett, G. S. Jones, M. J. Webb, M. Collins, and D. A. Stainforth, 2004: Quantification of modelling uncertainties in a large ensemble of climate change simulations. Nature, 430, 768772, doi10.1038/nature02771.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Murphy, J. M., and Coauthors, 2009: UK climate projections science report: Climate change projections. Met Office Hadley Centre, 192 pp. [Available online at http://ukclimateprojections.metoffice.gov.uk/media.jsp?mediaid=87894&filetype=pdf.]

  • Neelin, J. D., A. Bracco, H. Luo, J. C. McWilliams, and J. E. Meyerson, 2010: Considerations for parameter optimization and sensitivity in climate models. Proc. Natl. Acad. Sci. USA, 107, 21 34921 354, doi10.1073/pnas.1015473107.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Notz, D., 2015: How well must climate models agree with observations? Philos. Trans. Roy. Soc. London, A373, 20140164, doi10.1098/rsta.2014.0164.

    • Search Google Scholar
    • Export Citation
  • Phillips, N. A., 1956: The general circulation of the atmosphere: A numerical experiment. Quart. J. Roy. Meteor. Soc., 82, 123164, doi10.1002/qj.49708235202.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Qian, Y., and Coauthors, 2015: Parametric sensitivity analysis of precipitation at global and local scales in the Community Atmosphere Model CAM5. J. Adv. Model. Earth Syst., 7, 382411, doi10.1002/2014MS000354.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Rougier, J. C., 2007: Probabilistic inference for future climate using an ensemble of climate model evaluations. Climatic Change, 81, 247264, doi10.1007/s10584-006-9156-9.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sacks, J., W. J. Welch, T. J. Mitchell, and H. P. Wynn, 1989: Design and analysis of computer experiments. Stat. Sci., 4, 409435, doi10.1214/ss/1177012413.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schmidt, G. A., and Coauthors, 2014: Configuration and assessment of the GISS ModelE2 contributions to the CMIP5 archive. J. Adv. Model. Earth Syst., 6, 141184, doi10.1002/2013MS000265.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Sexton, D. M. H., J. M. Murphy, M. Collins, and M. J. Webb, 2012: Multivariate probabilistic projections using imperfect climate models part I: Outline of methodology. Climate Dyn., 38, 25132542, doi10.1007/s00382-011-1208-9.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Smagorinsky, J., 1963: General circulation experiments with the primitive equations. Mon. Wea. Rev., 91, 99164, doi10.1175/1520-0493(1963)091<0099:GCEWTP>2.3.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Suzuki, K., J.-C. Golaz, and G. L. Stephens, 2013: Evaluating cloud tuning in a climate model with satellite observations. Geophys. Res. Lett., 40, 44644468, doi10.1002/grl.50874.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tebaldi, C., and R. Knutti, 2007: The use of the multi-model ensemble in probabilistic climate projections. Philos. Trans. Roy. Soc. London, A365, 20532075, doi10.1098/rsta.2007.2076.

    • Search Google Scholar
    • Export Citation
  • Tiedtke, M., 1989: A comprehensive mass flux scheme for cumulus parameterization in large-scale models. Mon. Wea. Rev., 117, 17791800, doi10.1175/1520-0493(1989)117<1779:ACMFSF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wan, H., P. J. Rasch, K. Zhang, Y. Qian, H. Yan, and C. Zhao, 2014: Short ensembles: An efficient method for discerning climate-relevant sensitivities in atmospheric general circulation models. Geosci. Model Dev., 7, 19611977, doi10.5194/gmd-7-1961-2014.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Williamson, D., M. Goldstein, and A. Blaker, 2012: Fast linked analyses for scenario based hierarchies. J. Roy. Stat. Soc., 61C, 665692, doi10.1111/j.1467-9876.2012.01042.x.

    • Search Google Scholar
    • Export Citation
  • Williamson, D., M. Goldstein, L. Allison, A. Blaker, P. Challenor, L. Jackson, and K. Yamazaki, 2013: History matching for exploring and reducing climate model parameter space using observations and a large perturbed physics ensemble. Climate Dyn., 41, 17031729, doi10.1007/s00382-013-1896-4.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Williamson, D., A. T. Blaker, C. Hampton, and J. Salter, 2015: Identifying and removing structural biases in climate models with history matching. Climate Dyn., 45, 12991324, doi10.1007/s00382-014-2378-z.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yang, B., and Coauthors, 2013: Uncertainty quantification and parameter tuning in the CAM5 Zhang-McFarlane convection scheme and impact of improved convection on the global circulation and climate. J. Geophys. Res. Atmos., 118, 395415, doi10.1029/2012JD018213.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhang, K., and Coauthors, 2014: Technical note: On the use of nudging for aerosol–climate model intercomparison studies. Atmos. Chem. Phys., 14, 86318645, doi10.5194/acp-14-8631-2014.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhang, T., L. Li, Y. Lin, W. Xue, F. Xie, H. Xu, and X. Huang, 2015: An automatic and effective parameter optimization method for model tuning. Geosci. Model Dev., 8, 35793591, doi10.5194/gmd-8-3579-2015.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zou, L., Y. Qian, T. Zhou, and B. Yang, 2014: Parameter tuning and calibration of RegCM3 with MIT–Emanuel cumulus parameterization scheme over CORDEX East Asia domain. J. Climate, 27, 76877701, doi10.1175/JCLI-D-14-00229.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 20728 4160 392
PDF Downloads 10425 2375 288