Some Pitfalls in Statistical Downscaling of Future Climate

John R. Lanzante NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, New Jersey

Search for other papers by John R. Lanzante in
Current site
Google Scholar
PubMed
Close
,
Keith W. Dixon NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, New Jersey

Search for other papers by Keith W. Dixon in
Current site
Google Scholar
PubMed
Close
,
Mary Jo Nath NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, New Jersey

Search for other papers by Mary Jo Nath in
Current site
Google Scholar
PubMed
Close
,
Carolyn E. Whitlock NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, and Engility Inc., Dover, New Jersey

Search for other papers by Carolyn E. Whitlock in
Current site
Google Scholar
PubMed
Close
, and
Dennis Adams-Smith NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, New Jersey, and CPAESS, University Corporation for Atmospheric Research, Boulder, Colorado

Search for other papers by Dennis Adams-Smith in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Statistical downscaling (SD) is commonly used to provide information for the assessment of climate change impacts. Using as input the output from large-scale dynamical climate models and observation-based data products, SD aims to provide a finer grain of detail and to mitigate systematic biases. It is generally recognized as providing added value. However, one of the key assumptions of SD is that the relationships used to train the method during a historical period are unchanged in the future, in the face of climate change. The validity of this assumption is typically quite difficult to assess in the normal course of analysis, as observations of future climate are lacking. We approach this problem using a “perfect model” experimental design in which high-resolution dynamical climate model output is used as a surrogate for both past and future observations.

We find that while SD in general adds considerable value, in certain well-defined circumstances it can produce highly erroneous results. Furthermore, the breakdown of SD in these contexts could not be foreshadowed during the typical course of evaluation based on only available historical data. We diagnose and explain the reasons for these failures in terms of physical, statistical, and methodological causes. These findings highlight the need for caution in the use of statistically downscaled products and the need for further research to consider other hitherto unknown pitfalls, perhaps utilizing more advanced perfect model designs than the one we have employed.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR: John R. Lanzante, john.lanzante@noaa.gov

Abstract

Statistical downscaling (SD) is commonly used to provide information for the assessment of climate change impacts. Using as input the output from large-scale dynamical climate models and observation-based data products, SD aims to provide a finer grain of detail and to mitigate systematic biases. It is generally recognized as providing added value. However, one of the key assumptions of SD is that the relationships used to train the method during a historical period are unchanged in the future, in the face of climate change. The validity of this assumption is typically quite difficult to assess in the normal course of analysis, as observations of future climate are lacking. We approach this problem using a “perfect model” experimental design in which high-resolution dynamical climate model output is used as a surrogate for both past and future observations.

We find that while SD in general adds considerable value, in certain well-defined circumstances it can produce highly erroneous results. Furthermore, the breakdown of SD in these contexts could not be foreshadowed during the typical course of evaluation based on only available historical data. We diagnose and explain the reasons for these failures in terms of physical, statistical, and methodological causes. These findings highlight the need for caution in the use of statistically downscaled products and the need for further research to consider other hitherto unknown pitfalls, perhaps utilizing more advanced perfect model designs than the one we have employed.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

CORRESPONDING AUTHOR: John R. Lanzante, john.lanzante@noaa.gov
Save
  • Abatzoglou, J. T., and T. J. Brown, 2012: A comparison of statistical downscaling methods suited for wildfire applications. Int. J. Climatol., 32, 772780, https://doi.org/10.1002/joc.2312.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ashfaq, M., L. C. Bowling, K. Cherkauer, J. S. Pal, and N. S. Diffenbaugh, 2010: Influence of climate model biases and daily-scale temperature and precipitation events on hydrological impacts assessment: A case study of the United States. J. Geophys. Res., 115, D14116, https://doi.org/10.1029/2009JD012965.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Benestad, R. E., D. Chen, and I. Hanssen-Bauer, 2008: Empirical-Statistical Downscaling. World Scientific Publishing Co., 228 pp., https://doi.org/10.1142/6908.

    • Crossref
    • Export Citation
  • Dayon, G., J. Boé, and E. Martin, 2015: Transferability in the future climate of a statistical downscaling method for precipitation in France. J. Geophys. Res. Atmos., 120, 10231043, https://doi.org/10.1002/2014JD022236.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Deque, M., 2007: Frequency of precipitation and temperature extremes over France in an anthropogenic scenario: Model results and statistical correction according to observed values. Global Planet. Change, 57, 1626, https://doi.org/10.1016/j.gloplacha.2006.11.030.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dixon, K. W., J. R. Lanzante, M. J. Nath, K. Hayhoe, A. Stoner, A. Radhakrishnan, V. Balaji, and C. F. Gaitan, 2016: Evaluating the stationarity assumption in statistically downscaled climate projections: Is past performance an indicator of future results? Climatic Change, 135, 395408, https://doi.org/10.1007/s10584-016-1598-0.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Eden, J. M., M. Widmann, D. Maraun, and M. Vrac, 2014: Comparison of GCM- and RCM-simulated precipitation following stochastic postprocessing. J. Geophys. Res. Atmos., 119, 11 04011 053, https://doi.org/10.1002/2014JD021732.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Efron, B., 1982: The Jackknife, the Bootstrap, and Other Resampling Plans. CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 38, SIAM, 92 pp., https://doi.org/10.1137/1.9781611970319.

    • Crossref
    • Export Citation
  • Fowler, H., S. Blenkinsop, and C. Tebaldi, 2007: Linking climate change modelling to impacts studies: Recent advances in downscaling techniques for hydrological modelling. Int. J. Climatol., 27, 15471578, https://doi.org/10.1002/joc.1556.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Frías, M. D., E. Zorita, J. Fernández, and C. Rodríguez-Puebla, 2006: Testing statistical downscaling methods in simulated climates. Geophys. Res. Lett., 33, L19807, https://doi.org/10.1029/2006GL027453.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hall, A., 2014: Projecting regional change. Science, 346, 14611462, https://doi.org/10.1126/science.aaa0629.

  • Harper, K., L. W. Uccellini, L. Morone, E. Kalnay, and K. Carey, 2007: 50th anniversary of operational numerical weather prediction. Bull. Amer. Meteor. Soc., 88, 639650, https://doi.org/10.1175/BAMS-88-5-639.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ho, C.-K., D. B. Stephenson, M. Collins, C. A. T. Ferro, and S. J. Brown, 2012: Calibration strategies: A source of additional uncertainty in climate change projections. Bull. Amer. Meteor. Soc., 93, 2126, https://doi.org/10.1175/2011BAMS3110.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ivanov, M. A., and S. Kotlarski, 2017: Assessing distribution-based climate model bias correction methods over an alpine domain: Added value and limitations. Int. J. Climatol., 37, 26332653, https://doi.org/10.1002/joc.4870.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Maraun, D., 2012: Nonstationarities of regional climate model biases in European seasonal mean temperature and precipitation sums. Geophys. Res. Lett., 39, L06706, https://doi.org/10.1029/2012GL051210.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Maraun, D., and Coauthors, 2010: Precipitation downscaling under climate change: Recent developments to bridge the gap between dynamical models and the end user. Rev. Geophys., 48, RG3003, https://doi.org/10.1029/2009RG000314.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Maraun, D., and Coauthors, 2015: VALUE: A framework to validate downscaling approaches for climate change studies. Earth’s Future, 3, 114, https://doi.org/10.1002/2014EF000259.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Maurer, E. P., H. G. Hidalgo, and T. Das, 2010: The utility of daily large-scale climate data in the assessment of climate change impacts on daily streamflow in California. Hydrol. Earth Syst. Sci., 14, 11251138, https://doi.org/10.5194/hess-14-1125-2010.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Melillo, J. M., T. C. Richmond, and G. W. Yohe, Eds., 2014: Climate change impacts in the United States: The Third National Climate Assessment. U.S. Global Change Research Program, 841 pp., https://doi.org/10.7930/J0Z31WJ2.

    • Crossref
    • Export Citation
  • Milly, P. C. D., and Coauthors, 2014: An enhanced model of land water and energy for global hydrologic and earth-system studies. J. Hydrometeor., 15, 17391761, https://doi.org/10.1175/JHM-D-13-0162.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • NOAA, 2013: National coastal population report: Population trends from 1970 to 2020. NOAA’s State of the Coast, National Oceanic and Atmospheric Administration, 19 pp., http://oceanservice.noaa.gov/facts/coastal-population-report.pdf.

  • Panofsky, H. W., and G. W. Brier, 1968: Some Applications of Statistics to Meteorology. Pennsylvania State University Press, 224 pp.

  • Pierce, D. W., D. R. Cayan, and B. L. Thrasher, 2014: Statistical downscaling using localized constructed analogs (LOCA). J. Hydrometeor., 15, 25582585, https://doi.org/10.1175/JHM-D-14-0082.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pierce, D. W., D. R. Cayan, E. P. Maurer, J. T. Abatzoglou, and K. C. Hegewisch, 2015: Improved bias correction techniques for hydrological simulations of climate change. J. Hydrometeor., 16, 24212442, https://doi.org/10.1175/JHM-D-14-0236.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Salathé, E. P., Jr., R. Steed, C. F. Mass, and P. H. Zahn, 2008: A high-resolution climate model for the U.S. Pacific Northwest: Mesoscale feedbacks and local responses to climate change. J. Climate, 21, 57085726, https://doi.org/10.1175/2008JCLI2090.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Stoner, A. M. K., K. Hayhoe, X. Yang, and D. J. Wuebbles, 2013: An asynchronous regional regression model for statistical downscaling of daily climate variables. Int. J. Climatol., 33, 24732494, https://doi.org/10.1002/joc.3603.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Taylor, K. E., R. J. Stouffer, and G. A. Meehl, 2012: An overview of CMIP5 and the experiment design. Bull. Amer. Meteor. Soc., 93, 485498, https://doi.org/10.1175/BAMS-D-11-00094.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thrasher, B., E. P. Maurer, C. McKellar, and P. Duffy, 2012: Bias correcting climate model simulated daily temperature extremes with quantile mapping. Hydrol. Earth Syst. Sci., 16, 33093314, https://doi.org/10.5194/hess-16-3309-2012.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Turco, M., C. Llasat, S. Herrera, and J. M. Gutiérrez, 2017: Bias correction and downscaling of future RCM precipitation projections using a MOS-Analog technique. J. Geophys. Res. Atmos., 122, 26312648, https://doi.org/10.1002/2016JD025724.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Velazquez, J. A., M. Troin, D. Caya, and F. Brissette, 2015: Evaluating the time-invariance hypothesis of climate model bias correction: Implications for hydrological impact studies. J. Hydrometeor., 16, 20132026, https://doi.org/10.1175/JHM-D-14-0159.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Vrac, M., M. Stein, K. Hayhoe, and X.-Z. Liang, 2007: A general method for validating statistical downscaling methods under future climate change. Geophys. Res. Lett., 34, L18701, https://doi.org/10.1029/2007GL030295.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Walton, D. B., A. Hall, N. Berg, M. Schwartz, and F. Sun, 2017: Incorporating snow albedo feedback into downscaled temperature and snow cover projections for California’s Sierra Nevada. J. Climate, 30, 14171438, https://doi.org/10.1175/JCLI-D-16-0168.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 676 pp.

  • Wood, A. W., L. R. Leung, V. Sridhar, and D. P. Lettenmaier, 2004: Hydrologic implications of dynamical and statistical approaches to downscaling climate model outputs. Climatic Change, 62, 189216, https://doi.org/10.1023/B: CLIM.0000013685.99609.9e.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 5010 1427 132
PDF Downloads 2543 632 61