Editorial Type:
Article
Article Type:
Research Article

Evaluation of NCEP–CFSR, NCEP–NCAR, ERA-Interim, and ERA-40 Reanalysis Datasets against Independent Sounding Observations over the Tibetan Plateau

Xinghua Bao Department of Meteorology, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Xinghua Bao in
Current site
Google Scholar
PubMed Close
and
Fuqing Zhang Department of Meteorology, The Pennsylvania State University, University Park, Pennsylvania

Search for other papers by Fuqing Zhang in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jan 2013
DOI:
https://doi.org/10.1175/JCLI-D-12-00056.1
Page(s):
206–214
Restricted access

Abstract

The NCEP–NCAR reanalysis, NCEP Climate Forecast System Reanalysis (CFSR), 40-yr ECMWF Re-Analysis (ERA-40), and interim ECMWF Re-Analysis (ERA-Interim) products are evaluated with sounding observations from an enhanced radiosonde network available every 6 h during the Tibetan Plateau Experiment (TIPEX) conducted from 10 May to 9 August 1998. This study uses more than 3000 high-quality, independent rawinsondes at 11 stations (which were not assimilated in any of the reanalyses), which represents the first time that such a comprehensive evaluation is performed to assess the quality of these four most widely used reanalysis products over this region, which is highest in the world and crucial to the global climate and weather.

Averaging over the entire three-month period, it is found that each reanalysis dataset produces mean values of temperature and horizontal winds consistent with the verifying soundings (indicating relatively small mean bias); however, there are considerable differences (biases) in the mean relative humidity. On average, except for temperature at higher levels, both newer-generation reanalyses (CFSR and ERA-Interim) have smaller root-mean-square (RMS) error and bias than their predecessors (NCEP–NCAR and ERA-40). With some exceptions, the RMS errors of all variables for both CFSR and ERA-Interim (verifying with soundings) are similar in magnitude to the RMS difference between these two reanalyses, all of which are approximately twice as large as the corresponding observation errors. It is also found that there are strong diurnal variations in both RMS error and mean bias that differ greatly among different reanalyses and at different pressure levels.

Corresponding author address: Dr. Fuqing Zhang, Department of Meteorology, The Pennsylvania State University, University Park, PA 16802. E-mail: fzhang@psu.edu

Abstract

The NCEP–NCAR reanalysis, NCEP Climate Forecast System Reanalysis (CFSR), 40-yr ECMWF Re-Analysis (ERA-40), and interim ECMWF Re-Analysis (ERA-Interim) products are evaluated with sounding observations from an enhanced radiosonde network available every 6 h during the Tibetan Plateau Experiment (TIPEX) conducted from 10 May to 9 August 1998. This study uses more than 3000 high-quality, independent rawinsondes at 11 stations (which were not assimilated in any of the reanalyses), which represents the first time that such a comprehensive evaluation is performed to assess the quality of these four most widely used reanalysis products over this region, which is highest in the world and crucial to the global climate and weather.

Averaging over the entire three-month period, it is found that each reanalysis dataset produces mean values of temperature and horizontal winds consistent with the verifying soundings (indicating relatively small mean bias); however, there are considerable differences (biases) in the mean relative humidity. On average, except for temperature at higher levels, both newer-generation reanalyses (CFSR and ERA-Interim) have smaller root-mean-square (RMS) error and bias than their predecessors (NCEP–NCAR and ERA-40). With some exceptions, the RMS errors of all variables for both CFSR and ERA-Interim (verifying with soundings) are similar in magnitude to the RMS difference between these two reanalyses, all of which are approximately twice as large as the corresponding observation errors. It is also found that there are strong diurnal variations in both RMS error and mean bias that differ greatly among different reanalyses and at different pressure levels.

Corresponding author address: Dr. Fuqing Zhang, Department of Meteorology, The Pennsylvania State University, University Park, PA 16802. E-mail: fzhang@psu.edu
Save
Cover Journal of Climate
Journal of Climate

  • Bao, X., F. Zhang, and J. Sun, 2011: Diurnal variations of warm-season precipitation east of the Tibetan Plateau over China. Mon. Wea. Rev., 139, 2790–2810.

    • Search Google Scholar
    • Export Citation

  • Betts, A. K., M. Köhler, and Y. Zhang, 2009: Comparison of river basin hydrometeorology in ERA-Interim and ERA-40 reanalysis with observations. J. Geophys. Res., 114, D02101, doi:10.1029/2008JD010761.

    • Search Google Scholar
    • Export Citation

  • Bian, J. C., H. B. Chen, H. Vömel, Y. J. Duan, Y. J. Xuan, and D. R. Lu, 2011: Intercomparison of humidity and temperature sensors: GTS1, Vaisala RS80, and CFH. Adv. Atmos. Sci., 28, 139–146, doi:10.1007/s00376-010-9170-8.

    • Search Google Scholar
    • Export Citation

  • Dee, D. P., and Coauthors, 2011: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system. Quart. J. Roy. Meteor. Soc., 137, 553–597.

    • Search Google Scholar
    • Export Citation

  • Ding, Y., and J. C. L. Chan, 2005: The East Asian summer monsoon: An overview. Meteor. Atmos. Phys., 89, 117–142.

  • Fan, X., J. E. Walsh, and J. R. Krieger, 2008: A one-year experimental Arctic reanalysis and comparisons with ERA-40 and NCEP/NCAR reanalyses. Geophys. Res. Lett., 35, L19811, doi:10.1029/2008GL035110.

    • Search Google Scholar
    • Export Citation

  • Frauenfeld, O. W., T. Zhang, and M. C. Serreze, 2005: Climate change and variability using European Centre for Medium-Range Weather Forecasts reanalysis (ERA-40) temperatures on the Tibetan Plateau. J. Geophys. Res., 110, D02101, doi:10.1029/2004JD005230.

    • Search Google Scholar
    • Export Citation

  • He, H., and F. Zhang, 2010: Diurnal variations of warm-season precipitation over Northern China. Mon. Wea. Rev., 138, 1017–1025.

  • Hodges, K. I., R. W. Lee, and L. Bengtsson, 2011: A comparison of extratropical cyclones in recent reanalyses ERA-Interim, NASA MERRA, NCEP CFSR, and JRA-25. J. Climate, 24, 4888–4906.

    • Search Google Scholar
    • Export Citation

  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis project. Bull. Amer. Meteor. Soc., 77, 437–471.

  • Mao, J., X. Shi, L. Ma, D. P. Kaiser, Q. Li, and P. E. Thornton, 2010: Assessment of reanalysis daily extreme temperatures with China’s homogenized historical dataset during 1979–2001 using probability density functions. J. Climate, 23, 6605–6623.

    • Search Google Scholar
    • Export Citation

  • Mooney, P. A., F. J. Mulligan, and R. Fealy, 2010: Comparison of ERA-40, ERA-Interim and NCEP/NCAR reanalysis data with observed surface air temperatures over Ireland. Int. J. Climatol., 31, 545–557, doi:10.1002/joc.2098.

    • Search Google Scholar
    • Export Citation

  • Saha, S., and Coauthors, 2010: The NCEP climate forecast system reanalysis. Bull. Amer. Meteor. Soc., 91, 1015–1057.

  • Uppala, S. M., and Coauthors, 2005: The ERA-40 Re-Analysis. Quart. J. Roy. Meteor. Soc., 131, 2961–3012.

  • Wang, A., and X. Zeng, 2012: Evaluation of multireanalysis products with in situ observations over the Tibetan Plateau. J. Geophys. Res., 117, D05102, doi:10.1029/2011JD016553.

    • Search Google Scholar
    • Export Citation

  • Xu, X., L. Chen, and M. Zhou, 2002: The Second Tibetan Plateau Experiment of Atmospheric Sciences: TIPEX-GAME/TIBET. China Meteorological Press, 236 pp.

  • Zhao, T., and C. Fu, 2006: Comparison of products from ERA-40, NCEP-2, and CRU with station data for summer precipitation over China. Adv. Atmos. Sci., 23, 593–604.

    • Search Google Scholar
    • Export Citation

  • Zhou, M., X. Xu, L. Bian, J. Chen, H. Liu, Y. Zhang, S. Li, and Y. Zhao, 2000: Observations, Diagnostics, and Dynamics of the Atmospheric Boundary Layer over the Tibetan Plateau during TIPEX 1998 (in Chinese). China Meteorological Press, 125 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2145 886 220
PDF Downloads 1292 346 29