Systematic Error Analysis and Calibration of 2-m Temperature for the NCEP GEFS Reforecast of the Subseasonal Experiment (SubX) Project

Hong Guan SRG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Hong Guan in
Current site
Google Scholar
PubMed
Close
,
Yuejian Zhu NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Yuejian Zhu in
Current site
Google Scholar
PubMed
Close
,
Eric Sinsky IMSG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Eric Sinsky in
Current site
Google Scholar
PubMed
Close
,
Wei Li IMSG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Wei Li in
Current site
Google Scholar
PubMed
Close
,
Xiaqiong Zhou IMSG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Xiaqiong Zhou in
Current site
Google Scholar
PubMed
Close
,
Dingchen Hou NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Dingchen Hou in
Current site
Google Scholar
PubMed
Close
,
Christopher Melhauser IMSG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Christopher Melhauser in
Current site
Google Scholar
PubMed
Close
, and
Richard Wobus IMSG at NOAA/NWS/NCEP/EMC, College Park, Maryland

Search for other papers by Richard Wobus in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The National Centers for Environmental Prediction have generated an 18-yr (1999–2016) subseasonal (weeks 3 and 4) reforecast to support the Climate Prediction Center’s operational mission. To create this reforecast, the subseasonal experiment version of the GEFS was run every Wednesday, initialized at 0000 UTC with 11 members. The Climate Forecast System Reanalysis (CFSR) and Global Data Assimilation System (GDAS) served as the initial analyses for 1999–2010 and 2011–16, respectively. The analysis of 2-m temperature error demonstrates that the model has a strong warm bias over the Northern Hemisphere (NH) and North America (NA) during the warm season. During the boreal winter, the 2-m temperature errors over NA exhibit large interannual and intraseasonal variability. For NA and the NH, weeks 3 and 4 errors are mostly saturated, with initial conditions having a negligible impact. Week 2 errors (day 11) are ~88.6% and 86.6% of their saturated levels, respectively. The 1999–2015 reforecast biases were used to calibrate the 2-m temperature forecasts in 2016, which reduces (increases) the systematic error (forecast skill) for NA, the NH, the Southern Hemisphere, and the tropics, with a maximum benefit for NA during the warm season. Overall, analysis adjustment for the CFSR period makes bias characteristics more consistent with the GDAS period over the NH and tropics and substantially improves the corresponding forecast skill levels. The calibration of the forecast using week 2 bias provides similar skill to using weeks 3 and 4 bias, promising the feasibility of using week 2 bias to calibrate the weeks 3 and 4 forecast. Our results also demonstrate that 10-yr reforecasts are an optimal training period. This is particularly beneficial considering limited computing resources.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Dr. Hong Guan, hong.guan@noaa.gov

Abstract

The National Centers for Environmental Prediction have generated an 18-yr (1999–2016) subseasonal (weeks 3 and 4) reforecast to support the Climate Prediction Center’s operational mission. To create this reforecast, the subseasonal experiment version of the GEFS was run every Wednesday, initialized at 0000 UTC with 11 members. The Climate Forecast System Reanalysis (CFSR) and Global Data Assimilation System (GDAS) served as the initial analyses for 1999–2010 and 2011–16, respectively. The analysis of 2-m temperature error demonstrates that the model has a strong warm bias over the Northern Hemisphere (NH) and North America (NA) during the warm season. During the boreal winter, the 2-m temperature errors over NA exhibit large interannual and intraseasonal variability. For NA and the NH, weeks 3 and 4 errors are mostly saturated, with initial conditions having a negligible impact. Week 2 errors (day 11) are ~88.6% and 86.6% of their saturated levels, respectively. The 1999–2015 reforecast biases were used to calibrate the 2-m temperature forecasts in 2016, which reduces (increases) the systematic error (forecast skill) for NA, the NH, the Southern Hemisphere, and the tropics, with a maximum benefit for NA during the warm season. Overall, analysis adjustment for the CFSR period makes bias characteristics more consistent with the GDAS period over the NH and tropics and substantially improves the corresponding forecast skill levels. The calibration of the forecast using week 2 bias provides similar skill to using weeks 3 and 4 bias, promising the feasibility of using week 2 bias to calibrate the weeks 3 and 4 forecast. Our results also demonstrate that 10-yr reforecasts are an optimal training period. This is particularly beneficial considering limited computing resources.

© 2019 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Dr. Hong Guan, hong.guan@noaa.gov
Save
  • Bishop, C. H., and K. T. Shanley, 2008: Bayesian model averaging’s problematic treatment of extreme weather and a paradigm shift that fixes it. Mon. Wea. Rev., 136, 46414652, https://doi.org/10.1175/2008MWR2565.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Buizza, R., M. Milleer, and T. Palmer, 1999: Stochastic representation of model uncertainties in the ECMWF Ensemble Prediction System. Quart. J. Roy. Meteor. Soc., 125, 28872908, https://doi.org/10.1002/qj.49712556006.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Candille, G., 2009: The multiensemble approach: The NAEFS example. Mon. Wea. Rev., 137, 16551665, https://doi.org/10.1175/2008MWR2682.1.

  • Chai, T., and R. R. Draxler, 2014: Root mean square error (RMSE) or mean absolute error (MAE)?—Argument against avoiding RMSE in the literature. Geosci. Model Dev., 7, 12471250, https://doi.org/10.5194/gmd-7-1247-2014.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cheng, W. Y. Y., and W. J. Steenburgh, 2007: Strengths and weaknesses of MOS, running-mean bias removal, and Kalman filter techniques for improving model forecasts over the western United States. Wea. Forecasting, 22, 13041318, https://doi.org/10.1175/2007WAF2006084.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Cui, B., Z. Toth, Y. Zhu, and D. Hou, 2012: Bias correction for global ensemble forecast. Wea. Forecasting, 27, 396410, https://doi.org/10.1175/WAF-D-11-00011.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Frei, A., and D. A. Robinson, 1999: Northern Hemisphere snow extent: Regional variability 1972–1994. Int. J. Climatol., 19, 15351560, https://doi.org/10.1002/(SICI)1097-0088(19991130)19:14<1535::AID-JOC438>3.0.CO;2-J.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gneiting, T., A. E. Raftery, A. H. Westveld, and T. Goldman, 2005: Calibrated probabilistic forecasting using ensemble model output statistics and minimum CRPS estimation. Mon. Wea. Rev., 133, 10981118, https://doi.org/10.1175/MWR2904.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guan, H., and Y. Zhu, 2017: Development of verification methodology for extreme weather forecasts. Wea. Forecasting, 32, 479491, https://doi.org/10.1175/WAF-D-16-0123.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guan, H., B. Cui, and Y. Zhu, 2015: Improvement of statistical postprocessing using GEFS reforecast information. Wea. Forecasting, 30, 841854, https://doi.org/10.1175/WAF-D-14-00126.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., J. S. Whitaker, and X. Wei, 2004: Ensemble reforecasting: Improving medium-range forecast skill using retrospective forecasts. Mon. Wea. Rev., 132, 14341447, https://doi.org/10.1175/1520-0493(2004)132<1434:ERIMFS>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., R. Hagedorn, and J. S. Whitaker, 2008: Probabilistic forecast calibration using ECMWF and GFS ensemble reforecasts. Part II: Precipitation. Mon. Wea. Rev., 136, 26202632, https://doi.org/10.1175/2007MWR2411.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and Coauthors, 2013: NOAA’s second-generation global medium-range ensemble reforecast dataset. Bull. Amer. Meteor. Soc., 94, 15531565, https://doi.org/10.1175/BAMS-D-12-00014.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Han, J., W. Wang, Y. C. Kwon, S.-Y. Hong, V. Tallapragada, and F. Yang, 2017: Updates in the NCEP GFS cumulus convection schemes with scale and aerosol awareness. Wea. Forecasting, 32, 20052017, https://doi.org/10.1175/WAF-D-17-0046.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Johnson, N. C., D. C. Collins, S. B. Feldstein, M. L. L’Heureux, and E. E. Riddle, 2014: Skillful wintertime North American temperature forecasts out to 4 weeks based on the state of ENSO and the MJO. Wea. Forecasting, 29, 2338, https://doi.org/10.1175/WAF-D-13-00102.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kalnay, E., and Coauthors, 1996: The NCEP/NCAR 40-Year Reanalysis Project. Bull. Amer. Meteor. Soc., 77, 437471, https://doi.org/10.1175/1520-0477(1996)077<0437:TNYRP>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kazakova, E. and I. Rozinkina, 2011: Testing of snow parameterization schemes in COSMO-Ru: Analysis and results. COSMO Newsletter, No. 11, 41–51, http://www.cosmo-model.org/content/model/documentation/newsLetters/newsLetter11/2_kazakova.pdf.

  • Klein, S. A., X. Jiang, J. Boyle, S. Malyshev, and S. Xie, 2006: Diagnosis of the summertime warm and dry bias over the U.S. southern Great Plains in the GFDL Climate Model using a weather forecasting approach. Geophys. Res. Lett., 33, L18805, https://doi.org/10.1029/2006GL027567.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Klingaman, N. P., B. Hanson, and D. J. Leathers, 2008: A teleconnection between forced Great Plains snow cover and European winter climate. J. Climate, 21, 24662483, https://doi.org/10.1175/2007JCLI1672.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lavaysse, C., M. Carrera, S. Bélair, N. Gagnon, R. Frenette, M. Charron, and M. K. Yau, 2013: Impact of surface parameter uncertainties with the Canadian Regional Ensemble Prediction System. Mon. Wea. Rev., 141, 15061526, https://doi.org/10.1175/MWR-D-11-00354.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Li, W., and Coauthors, 2018: Evaluating the MJO forecast skill from different configurations of NCEP GEFS extended forecast. Climate Dyn., https://doi.org/10.1007/s00382-018-4423-9, in press.

    • Search Google Scholar
    • Export Citation
  • Melhauser, C., W. Li, Y. Zhu, X. Zhou, M. Pena, and D. Hou, 2016: Exploring the impact of SST on the extended range NCEP Global Ensemble Forecast System. 41st Annual Climate Diagnostics and Prediction Workshop, Orono, ME, NOAA/NWS, 30–34, http://www.nws.noaa.gov/ost/climate/STIP/41CDPW/41cdpw-CMelhauser.pdf.

  • NOAA, 2017: Service Change Notice 1767 update. NOAA/NWS, http://www.nws.noaa.gov/os/notification/scn17-67gfsupgradeaab.htm.

  • Ou, M., M. Charles, and D. Collins, 2016: Sensitivity of calibrated week-2 probabilistic forecast skill to reforecast sampling of the NCEP Global Ensemble Forecast System. Wea. Forecasting, 31, 10931107, https://doi.org/10.1175/WAF-D-15-0166.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Palmer, T. N., R. Buizza, F. Doblas-Reyes, T. Jung, M. Leutbecher, G. Shutts, M. Steinheimer, and A. Weisheimer, 2009: Stochastic parametrization and model uncertainty. ECMWF Tech. Memo. 598, 42 pp., http://www.ecmwf.int/publications/.

  • Raftery, A. E., T. Gneiting, F. Balabdaoui, and M. Polakowski, 2005: Using Bayesian model averaging to calibrate forecast ensembles. Mon. Wea. Rev., 133, 11551174, https://doi.org/10.1175/MWR2906.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Robinson, D. A., 1996: Evaluating snow cover over Northern Hemisphere lands using satellite and in situ observations. Proc. 53rd Eastern Snow Conf., Williamsburg, VA, Eastern Snow Conference, 13–19.

  • Robinson, D. A., and A. Frei, 2000: Seasonal variability of Northern Hemisphere snow extent using visible satellite data. Prof. Geogr., 52, 307315, https://doi.org/10.1111/0033-0124.00226.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Roulston, M. S., and L. A. Smith, 2003: Combining dynamical and statistical ensembles. Tellus, 55A, 1630, https://doi.org/10.1034/j.1600-0870.2003.201378.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Saha, S., and Coauthors, 2010: The NCEP Climate Forecast System Reanalysis. Bull. Amer. Meteor. Soc., 91, 10151057, https://doi.org/10.1175/2010BAMS3001.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Shutts, G., 2005: A kinetic energy backscatter algorithm for use in ensemble prediction systems. Quart. J. Roy. Meteor. Soc., 131, 30793102, https://doi.org/10.1256/qj.04.106.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Shutts, G., and T. N. Palmer, 2004: The use of high-resolution numerical simulations of tropical circulation to calibrate stochastic physics schemes. Proc. Workshop on Simulation and Prediction of Intra-Seasonal Variability with Emphasis on the MJO, Reading, United Kingdom, ECMWF, 83–102, https://www.ecmwf.int/en/learning/workshops-and-seminars/past-workshops/2003-simulation-prediction-intra-seasonal-variability.

  • Song, S. W., and B. Mapes, 2012: Interpretations of systematic errors in the NCEP Climate Forecast System at lead times of 2, 4, 8, ..., 256 days. J. Adv. Model. Earth Syst., 4, M09002, https://doi.org/10.1029/2011MS000094.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tompkins, A. M., and J. Berner, 2008: A stochastic convective approach to account for model uncertainty due to unresolved humidity variability. J. Geophys. Res., 113, D18101, https://doi.org/10.1029/2007JD009284.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Vitart, F., 2009: Impact of the Madden–Julian oscillation on tropical storms and risk of landfall in the ECMWF forecast system. Geophys. Res. Lett., 36, L15802, https://doi.org/10.1029/2009GL039089.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wang, X., and C. H. Bishop, 2005: Improvement of ensemble reliability with a new dressing kernel. Quart. J. Roy. Meteor. Soc., 131, 965986, https://doi.org/10.1256/qj.04.120.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wei, M., Z. Toth, R. Wobus, and Y. Zhu, 2008: Initial perturbations based on the ensemble transform (ET) technique in the NCEP global operational forecast system. Tellus, 60A, 6279, https://doi.org/10.1111/j.1600-0870.2007.00273.x.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 2011: Statistical Methods in the Atmospheric Sciences. 3rd ed. Elsevier, 676 pp.

    • Crossref
    • Export Citation
  • Wilks, D. S., and T. M. Hamill, 2007: Comparison of ensemble-MOS methods using GFS reforecasts. Mon. Wea. Rev., 135, 23792390, https://doi.org/10.1175/MWR3402.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wilson, L. J., S. Beauregard, A. E. Raftery, and R. Verret, 2007: Calibrated surface temperature forecasts from the Canadian Ensemble Prediction System using Bayesian model averaging. Mon. Wea. Rev., 135, 13641385, https://doi.org/10.1175/MWR3347.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Yuan, H., X. Gao, S. L. Mullen, S. Sorooshian, J. Du, and H. H. Juang, 2007: Calibration of probabilistic quantitative precipitation forecasts with an artificial neural network. Wea. Forecasting, 22, 12871303, https://doi.org/10.1175/2007WAF2006114.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zheng, W., H. Wei, Z. Wang, X. Zeng, J. Meng, M. Ek, K. Mitchell, and J. Derber, 2012: Improvement of daytime land surface skin temperature over arid regions in the NCEP GFS model and its impact on satellite data assimilation. J. Geophys. Res., 117, D06117, https://doi.org/10.1029/2011JD015901.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhou, X., Y. Zhu, D. Hou, and D. Kleist, 2016: Comparison of the ensemble transform and the ensemble Kalman filter in the NCEP Global Ensemble Forecast System. Wea. Forecasting, 31, 20582074.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhou, X., Y. Zhu, D. Hou, Y. Luo, J. Peng, and D. Wobus, 2017: The NCEP Global Ensemble Forecast System with the EnKF initialization. Wea. Forecasting, 32, 19892004, https://doi.org/10.1175/WAF-D-17-0023.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhu, Y., 2005: Ensemble forecast: A new approach to uncertainty and predictability. Adv. Atmos. Sci., 22, 781788, https://doi.org/10.1007/BF02918678.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhu, Y., and Z. Toth, 2008: Ensemble based probabilistic forecast verification. 19th Conf. on Probability and Statistics, New Orleans, LA, Amer. Meteor. Soc., 2.2, https://ams.confex.com/ams/88Annual/webprogram/Paper131645.html.

  • Zhu, Y., X. Zhou, M. Pena, W. Li, C. Melhauser, and D. Hou, 2017: Impact of sea surface temperature forcing on weeks 3 and 4 forecast skill in the NCEP Global Ensemble Forecast System. Wea. Forecasting, 32, 21592173, https://doi.org/10.1175/WAF-D-17-0093.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Zhu, Y., and Coauthors, 2018: Toward the improvement of sub-seasonal prediction in the NCEP Global Ensemble Forecast System (GEFS). J. Geophys. Res. Atmos., 123, 67326745, https://doi.org/10.1029/2018JD028506.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 2605 1465 54
PDF Downloads 786 143 11