Spatiotemporal Variations in Precipitation Forecasting Skill of Three Global Subseasonal Prediction Products over China

Shiyuan Liu aThe National Key Laboratory of Water Disaster Prevention, Hohai University, Nanjing, China
bCollege of Hydrology and Water Resources, Hohai University, Nanjing, China

Search for other papers by Shiyuan Liu in
Current site
Google Scholar
PubMed
Close
,
Wentao Li aThe National Key Laboratory of Water Disaster Prevention, Hohai University, Nanjing, China
bCollege of Hydrology and Water Resources, Hohai University, Nanjing, China
cChina Meteorological Administration Hydro-Meteorology Key Laboratory, Hohai University, Nanjing, China

Search for other papers by Wentao Li in
Current site
Google Scholar
PubMed
Close
, and
Qingyun Duan aThe National Key Laboratory of Water Disaster Prevention, Hohai University, Nanjing, China
bCollege of Hydrology and Water Resources, Hohai University, Nanjing, China
cChina Meteorological Administration Hydro-Meteorology Key Laboratory, Hohai University, Nanjing, China

Search for other papers by Qingyun Duan in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Subseasonal to seasonal (S2S) predictions, which bridge the gap between weather forecasts and climate outlooks, have the great societal benefits of improving water resource management and food security. However, there are tremendous disparities in the forecasting skills of subseasonal precipitation prediction products. This study investigates the spatiotemporal variations in the precipitation forecasting skill of three subseasonal prediction products from the CMA, ECMWF, and NCEP over China. Daily precipitation predictions with lead times ranging from 1 to 30 days and cumulative precipitation predictions over 1–30 days were evaluated in nine major river basins. The daily prediction skill rapidly declines with lead time. In contrast, the correlation coefficient between the cumulative precipitation predictions and corresponding observations increases at first and peaks at 0.7–0.8 after 3–5 days, then gradually decreases and settles at approximately 0.2–0.6. Among the three evaluated models, the ECMWF model demonstrates the best skill, maintaining a correlation coefficient of approximately 0.5 for 2-week cumulative precipitation. Moreover, the correlation coefficient of the model’s prediction is 0.2–0.5 higher than that of the climatological prediction over a large domain for the 30-day cumulative precipitation during the rainy summer. Similarly, the equitable threat score for forecasting below- and above-normal precipitation events presents good results in eastern China but is affected by biases of raw predictions. The variations in the subseasonal prediction skill at different time scales reveal the potential values of cumulative precipitation predictions. The findings of this study can provide practical information for applications that prioritize the long-term aggregation of hydrometeorological variables.

Significance Statement

The daily and cumulative precipitation prediction skills of three subseasonal prediction products were evaluated over China in this study. Our results reveal the spatiotemporal variations in prediction skill, especially with respect to time scale. Compared to daily precipitation predictions, cumulative precipitation predictions are more skillful, with correlation coefficients peaking at 0.7–0.8 after 3–5 days. These results can provide valuable information for water resource managers who are more concerned with the general conditions over a period than with hydrometeorological events occurring on a particular day. This study can guide end users in applying appropriate time scales to fully exploit numerical weather prediction information and satisfy their specific needs.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Qingyun Duan, qyduan@hhu.edu.cn

Abstract

Subseasonal to seasonal (S2S) predictions, which bridge the gap between weather forecasts and climate outlooks, have the great societal benefits of improving water resource management and food security. However, there are tremendous disparities in the forecasting skills of subseasonal precipitation prediction products. This study investigates the spatiotemporal variations in the precipitation forecasting skill of three subseasonal prediction products from the CMA, ECMWF, and NCEP over China. Daily precipitation predictions with lead times ranging from 1 to 30 days and cumulative precipitation predictions over 1–30 days were evaluated in nine major river basins. The daily prediction skill rapidly declines with lead time. In contrast, the correlation coefficient between the cumulative precipitation predictions and corresponding observations increases at first and peaks at 0.7–0.8 after 3–5 days, then gradually decreases and settles at approximately 0.2–0.6. Among the three evaluated models, the ECMWF model demonstrates the best skill, maintaining a correlation coefficient of approximately 0.5 for 2-week cumulative precipitation. Moreover, the correlation coefficient of the model’s prediction is 0.2–0.5 higher than that of the climatological prediction over a large domain for the 30-day cumulative precipitation during the rainy summer. Similarly, the equitable threat score for forecasting below- and above-normal precipitation events presents good results in eastern China but is affected by biases of raw predictions. The variations in the subseasonal prediction skill at different time scales reveal the potential values of cumulative precipitation predictions. The findings of this study can provide practical information for applications that prioritize the long-term aggregation of hydrometeorological variables.

Significance Statement

The daily and cumulative precipitation prediction skills of three subseasonal prediction products were evaluated over China in this study. Our results reveal the spatiotemporal variations in prediction skill, especially with respect to time scale. Compared to daily precipitation predictions, cumulative precipitation predictions are more skillful, with correlation coefficients peaking at 0.7–0.8 after 3–5 days. These results can provide valuable information for water resource managers who are more concerned with the general conditions over a period than with hydrometeorological events occurring on a particular day. This study can guide end users in applying appropriate time scales to fully exploit numerical weather prediction information and satisfy their specific needs.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Qingyun Duan, qyduan@hhu.edu.cn

Supplementary Materials

    • Supplemental Materials (PDF 2.4584 MB)
Save
  • Brunet, G., and Coauthors, 2010: Collaboration of the weather and climate communities to advance subseasonal-to-seasonal prediction. Bull. Amer. Meteor. Soc., 91, 13971406, https://doi.org/10.1175/2010BAMS3013.1.

    • Search Google Scholar
    • Export Citation
  • Chen, Z., X. Zhang, and J. Chen, 2021: Monitoring terrestrial water storage changes with the Tongji-Grace2018 model in the nine major river basins of the Chinese Mainland. Remote Sens., 13, 1851, https://doi.org/10.3390/rs13091851.

    • Search Google Scholar
    • Export Citation
  • de Andrade, F. M., C. A. S. Coelho, and I. F. A. Cavalcanti, 2019: Global precipitation hindcast quality assessment of the Subseasonal to Seasonal (S2S) prediction project models. Climate Dyn., 52, 54515475, https://doi.org/10.1007/s00382-018-4457-z.

    • Search Google Scholar
    • Export Citation
  • de Andrade, F. M., M. P. Young, D. MacLeod, L. C. Hirons, S. J. Woolnough, and E. Black, 2021: Subseasonal precipitation prediction for Africa: Forecast evaluation and sources of predictability. Wea. Forecasting, 36, 265284, https://doi.org/10.1175/WAF-D-20-0054.1.

    • Search Google Scholar
    • Export Citation
  • Domeisen, D. I. V., and Coauthors, 2020a: The role of the stratosphere in subseasonal to seasonal prediction: 1. Predictability of the stratosphere. J. Geophys. Res. Atmos., 125, e2019JD030920, https://doi.org/10.1029/2019JD030920.

    • Search Google Scholar
    • Export Citation
  • Domeisen, D. I. V., and Coauthors, 2020b: The role of the stratosphere in subseasonal to seasonal prediction: 2. Predictability arising from stratosphere troposphere coupling. J. Geophys. Res. Atmos., 125, e2019JD030923, https://doi.org/10.1029/2019JD030923.

    • Search Google Scholar
    • Export Citation
  • Gebremichael, M., H. Yue, and V. Nourani, 2022: The accuracy of precipitation forecasts at timescales of 1–15 days in the Volta River Basin. Remote Sens., 14, 937, https://doi.org/10.3390/rs14040937.

    • Search Google Scholar
    • Export Citation
  • Gill, E. C., B. Rajagopalan, and P. Molnar, 2015: Subseasonal variations in spatial signatures of ENSO on the Indian summer monsoon from 1901 to 2009. J. Geophys. Res. Atmos., 120, 81658185, https://doi.org/10.1002/2015JD023184.

    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14, 155167, https://doi.org/10.1175/1520-0434(1999)014<0155:HTFENP>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • He, Z., P. Hsu, X. Liu, T. Wu, and Y. Gao, 2019: Factors limiting the forecast skill of the boreal summer intraseasonal oscillation in a subseasonal-to-seasonal model. Adv. Atmos. Sci., 36, 104118, https://doi.org/10.1007/s00376-018-7242-3.

    • Search Google Scholar
    • Export Citation
  • Hertig, E., and J. Jacobeit, 2013: A novel approach to statistical downscaling considering nonstationarities: Application to daily precipitation in the Mediterranean area. J. Geophys. Res. Atmos., 118, 520533, https://doi.org/10.1002/jgrd.50112.

    • Search Google Scholar
    • Export Citation
  • Hinkley, D. V., 1988: Bootstrap methods. J. Roy. Stat. Soc., 50B, 321337, https://doi.org/10.1111/j.2517-6161.1988.tb01731.x.

  • Hoskins, B., 2013: The potential for skill across the range of the seamless weather-climate prediction problem: A stimulus for our science. Quart. J. Roy. Meteor. Soc., 139, 573584, https://doi.org/10.1002/qj.1991.

    • Search Google Scholar
    • Export Citation
  • Kolachian, R., and B. Saghafian, 2019: Deterministic and probabilistic evaluation of raw and post processed sub-seasonal to seasonal precipitation forecasts in different precipitation regimes. Theor. Appl. Climatol., 137, 14791493, https://doi.org/10.1007/s00704-018-2680-5.

    • Search Google Scholar
    • Export Citation
  • Koster, R. D., and Coauthors, 2010: Contribution of land surface initialization to subseasonal forecast skill: First results from a multi-model experiment. Geophys. Res. Lett., 37, L02402, https://doi.org/10.1029/2009GL041677.

    • Search Google Scholar
    • Export Citation
  • Lang, A. L., K. Pegion, and E. A. Barnes, 2020: Introduction to special collection: “Bridging weather and climate: Subseasonal-to-seasonal (S2S) prediction.” J. Geophys. Res. Atmos., 125, e2019JD031833, https://doi.org/10.1029/2019JD031833.

    • Search Google Scholar
    • Export Citation
  • Li, W., Q. Duan, C. Miao, A. Ye, W. Gong, and Z. Di, 2017: A review on statistical postprocessing methods for hydrometeorological ensemble forecasting. Wiley Interdiscip. Rev.: Water, 4, e1246, https://doi.org/10.1002/wat2.1246.

    • Search Google Scholar
    • Export Citation
  • Li, X., Y. Tang, and X. Song, 2022: Extra predictability from a seamless approach for Asian summer monsoon precipitation from days to weeks. Quart. J. Roy. Meteor. Soc., 148, 24312445, https://doi.org/10.1002/qj.4310.

    • Search Google Scholar
    • Export Citation
  • Li, Y., Z. Wu, H. He, and G. Lu, 2021: Deterministic and probabilistic evaluation of sub-seasonal precipitation forecasts at various spatiotemporal scales over China during the boreal summer monsoon. Atmosphere, 12, 1049, https://doi.org/10.3390/atmos12081049.

    • Search Google Scholar
    • Export Citation
  • Lim, Y., S.-W. Son, and D. Kim, 2018: MJO prediction skill of the subseasonal-to-seasonal prediction models. J. Climate, 31, 40754094, https://doi.org/10.1175/JCLI-D-17-0545.1.

    • Search Google Scholar
    • Export Citation
  • Liu, Y., Q. Duan, L. Zhao, A. Ye, Y. Tao, C. Miao, X. Mu, and J. C. Schaake, 2013: Evaluating the predictive skill of post-processed NCEP GFS ensemble precipitation forecasts in China’s Huai River basin. Hydrol. Processes, 27, 5774, https://doi.org/10.1002/hyp.9496.

    • Search Google Scholar
    • Export Citation
  • Lloyd-Hughes, B., and M. A. Saunders, 2002: Seasonal prediction of European spring precipitation from El Niño–Southern Oscillation and local sea-surface temperatures. Int. J. Climatol., 22, 114, https://doi.org/10.1002/joc.723.

    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130141, https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Ma, R., and X. Yuan, 2023: Subseasonal ensemble prediction of flash droughts over China. J. Hydrometeor., 24, 897910, https://doi.org/10.1175/JHM-D-22-0150.1.

    • Search Google Scholar
    • Export Citation
  • Mariotti, A., P. M. Ruti, and M. Rixen, 2018: Progress in subseasonal to seasonal prediction through a joint weather and climate community effort. npj Climate Atmos. Sci., 1, 4, https://doi.org/10.1038/s41612-018-0014-z.

    • Search Google Scholar
    • Export Citation
  • Mason, I. B., 2003: Binary events. Forecast Verification: A Practitioner’s Guide in Atmospheric Science, I. T. Jolliffe and D. B. Stephenson, Eds., Wiley, 37–76.

  • Meehl, G. A., and Coauthors, 2021: Initialized Earth system prediction from subseasonal to decadal timescales. Nat. Rev. Earth Environ., 2, 340357, https://doi.org/10.1038/s43017-021-00155-x.

    • Search Google Scholar
    • Export Citation
  • Miao, Y., and A. Wang, 2020: A daily 0.25° × 0.25° hydrologically based land surface flux dataset for conterminous China, 1961–2017. J. Hydrol., 590, 125413, https://doi.org/10.1016/j.jhydrol.2020.125413.

    • Search Google Scholar
    • Export Citation
  • Monhart, S., C. Spirig, J. Bhend, K. Bogner, C. Schär, and M. A. Liniger, 2018: Skill of subseasonal forecasts in Europe: Effect of bias correction and downscaling using surface observations. J. Geophys. Res. Atmos., 123, 79998016, https://doi.org/10.1029/2017JD027923.

    • Search Google Scholar
    • Export Citation
  • Mulholland, D. P., P. Laloyaux, K. Haines, and M. A. Balmaseda, 2015: Origin and impact of initialization shocks in coupled atmosphere–ocean forecasts. Mon. Wea. Rev., 143, 46314644, https://doi.org/10.1175/MWR-D-15-0076.1.

    • Search Google Scholar
    • Export Citation
  • National Academies of Sciences, Engineering, and Medicine, 2016: Next Generation Earth System Prediction: Strategies for Subseasonal to Seasonal Forecasts. National Academies Press, 350 pp.

  • Nie, Y., and J. Sun, 2020: Evaluation of high-resolution precipitation products over southwest China. J. Hydrometeor., 21, 26912712, https://doi.org/10.1175/JHM-D-20-0045.1.

    • Search Google Scholar
    • Export Citation
  • Palmer, T. N., F. J. Doblas-Reyes, A. Weisheimer, and M. J. Rodwell, 2008: Toward seamless prediction: Calibration of climate change projections using seasonal forecasts. Bull. Amer. Meteor. Soc., 89, 459470, https://doi.org/10.1175/BAMS-89-4-459.

    • Search Google Scholar
    • Export Citation
  • Pan, B., K. Hsu, A. AghaKouchak, S. Sorooshian, and W. Higgins, 2019: Precipitation prediction skill for the West Coast United States: From short to extended range. J. Climate, 32, 161182, https://doi.org/10.1175/JCLI-D-18-0355.1.

    • Search Google Scholar
    • Export Citation
  • Pegion, K., and Coauthors, 2019: The Subseasonal Experiment (SubX): A multimodel subseasonal prediction experiment. Bull. Amer. Meteor. Soc., 100, 20432060, https://doi.org/10.1175/BAMS-D-18-0270.1.

    • Search Google Scholar
    • Export Citation
  • Peng, D., and T. Zhou, 2017: Why was the arid and semiarid northwest China getting wetter in the recent decades? J. Geophys. Res. Atmos., 122, 90609075, https://doi.org/10.1002/2016JD026424.

    • Search Google Scholar
    • Export Citation
  • Robertson, A., and F. Vitart, 2018: Sub-Seasonal to Seasonal Prediction: The Gap between Weather and Climate Forecasting. Elsevier, 585 pp.

  • Robertson, A. W., A. Kumar, M. Peña, and F. Vitart, 2015: Improving and promoting subseasonal to seasonal prediction. Bull. Amer. Meteor. Soc., 96, ES49ES53, https://doi.org/10.1175/BAMS-D-14-00139.1.

    • Search Google Scholar
    • Export Citation
  • Schaake, J. C., T. M. Hamill, R. Buizza, and M. Clark, 2007: HEPEX: The Hydrological Ensemble Prediction Experiment. Bull. Amer. Meteor. Soc., 88, 15411548, https://doi.org/10.1175/BAMS-88-10-1541.

    • Search Google Scholar
    • Export Citation
  • Schepen, A., Q. J. Wang, and D. E. Robertson, 2019: Application to post-processing of meteorological seasonal forecasting. Handbook of Hydrometeorological Ensemble Forecasting, Q. Duan et al., Eds., Springer, 255–283.

  • Shapiro, M., and Coauthors, 2010: An Earth-system prediction initiative for the twenty-first century. Bull. Amer. Meteor. Soc., 91, 13771388, https://doi.org/10.1175/2010BAMS2944.1.

    • Search Google Scholar
    • Export Citation
  • Short, C. J., and J. Petch, 2022: Reducing the spin-up of a regional NWP system without data assimilation. Quart. J. Roy. Meteor. Soc., 148, 16231643, https://doi.org/10.1002/qj.4268.

    • Search Google Scholar
    • Export Citation
  • Tao, Y., Q. Duan, A. Ye, W. Gong, Z. Di, M. Xiao, and K. Hsu, 2014: An evaluation of post-processed TIGGE multimodel ensemble precipitation forecast in the Huai River basin. J. Hydrol., 519, 28902905, https://doi.org/10.1016/j.jhydrol.2014.04.040.

    • Search Google Scholar
    • Export Citation
  • Vitart, F., 2017: Madden–Julian Oscillation prediction and teleconnections in the S2S database. Quart. J. Roy. Meteor. Soc., 143, 22102220, https://doi.org/10.1002/qj.3079.

    • Search Google Scholar
    • Export Citation
  • Vitart, F., and A. W. Robertson, 2018: The sub-seasonal to seasonal prediction project (S2S) and the prediction of extreme events. npj Climate Atmos. Sci., 1, 3, https://doi.org/10.1038/s41612-018-0013-0.

    • Search Google Scholar
    • Export Citation
  • Vitart, F., A. W. Robertson, and D. L. Anderson, 2012: Subseasonal to seasonal prediction project: Bridging the gap between weather and climate. WMO Bull., 61, 2328.

    • Search Google Scholar
    • Export Citation
  • Vitart, F., and Coauthors, 2017: The Subseasonal to Seasonal (S2S) prediction project database. Bull. Amer. Meteor. Soc., 98, 163173, https://doi.org/10.1175/BAMS-D-16-0017.1.

    • Search Google Scholar
    • Export Citation
  • Wang, C., S. Zhang, F. Zhang, K. Li, and K. Yang, 2021: On the increase of precipitation in the northwestern China under the global warming (in Chinese). Adv. Earth Sci., 36, 980989, https://doi.org/10.11867/j.issn.1001-8166.2021.087.

    • Search Google Scholar
    • Export Citation
  • Wheeler, M. C., H. Zhu, A. H. Sobel, D. Hudson, and F. Vitart, 2017: Seamless precipitation prediction skill comparison between two global models. Quart. J. Roy. Meteor. Soc., 143, 374383, https://doi.org/10.1002/qj.2928.

    • Search Google Scholar
    • Export Citation
  • White, C. J., and Coauthors, 2017: Potential applications of Subseasonal-to-Seasonal (S2S) predictions. Meteor. Appl., 24, 315325, https://doi.org/10.1002/met.1654.

    • Search Google Scholar
    • Export Citation
  • Wu, J., and X.-J. Gao, 2013: A gridded daily observation dataset over China region and comparison with the other datasets (in Chinese). Chin. J. Geophys., 56, 11021111, https://doi.org/10.6038/cjg20130406.

    • Search Google Scholar
    • Export Citation
  • Yang, Y., J. Tang, Z. Xiong, and X. Dong, 2017: Evaluation of high-resolution gridded precipitation data in arid and semiarid regions: Heihe River basin, northwest China. J. Hydrometeor., 18, 30753101, https://doi.org/10.1175/JHM-D-16-0252.1.

    • Search Google Scholar
    • Export Citation
  • Ye, A., Q. Duan, C. Zhan, Z. Liu, and Y. Mao, 2013: Improving kinematic wave routing scheme in community land model. Hydrol. Res., 44, 886903, https://doi.org/10.2166/nh.2012.145.

    • Search Google Scholar
    • Export Citation
  • Zampieri, L., H. F. Goessling, and T. Jung, 2018: Bright prospects for Arctic Sea ice prediction on subseasonal time scales. Geophys. Res. Lett., 45, 97319738, https://doi.org/10.1029/2018GL079394.

    • Search Google Scholar
    • Export Citation
  • Zeng, D., and X. Yuan, 2018: Multiscale land–atmosphere coupling and its application in assessing subseasonal forecasts over East Asia. J. Hydrometeor., 19, 745760, https://doi.org/10.1175/JHM-D-17-0215.1.

    • Search Google Scholar
    • Export Citation
  • Zhang, Z., X. Chen, C.-Y. Xu, L. Yuan, B. Yong, and S. Yan, 2011: Evaluating the non-stationary relationship between precipitation and streamflow in nine major basins of China during the past 50 years. J. Hydrol., 409, 8193, https://doi.org/10.1016/j.jhydrol.2011.07.041.

    • Search Google Scholar
    • Export Citation
  • Zhu, H., M. C. Wheeler, A. H. Sobel, and D. Hudson, 2014: Seamless precipitation prediction skill in the tropics and extratropics from a global model. Mon. Wea. Rev., 142, 15561569, https://doi.org/10.1175/MWR-D-13-00222.1.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 600 598 26
Full Text Views 129 123 2
PDF Downloads 166 162 2