Using Citizen Science Reports to Evaluate Estimates of Surface Precipitation Type

Sheng Chen Advanced Radar Research Center, National Weather Center, and School of Civil Engineering and Environmental Science, University of Oklahoma, Norman, Oklahoma

Search for other papers by Sheng Chen in
Current site
Google Scholar
PubMed
Close
,
Jonathan J. Gourley NOAA/National Severe Storms Laboratory, and School of Meteorology, University of Oklahoma, Norman, Oklahoma

Search for other papers by Jonathan J. Gourley in
Current site
Google Scholar
PubMed
Close
,
Yang Hong Advanced Radar Research Center, National Weather Center, and School of Civil Engineering and Environmental Science, University of Oklahoma, Norman, Oklahoma

Search for other papers by Yang Hong in
Current site
Google Scholar
PubMed
Close
,
Qing Cao Research and Innovation, Enterprise Electronics Corporation, Enterprise, Alabama

Search for other papers by Qing Cao in
Current site
Google Scholar
PubMed
Close
,
Nicholas Carr Advanced Radar Research Center, National Weather Center, and School of Meteorology, University of Oklahoma, Norman, Oklahoma

Search for other papers by Nicholas Carr in
Current site
Google Scholar
PubMed
Close
,
Pierre-Emmanuel Kirstetter Advanced Radar Research Center, National Weather Center, and NOAA/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Pierre-Emmanuel Kirstetter in
Current site
Google Scholar
PubMed
Close
,
Jian Zhang NOAA/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Jian Zhang in
Current site
Google Scholar
PubMed
Close
, and
Zac Flamig Cooperative Institute for Mesoscale Meteorological Studies, University of Oklahoma, Advanced Radar Research Center, National Weather Center, and NOAA/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Zac Flamig in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

In meteorological investigations, the reference variable or “ground truth” typically comes from an instrument. This study uses human observations of surface precipitation types to evaluate the same variables that are estimated from an automated algorithm. The NOAA/National Severe Storms Laboratory’s Multi-Radar Multi-Sensor (MRMS) system relies primarily on observations from the Next Generation Radar (NEXRAD) network and model analyses from the Earth System Research Laboratory’s Rapid Refresh (RAP) system. Each hour, MRMS yields quantitative precipitation estimates and surface precipitation types as rain or snow. To date, the surface precipitation type product has received little attention beyond case studies. This study uses precipitation type reports collected by citizen scientists who have contributed observations to the meteorological Phenomena Identification Near the Ground (mPING) project. Citizen scientist reports of rain and snow during the winter season from 19 December 2012 to 30 April 2013 across the United States are compared to the MRMS precipitation type products. Results show that while the mPING reports have a limited spatial distribution (they are concentrated in urban areas), they yield similar critical success indexes of MRMS precipitation types in different cities. The remaining disagreement is attributed to an MRMS algorithmic deficiency of yielding too much rain, as opposed to biases in the mPING reports. The study also shows reduced detectability of snow compared to rain, which is attributed to lack of sensitivity at S band and the shallow nature of winter storms. Some suggestions are provided for improving the MRMS precipitation type algorithm based on these findings.

CORRESPONDING AUTHOR: Jonathan J. Gourley, National Weather Center, 120 David L. Boren Blvd., Norman, OK 73072, E-mail: jj.gourley@noaa.gov

Abstract

In meteorological investigations, the reference variable or “ground truth” typically comes from an instrument. This study uses human observations of surface precipitation types to evaluate the same variables that are estimated from an automated algorithm. The NOAA/National Severe Storms Laboratory’s Multi-Radar Multi-Sensor (MRMS) system relies primarily on observations from the Next Generation Radar (NEXRAD) network and model analyses from the Earth System Research Laboratory’s Rapid Refresh (RAP) system. Each hour, MRMS yields quantitative precipitation estimates and surface precipitation types as rain or snow. To date, the surface precipitation type product has received little attention beyond case studies. This study uses precipitation type reports collected by citizen scientists who have contributed observations to the meteorological Phenomena Identification Near the Ground (mPING) project. Citizen scientist reports of rain and snow during the winter season from 19 December 2012 to 30 April 2013 across the United States are compared to the MRMS precipitation type products. Results show that while the mPING reports have a limited spatial distribution (they are concentrated in urban areas), they yield similar critical success indexes of MRMS precipitation types in different cities. The remaining disagreement is attributed to an MRMS algorithmic deficiency of yielding too much rain, as opposed to biases in the mPING reports. The study also shows reduced detectability of snow compared to rain, which is attributed to lack of sensitivity at S band and the shallow nature of winter storms. Some suggestions are provided for improving the MRMS precipitation type algorithm based on these findings.

CORRESPONDING AUTHOR: Jonathan J. Gourley, National Weather Center, 120 David L. Boren Blvd., Norman, OK 73072, E-mail: jj.gourley@noaa.gov
Save
  • Elmore, K. L., Z. L. Flamig, V. Lakshmanan, B. T. Kaney, V. Farmer, H. D. Reeves, and L. P. Rothfusz, 2014: mPING: Crowd-sourcing weather reports for research. Bull. Amer. Meteor. Soc., 95, 13351342, doi:10.1175/BAMS-D-13-00014.1.

    • Search Google Scholar
    • Export Citation
  • Hou, A. Y., and Coauthors, 2014: The Global Precipitation Measurement Mission. Bull. Amer. Meteor. Soc., 95, 701722, doi:10.1175/BAMS-D-13-00164.1.

    • Search Google Scholar
    • Export Citation
  • Kirstetter, P.-E., and Coauthors, 2012: Toward a framework for systematic error modeling of spaceborne precipitation radar with NOAA/NSSL ground radar-based National Mosaic QPE. J. Hydrometeor., 13, 12851300, doi:10.1175/JHM-D-11-0139.1.

    • Search Google Scholar
    • Export Citation
  • Park, H., A. V. Ryzhkov, D. S. Zrnić, and K.-E. Kim, 2009: The hydrometeor classification and algorithm for the polarimetric WSR-88D: Description and application to an MCS. Wea. Forecasting, 24, 730748, doi:10.1175/2008WAF2222205.1.

    • Search Google Scholar
    • Export Citation
  • Zhang, J. K. Howard, and Coauthors, 2011: National Mosaic and Multi-Sensor QPE (NMQ) system: Description, results, and future plans. Bull. Amer. Meteor. Soc., 92, 13211338, doi:10.1175/2011BAMS-D-11-00047.1.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 4593 4098 73
PDF Downloads 392 75 5