A Neural Network Quality-Control Scheme for Improved Quantitative Precipitation Estimation Accuracy on the U.K. Weather Radar Network

Nawal Husnoo aMet Office, Exeter, United Kingdom

Search for other papers by Nawal Husnoo in
Current site
Google Scholar
PubMed
Close
,
Timothy Darlington aMet Office, Exeter, United Kingdom

Search for other papers by Timothy Darlington in
Current site
Google Scholar
PubMed
Close
,
Sebastián Torres bCooperative Institute for Mesoscale Meteorological Studies, University of Oklahoma, and NOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Sebastián Torres in
Current site
Google Scholar
PubMed
Close
, and
David Warde bCooperative Institute for Mesoscale Meteorological Studies, University of Oklahoma, and NOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by David Warde in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

In this work, we present a new quantitative precipitation estimation (QPE) quality-control (QC) algorithm for the U.K. weather radar network. The real-time adaptive algorithm uses a neural network (NN) to select data from the lowest useable elevation scan to optimize the combined performance of two other radar data correction algorithms: ground-clutter mitigation [using Clutter Environment Analysis using Adaptive Processing (CLEAN-AP)] and vertical profile of reflectivity (VPR) correction. The NN is trained using 3D tiles of observed uncontaminated weather signals that are systematically combined with ground-clutter signals collected under dry weather conditions. This approach provides a way to simulate radar signals with a wide range of clutter contamination conditions and with realistic spatial structures while providing the uncontaminated “truth” with respect to which the performance of the QC algorithm can be measured. An evaluation of QPE products obtained with the proposed QC algorithm demonstrates superior performance as compared to those obtained with the QC algorithm currently used in operations. Similar improvements are also illustrated using radar observations from two periods of prolonged precipitation, showing a better balance between overestimation errors from using clutter-contaminated low-elevation radar data and VPR-induced errors from using high-elevation radar data.

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Nawal Husnoo, nawal.husnoo@metoffice.gov.uk

Abstract

In this work, we present a new quantitative precipitation estimation (QPE) quality-control (QC) algorithm for the U.K. weather radar network. The real-time adaptive algorithm uses a neural network (NN) to select data from the lowest useable elevation scan to optimize the combined performance of two other radar data correction algorithms: ground-clutter mitigation [using Clutter Environment Analysis using Adaptive Processing (CLEAN-AP)] and vertical profile of reflectivity (VPR) correction. The NN is trained using 3D tiles of observed uncontaminated weather signals that are systematically combined with ground-clutter signals collected under dry weather conditions. This approach provides a way to simulate radar signals with a wide range of clutter contamination conditions and with realistic spatial structures while providing the uncontaminated “truth” with respect to which the performance of the QC algorithm can be measured. An evaluation of QPE products obtained with the proposed QC algorithm demonstrates superior performance as compared to those obtained with the QC algorithm currently used in operations. Similar improvements are also illustrated using radar observations from two periods of prolonged precipitation, showing a better balance between overestimation errors from using clutter-contaminated low-elevation radar data and VPR-induced errors from using high-elevation radar data.

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Nawal Husnoo, nawal.husnoo@metoffice.gov.uk
Save
  • Caruana, R., and A. Niculescu-Mizil, 2006: An empirical comparison of supervised learning algorithms. 23rd Int. Conf. on Machine Learning, New York, NY, Association for Computing Machinery, 161–168, https://doi.org/10.1145/1143844.1143865.

    • Crossref
    • Export Citation
  • Caruana, R., N. Karampatziakis, and A. Yessenalina, 2008: An empirical evaluation of supervised learning in high dimensions. 25th Int. Conf. on Machine Learning, New York, NY, Association for Computing Machinery, 96–103, https://doi.org/10.1145/1390156.1390169.

    • Crossref
    • Export Citation
  • Chollet, F., and Coauthors, 2015: Keras. Keras, https://keras.io.

  • Derrien, M., and H. L. Gleau, 2005: MSG/SEVIRI cloud mask and type from SAFNWC. Int. J. Remote Sens., 26, 47074732, https://doi.org/10.1080/01431160500166128.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Figueras i Ventura, J., A.-A. Boumahmoud, B. Fradon, P. Dupuy, and P. Tabary, 2012: Long-term monitoring of French polarimetric radar data quality and evaluation of several polarimetric quantitative precipitation estimators in ideal conditions for operational implementation at C-band. Quart. J. Roy. Meteor. Soc., 138, 22122228, https://doi.org/10.1002/qj.1934.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Friedrich, K., U. Germann, and P. Tabary, 2009: Influence of ground clutter contamination on polarimetric radar parameters. J. Atmos. Oceanic Tech., 26, 251269, https://doi.org/10.1175/2008JTECHA1092.1.

    • Search Google Scholar
    • Export Citation
  • Glorot, X., and Y. Bengio, 2010: Understanding the difficulty of training deep feedforward neural networks. 13th Int. Conf. on Artifical Intelligence and Statistics, Sardinia, Italy, PMLR, 249–256, http://proceedings.mlr.press/v9/glorot10a.html.

  • Golding, B., 1998: Nimrod: A system for generating automated very short range forecasts. Meteor. Appl., 5, 116, https://doi.org/10.1017/S1350482798000577.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Harrison, D. L., R. W. Scovell, and M. Kitchen, 2009: High-resolution precipitation estimates for hydrological uses. Proc. Inst. Civil Eng. Water Manage., 162, 125135, https://doi.org/10.1680/wama.2009.162.2.125.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Harrison, D. L., K. Norman, C. Pierce, and N. Gaussiat, 2012: Radar products for hydrological applications in the UK. Proc. Inst. Civil Eng. Water Manage., 165, 89103, https://doi.org/10.1680/wama.2012.165.2.89.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Harrison, D. L., K. Norman, T. Darlington, D. Adams, N. Husnoo, C. Sandford, and S. Best, 2015: The evolution of the Met Office radar data quality control and product generation system: Radarnet. 37th Conf. on Radar Meteorology, Norman, OK, Amer. Meteor. Soc., 14B.2, https://ams.confex.com/ams/37RADAR/webprogram/Paper275684.html.

  • Hornik, K., 1991: Approximation capabilities of multilayer feedforward networks. Neural Networks, 4, 251257, https://doi.org/10.1016/0893-6080(91)90009-T.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hubbert, J. C., M. Dixon, S. M. Ellis, and G. Meymaris, 2009a: Weather radar ground clutter. Part I: Identification, modeling, and simulation. J. Atmos. Oceanic Technol., 26, 11651180, https://doi.org/10.1175/2009JTECHA1159.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hubbert, J. C., M. Dixon, and S. M. Ellis, 2009b: Weather radar ground clutter. Part II: Real-time identification and filtering. J. Atmos. Oceanic Technol., 26, 11811197, https://doi.org/10.1175/2009JTECHA1160.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Illingworth, A., 2004: Improved precipitation rates and data quality by using polarimetric measurements. Weather Radar Principles and Advanced Applications, P. Meischner, Ed., Springer-Verlag, 130–166, https://doi.org/10.1007/978-3-662-05202-0_5.

    • Crossref
    • Export Citation
  • Jacobs, N. A., T. Gallaudet, S. Volz, N. LeBoeuf, C. McLean, L. W. Uccellini, C. Oliver, and M. J. Silah, 2020: NOAA artificial intelligence strategy: Analytics for next-generation Earth science. NOAA Rep., 8 pp., https://sciencecouncil.noaa.gov/Portals/0/2020%20AI%20Strategy.pdf.

  • Keat, W. J., C. D. Westbrook, and A. J. Illingworth, 2016: High-precision measurements of the copolar correlation coefficient: Non-Gaussian errors and retrieval of the dispersion parameter in rainfall. J. Appl. Meteor. Climatol., 55, 16151632, https://doi.org/10.1175/JAMC-D-15-0272.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Keeler, R. J., and R. E. Passarelli, 1990: Signal processing for atmospheric radars. Radar in Meteorology, Amer. Meteor. Soc., 199–229, https://doi.org/10.1007/978-1-935704-15-7_21.

    • Crossref
    • Export Citation
  • Kitchen, M., R. Brown, and A. G. Davies, 1994: Real-time correction of weather radar data for the effects of bright band, range and orographic growth in widespread precipitation. Quart. J. Roy. Meteor. Soc., 120, 12311254, https://doi.org/10.1002/qj.49712051906.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lakshmanan, V., A. Fritz, T. Smith, K. Hondl, and G. Stumpf, 2007: An automated technique to quality control radar reflectivity data. J. Appl. Meteor. Climatol., 46, 288305, https://doi.org/10.1175/JAM2460.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Moisseev, D. N., and V. Chandrasekar, 2009: Polarimetric spectral filter for adaptive clutter and noise suppression. J. Atmos. Oceanic Technol., 26, 215228, https://doi.org/10.1175/2008JTECHA1119.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Pamment, J. A., and B. J. Conway, 1998: Objective identification of echoes due to anomalous propagation in weather radar data. J. Atmos. Oceanic Tech., 15, 98113, https://doi.org/10.1175/1520-0426(1998)015<0098:OIOEDT>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Passarelli, R. E., and D. S. Zrnić, 1989: An expression for phase noise. Preprints, 24th Conf. on Radar Meteorology, Tallahassee, FL, Amer. Metero. Soc., 433–435.

  • Rico-Ramirez, M., and I. Cluckie, 2008: Classification of ground clutter and anomalous propagation using dual-polarization weather radar. IEEE Trans. Geosci. Remote Sens., 46, 18921904, https://doi.org/10.1109/TGRS.2008.916979.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Tang, J., and C. J. Matyas, 2017: Machine learning method of weather radar data quality control using Python and PySpark. Seventh Symp. on Advances in Modeling and Analysis Using Python, Seattle, WA, Amer. Meteor. Soc., 4.5, https://ams.confex.com/ams/97Annual/webprogram/Paper309674.html.

  • Thorndahl, S., T. Einfalt, P. Willems, J. E. Nielsen, M.-C. ten Veldhuis, K. Arnbjerg-Nielsen, M. R. Rasmussen, and P. Molnar, 2017: Weather radar rainfall data in urban hydrology. Hydrol. Earth Syst. Sci., 21, 13591380, https://doi.org/10.5194/hess-21-1359-2017.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Torres, S. M., and D. A. Warde, 2014: Ground clutter mitigation for weather radars using the autocorrelation spectral density. J. Atmos. Oceanic Tech., 31, 20492066, https://doi.org/10.1175/JTECH-D-13-00117.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Warde, D., and S. Torres, 2014: The autocorrelation spectral density for Doppler-weather-radar signal analysis. IEEE Trans. Geosci. Remote Sens., 52, 508518, https://doi.org/10.1109/TGRS.2013.2241775.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Warde, D., and S. Torres, 2015: Minimizing the impact of ground-clutter filtering along the zero-isodop in polarimetric doppler weather radars. 31st Conf. on Environmental Information Processing Technologies, Phoenix, AZ, Amer. Meteor. Soc., P11-5, https://ams.confex.com/ams/95Annual/webprogram/Paper267106.html.

  • Wu, W., D. Kitzmiller, and S. Wu, 2012: Evaluation of radar precipitation estimates from the national mosaic and multisensor quantitative precipitation estimation system and the WSR-88D precipitation processing system over the conterminous United States. J. Hydrometeor., 13, 10801093, https://doi.org/10.1175/JHM-D-11-064.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 203 0 0
Full Text Views 2284 1618 133
PDF Downloads 1000 262 31