An Automated Technique to Quality Control Radar Reflectivity Data

Valliappa Lakshmanan Cooperative Institute of Mesoscale Meteorological Studies, University of Oklahoma, and National Oceanic and Atmospheric Administration/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Valliappa Lakshmanan in
Current site
Google Scholar
PubMed
Close
,
Angela Fritz Valparaiso University, Valparaiso, Indiana

Search for other papers by Angela Fritz in
Current site
Google Scholar
PubMed
Close
,
Travis Smith Cooperative Institute of Mesoscale Meteorological Studies, University of Oklahoma, and National Oceanic and Atmospheric Administration/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Travis Smith in
Current site
Google Scholar
PubMed
Close
,
Kurt Hondl National Oceanic and Atmospheric Administration/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Kurt Hondl in
Current site
Google Scholar
PubMed
Close
, and
Gregory Stumpf Cooperative Institute of Mesoscale Meteorological Studies, University of Oklahoma, Norman, Oklahoma, and National Weather Service/Meteorological Development Laboratory, Silver Spring, Maryland

Search for other papers by Gregory Stumpf in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

Echoes in radar reflectivity data do not always correspond to precipitating particles. Echoes on radar may result from biological targets such as insects, birds, or wind-borne particles; from anomalous propagation or ground clutter; or from test and interference patterns that inadvertently seep into the final products. Although weather forecasters can usually identify and account for the presence of such contamination, automated weather-radar algorithms are drastically affected. Several horizontal and vertical features have been proposed to discriminate between precipitation echoes and echoes that do not correspond to precipitation. None of these features by themselves can discriminate between precipitating and nonprecipitating areas. In this paper, a neural network is used to combine the individual features, some of which have already been proposed in the literature and some of which are introduced in this paper, into a single discriminator that can distinguish between “good” and “bad” echoes (i.e., precipitation and nonprecipitation, respectively). The method of computing the horizontal features leads to statistical anomalies in their distributions near the edges of echoes. Also described is how to avoid presenting such range gates to the neural network. The gate-by-gate discrimination provided by the neural network is followed by more holistic postprocessing based on spatial contiguity constraints and object identification to yield quality-controlled radar reflectivity scans that have most of the bad echo removed while leaving most of the good echo untouched. A possible multisensor extension, utilizing satellite data and surface observations, to the radar-only technique is also demonstrated. It is demonstrated that the resulting technique is highly skilled and that its skill exceeds that of the currently operational algorithm.

Corresponding author address: V. Lakshmanan, NSSL/RRDD, 120 David L. Boren Blvd., Norman, OK 73071. Email: lakshman@ou.edu

Abstract

Echoes in radar reflectivity data do not always correspond to precipitating particles. Echoes on radar may result from biological targets such as insects, birds, or wind-borne particles; from anomalous propagation or ground clutter; or from test and interference patterns that inadvertently seep into the final products. Although weather forecasters can usually identify and account for the presence of such contamination, automated weather-radar algorithms are drastically affected. Several horizontal and vertical features have been proposed to discriminate between precipitation echoes and echoes that do not correspond to precipitation. None of these features by themselves can discriminate between precipitating and nonprecipitating areas. In this paper, a neural network is used to combine the individual features, some of which have already been proposed in the literature and some of which are introduced in this paper, into a single discriminator that can distinguish between “good” and “bad” echoes (i.e., precipitation and nonprecipitation, respectively). The method of computing the horizontal features leads to statistical anomalies in their distributions near the edges of echoes. Also described is how to avoid presenting such range gates to the neural network. The gate-by-gate discrimination provided by the neural network is followed by more holistic postprocessing based on spatial contiguity constraints and object identification to yield quality-controlled radar reflectivity scans that have most of the bad echo removed while leaving most of the good echo untouched. A possible multisensor extension, utilizing satellite data and surface observations, to the radar-only technique is also demonstrated. It is demonstrated that the resulting technique is highly skilled and that its skill exceeds that of the currently operational algorithm.

Corresponding author address: V. Lakshmanan, NSSL/RRDD, 120 David L. Boren Blvd., Norman, OK 73071. Email: lakshman@ou.edu

Save
  • Bishop, C., 1995: Neural Networks for Pattern Recognition. Oxford University Press, 482 pp.

  • Cornelius, R., R. Gagon, and F. Pratte, 1995: Optimization of WSR-88D clutter processing and AP clutter mitigation. Forecast Systems Laboratory Tech. Rep., 182 pp.

  • Donaldson, R., R. Dyer, and M. Kraus, 1975: An objective evaluator of techniques for predicting severe weather events. Preprints, Ninth Conf. on Severe Local Storms, Norman, OK, Amer. Meteor. Soc., 321–326.

  • Efron, B., and R. Tibshirani, 1997: Improvements on cross-validation: The 632+ bootstrap method. J. Amer. Stat. Assoc., 92 , 548560.

  • Fritz, A., V. Lakshmanan, T. Smith, E. Forren, and B. Clarke, 2006: A validation of radar reflectivity quality control methods. Preprints, 22d Int. Conf. on IIPS for Meteorology, Oceanography and Hydrology, Atlanta, GA, Amer. Meteor. Soc., CD-ROM, 9.10.

  • Fulton, R., D. Breidenback, D. Miller, and T. O’Bannon, 1998: The WSR-88D rainfall algorithm. Wea. Forecasting, 13 , 377395.

  • Grecu, M., and W. Krajewski, 2000: An efficient methodology for detection of anamalous propagation echoes in radar reflectivity data using neural networks. J. Atmos. Oceanic Technol., 17 , 121129.

    • Search Google Scholar
    • Export Citation
  • Greene, D. R., and R. A. Clark, 1972: Vertically integrated liquid water—A new analysis tool. Mon. Wea. Rev., 100 , 548552.

  • Heidke, P., 1926: Berechnung des erfolges und der gute der windstarkvorhersagen im sturmwarnungsdienst (Calculation of the success and the goodness of strong wind forecasts in the storm warning service). Geogr. Ann., 8 , 301349.

    • Search Google Scholar
    • Export Citation
  • Hondl, K., 2002: Current and planned activities for the warning decision support system-integrated information (WDSS-II). Preprints, 21st Conf. on Severe Local Storms, San Antonio, TX, Amer. Meteor. Soc., 146–148.

  • Jain, M., and Coauthors, 1998: Software development of the NEXRAD open systems radar products generator (ORPG). Preprints, 14th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, Phoenix, AZ, Amer. Meteor. Soc., 563–566.

  • Kessinger, C., S. Ellis, and J. Van Andel, 2003: The radar echo classifier: A fuzzy logic algorithm for the WSR-88D. Preprints, Third Conf. on Artificial Applications to the Environmental Sciences, Long Beach, CA, Amer. Meteor. Soc., CD-ROM, P1.6.

  • Krajewski, W., and B. Vignal, 2001: Evaluation of anomalous propagation echo detection in WSR-88D data: A large sample case study. J. Atmos. Oceanic Technol., 18 , 807814.

    • Search Google Scholar
    • Export Citation
  • Krogh, A., and J. Hertz, 1992: A simple weight decay can improve generalization. Advances in Neural Information Processing Systems, J. E. Moody, S. J. Hanson, and R. P. Lippman, Eds., Vol. 4, Morgan Kaufmann, 950–957.

    • Search Google Scholar
    • Export Citation
  • Lakshmanan, V., 2001: A heirarchical, multiscale texture segmentation algorithm for real-world scenes Ph.D. thesis, University of Oklahoma, 115 pp.

  • Lakshmanan, V., and M. Valente, 2004: Quality control of radar reflectivity data using satellite data and surface observations. Preprints, 20th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, Seattle, WA, Amer. Meteor. Soc., CD–ROM, 12.2.

  • Lakshmanan, V., R. Rabin, and V. DeBrunner, 2003: Multiscale storm identification and forecast. J. Atmos. Res., 67 , 367380.

  • Lakshmanan, V., T. Smith, K. Hondl, G. J. Stumpf, and A. Witt, 2006: A real-time, three dimensional, rapidly updating, heterogeneous radar merger technique for reflectivity, velocity and derived products. Wea. Forecasting, 21 , 802823.

    • Search Google Scholar
    • Export Citation
  • Lynn, R., and V. Lakshmanan, 2002: Virtual radar volumes: Creation, algorithm access and visualization. Preprints, 21st Conf. on Severe Local Storms, San Antonio, TX, Amer. Meteor. Soc., CD-ROM, P5.3.

  • MacKay, D. J. C., 1992: A practical Bayesian framework for backprop networks. Advances in Neural Information Processing Systems, J. E. Moody, S. J. Hanson, and R. P. Lippmann, Eds., Vol. 4, Morgan Kaufmann, 839–846.

    • Search Google Scholar
    • Export Citation
  • Marzban, C., and G. Stumpf, 1996: A neural network for tornado prediction based on Doppler radar-derived attributes. J. Appl. Meteor., 35 , 617626.

    • Search Google Scholar
    • Export Citation
  • Masters, T., 1993: Practical Neural Network Recipes in C++. Morgan Kaufmann, 493 pp.

  • Mazur, R. J., V. Lakshmanan, and G. J. Stumpf, 2004: Quality control of radar data to improve mesocyclone detection. Preprints, 20th Int. Conf. on IIPS for Meteorology, Oceanography, and Hydrology, Seattle, WA, Amer. Meteor. Soc, CD–ROM, P1.2.

  • McGrath, K., T. Jones, and J. Snow, 2002: Increasing the usefulness of a mesocyclone climatology. Preprints, 21st Conf. on Severe Local Storms, San Antonio, TX, Amer. Meteor. Soc., CD-ROM, 5.4.

  • O’Bannon, T., 1997: Using a terrain-based hybrid scan to improve WSR-88D precipitation estimates. Preprints, 28th Conf. on Radar Meteorology, Austin, TX, Amer. Meteor. Soc, 506–507.

  • Pamment, J., and B. Conway, 1998: Objective identification of echoes due to anomalous propagation in weather radar data. J. Atmos. Oceanic Technol., 15 , 98113.

    • Search Google Scholar
    • Export Citation
  • Riedmiller, M., and H. Braun, 1993: A direct adaptive method for faster backpropagation learning: The RPROP algorithm. Proc. IEEE Conf. on Neural Networks, San Francisco, CA, IEEE, 586–591.

  • Robinson, M., M. Steiner, D. Wolff, C. Kessinger, and R. Fulton, 2001: Radar data quality control: Evaluation of several algorithms based on accumulating rainfall statistics. Preprints, 30th Int. Conf. on Radar Meteorology, Munich, Germany, Amer. Meteor. Soc., 274–276.

  • Steiner, M., and J. Smith, 2002: Use of three-dimensional reflectivity structure for automated detection and removal of nonprecipitating echoes in radar data. J. Atmos. Oceanic Technol., 19 , 673686.

    • Search Google Scholar
    • Export Citation
  • Stumpf, G., A. Witt, E. D. Mitchell, P. Spencer, J. Johnson, M. Eilts, K. Thomas, and D. Burgess, 1998: The National Severe Storms Laboratory mesocyclone detection algorithm for the WSR-88D. Wea. Forecasting, 13 , 304326.

    • Search Google Scholar
    • Export Citation
  • Venkatesan, C., S. Raskar, S. Tambe, B. Kulkarni, and R. Keshavamurty, 1997: Prediction of all India summer monsoon rainfall using error-back-propagation neural networks. Meteor. Atmos. Phys., 62 , 225240.

    • Search Google Scholar
    • Export Citation
  • Zhang, J., S. Wang, and B. Clarke, 2004: WSR-88D reflectivity quality control using horizontal and vertical reflectivity structure. Preprints, 11th Conf. on Aviation, Range and Aerospace Meteorology, Hyannis, MA, Amer. Meteor. Soc, CD-ROM, P5.4.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1844 830 437
PDF Downloads 900 189 9