1. Introduction
A significant challenge in radar-derived quantitative precipitation estimation (QPE) is separating precipitation from nonprecipitation (NP) radar returns. NP echoes include electromagnetic interferences (EI) from man-made telecommunication transmitters and sun spikes (SS); ground clutter from anomalous propagation (AP) of the radar beam due to specific atmospheric temperatures and/or moisture gradients (Grecu and Krajewski 2000); biological scatterers (birds, bats, and insects) (Lakshmanan et al. 2010); ground clutter from surface structures, such as towers and buildings (Bachmann and Tracy 2009); and sea clutter (Gray and Larsen 2005). An effective quality control (QC) of radar reflectivity (Z) fields is critical in assuring realistic depiction of storm structure and accurate precipitation estimation from the radar data.
Before polarimetric radar techniques became widely available, heuristic rule–based (e.g., Zhang et al. 2004) and neural network–based [quality control neural network (QCNN)] (e.g., Lakshmanan et al. 2007, 2010) reflectivity QC techniques using Z, radial velocity V, spectrum width συ, and atmospheric environmental data were developed to segregate precipitation and nonprecipitation (P–NP) echoes. These techniques can remove a significant amount of NP returns under various scenarios. However, nocturnal biological echoes (“blooms”) during the peak of bird migration seasons, spring and fall, remained a major issue, especially when they are connected with precipitation echoes. On the other hand, light rain and snow echoes were sometimes removed as a result of the techniques trying to minimize bloom echoes. Manual QC on radar reflectivity field has been practiced at commercial weather companies and in operations such as the National Weather Service River Forecast Centers (http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/stage4/). However, manual QC is an expensive resource and prohibitive for timely warnings of severe weather and flash floods. An automated approach is still desirable for real-time applications.
The polarimetric upgrade of the U.S. Weather Surveillance Radar-1988 Doppler (WSR-88D) network opened a new era for the radar data applications in many disciplines (Kumjian 2013b). With the upgrade, new variables of differential reflectivity ZDR, differential phase ΦDP and specific differential phase KDP, and correlation coefficient
Lakshmanan et al. (2013) developed a dual-polarization (dp) radar reflectivity quality control using a neural network approach (dpQCNN) to segregate NP from precipitation echoes. With inputs of the six variables (Z, V, συ,
It is commonly recognized that the correlation coefficient
The dpQC is a physically based scheme that applies a set of explicit meteorological principles according to
The rest of this paper is organized as follows. Section 2 provides a detailed description of the dpQC methodology, and section 3 presents case study results and discussions. Conclusions and remarks are given in section 4.
2. Methodology
Figure 2 shows an overview flowchart of the dpQC algorithm, which consists of seven steps, including 1) a basic
a. The basic filter
It is commonly known that pure rain and pure snow are associated with high ρHV values close to 1 and that NP scatterers generally produce low
Figure 4 shows normalized histograms of
b. Hail and NBF
Low
If a strong reflectivity echo (>45 dBZ) is associated with a
c. The ML
If a real ML is found, then the ML boundaries in a radial are determined by searching for the significant radial gradients of
Figure 6 shows an example of the ML lineation during a winter precipitation event, where a black circle indicates the relatively low
d. The texture filter
The
e. The spike filter
While most SS and EI echoes are associated with low
f. Vertical gradient and horizontal smoothness checks
The vertical gradient check handles AP ground clutter and clear-air echoes around the radar. Some AP echoes are associated with
Clear-air echoes are sometimes associated with unrealistic high
g. The speckle filter and hole filling
This step performs two tasks: removing clear-air echoes of minor size and filling in small voids in precipitation regions. If the residual echoes of 10 dBZ or higher in the whole volume scan accumulate to less than 10 km2 in size, then the whole volume scan is assigned missing reflectivity. This process effectively cleans up clear-air pixels with biased high
3. Evaluations of dpQC
List of cases used for the development and tuning of dpQC. BI: biological clutter; WF: wind farm; GC: ground clutter.
Testing cases for evaluating the QC algorithm.
The dpQC algorithm has been implemented in the MRMS system (Zhang et al. 2014) to process 146 WSR-88D since 5 December 2012. While computationally efficient, the dpQC scheme has been very effective in removing biological and other NP echoes and retaining light precipitation. Figure 9 shows example CREF mosaic fields from the real-time MRMS system before and after the dpQC. The raw CREF image (Fig. 9a) showed large areas of blooms because it was late night (~0330 local time) during the peak bird migration season (early October). The dpQCNN was able to remove the majority of the blooms, although some blooms connected with the precipitation were left in (red circles in Fig. 9b). Meanwhile a light rain near the KDMX radar (white circle in Fig. 9b) was removed. This may be an indication that the relative weights given to the reflectivity and
The dpQC scheme has been evaluated on a daily basis for over a year in the real-time MRMS system, and its performance was found to be very satisfactory. A few minor issues remain, though. Because of the difference in the maximum ranges of
4. Conclusions
A physically based P–NP echo classifier was developed using polarimetric radar variables and atmospheric environmental data. The algorithm applied a set of explicit meteorological principles that segregate P–NP echoes in the radar reflectivity field based on the correlation coefficient, 3D reflectivity, and temperature structure. The new algorithm was evaluated using 16 independent events and showed a high accuracy (HSS of 0.83) in segregating P–NP echoes. When compared with a more complex QC algorithm that uses all polarimetric variables and a neural network approach, the dpQC showed a similar HSS (0.83 vs 0.80), but with a significantly higher computational efficiency (3.15 vs 17.76s in CPU time usage and 83 vs 199 MB in RAM usage for processing a volume scan of data). Because of its computational efficiency and transparency of the algorithm, the dpQC is easy to implement and to maintain for large radar networks in a real-time environment.
Acknowledgments
Funding for this research was partially provided under the agreement between the National Oceanic and Atmospheric Administration (NOAA) and the Federal Aviation Administration's Aviation Weather Research Program, and partially provided by NOAA/Office of Oceanic and Atmospheric Research under NOAA-University of Oklahoma Cooperative Agreement NA11OAR4320072, U.S. Department of Commerce. The authors thank Dr. Alexander Ryzhkov and Dr. Yadong Wang for their comments. We would also like to express our appreciation to three anonymous reviewers for their helpful suggestions.
REFERENCES
Andrić, J., Kumjian M. R. , Zrnić D. S. , Straka J. M. , and Melnikov V. M. , 2013: Polarimetric signatures above the melting layer in winter storms: An observational and modeling study. J. Appl. Meteor. Climatol., 52, 682–700, doi:10.1175/JAMC-D-12-028.1.
Bachmann, S. M., and Tracy M. D. , 2009: Data driven adaptive identification and suppression of ground clutter for weather radar. 25th Conf. on Int. Interactive Information and Processing Systems (IIPS) for Meteorology, Oceanography, and Hydrology, Phoenix, AZ, Amer. Meteor. Soc., 11B.3. [Available online at https://ams.confex.com/ams/89annual/techprogram/paper_146356.htm.]
Balakrishnan, N., and Zrnić D. S. , 1990: Use of polarization to characterize precipitation and discriminate large hail. J. Atmos. Sci., 47, 1525–1540, doi:10.1175/1520-0469(1990)047<1525:UOPTCP>2.0.CO;2.
Berkowitz, D. S., Schultz J. A. , Vasiloff S. , Elmore K. L. , Payne C. D. , and Boettcher J. B. , 2013: Status of dual pol QPE in the WSR-88D network. 27th Conf. on Hydrology, Austin, TX, Amer. Meteor. Soc., 2.2. [Available online at https://ams.confex.com/ams/93Annual/webprogram/Paper221525.html.]
Brandes, E. A., and Ikeda K. , 2004: Freezing-level estimation with polarimetric radar. J. Appl. Meteor. Climatol., 43, 1541–1553, doi:10.1175/JAM2155.1.
Doviak, R. J., and Zrnić D. S. , 1993: Doppler Radar and Weather Observations. Academic Press, 562 pp.
Fabry, F., and Zawadzki I. , 1995: Long-term radar observations of the melting layer of precipitation and their interpretation. J. Atmos. Sci., 52, 838–851, doi:10.1175/1520-0469(1995)052<0838:LTROOT>2.0.CO;2.
Giangrande, S. E., Krause J. M. , and Ryzhkov A. V. , 2008: Automatic designation of the melting layer with a polarimetric prototype of the WSR-88D radar. J. Appl. Meteor. Climatol., 47, 1354–1364, doi:10.1175/2007JAMC1634.1.
Gourley, J. J., and Calvert C. M. , 2003: Automated detection of the bright band using WSR-88D data. Wea. Forecasting, 18, 585–599, doi:10.1175/1520-0434(2003)018<0585:ADOTBB>2.0.CO;2.
Gourley, J. J., Tabary P. , and Parent-du-Chatelet J. , 2007: A fuzzy logic algorithm for the separation of precipitating from nonprecipitating echoes using polarimetric radar observations. J. Atmos. Oceanic Technol., 24, 1439–1451, doi:10.1175/JTECH2035.1.
Gray, W., and Larsen H. , 2005: Radar rainfall estimation in the New Zealand context. Atmos. Sci. Lett., 6, 31–34, doi:10.1002/asl.87.
Grecu, M., and Krajewski W. F. , 2000: An efficient methodology for detection of anomalous propagation echoes in radar reflectivity data using neural networks. J. Atmos. Oceanic Technol., 17, 121–129, doi:10.1175/1520-0426(2000)017<0121:AEMFDO>2.0.CO;2.
Ivić, I. R., and Melnikov V. , 2013: Multi-lag hybrid correlation coefficient estimator. 36th Conf. on Radar Meteorology, Breckenridge, CO, Amer. Meteor. Soc., 248. [Available online at https://ams.confex.com/ams/36Radar/webprogram/Paper228447.html.]
Kumjian, M. R., 2013a: Principles and applications of dual-polarization weather radar. Part I: Description of the polarimetric radar variables. J. Oper. Meteor., 1, 226–242, doi:10.15191/nwajom.2013.0119.
Kumjian, M. R., 2013b: Principles and applications of dual-polarization weather radar. Part II: Warm- and cold-season applications. J. Oper. Meteor., 1, 243–264, doi:10.15191/nwajom.2013.0120.
Kumjian, M. R., 2013c: Principles and applications of dual-polarization weather radar. Part III: Artifacts. J. Oper. Meteor., 1, 265–274, doi:10.15191/nwajom.2013.0121.
Lakshmanan, V., Fritz A. , Smith T. , Hondl K. , and Stumpf G. J. , 2007: An automated technique to quality control radar reflectivity data. J. Appl. Meteor. Climatol., 46, 288–305, doi:10.1175/JAM2460.1.
Lakshmanan, V., Zhang J. , and Howard K. , 2010: A technique to censor biological echoes in weather radar images. J. Appl. Meteor. Climatol., 49, 453–462, doi:10.1175/2009JAMC2255.1.
Lakshmanan, V., Christopher C. , Krause J. , and Tang L. , 2013: Quality control of weather radar data using polarimetric variables. J. Atmos. Oceanic Technol., 31, 1234–1249, doi:10.1175/JTECH-D-13-00073.1.
Lim, S., Chandrasekar V. , and Bringi V. N. , 2005: Hydrometeor classification system using dual-polarization radar measurements: Model improvements and in situ verification. IEEE Trans. Geosci. Remote Sens., 43, 792–801, doi:10.1109/TGRS.2004.843077.
Liu, H., and Chandrasekar V. , 2000: Classification of hydrometeors based on polarimetric radar measurements: Development of fuzzy logic and neuro-fuzzy systems, and in situ verification. J. Atmos. Oceanic Technol., 17, 140–164, doi:10.1175/1520-0426(2000)017<0140:COHBOP>2.0.CO;2.
Marzano, F. S., Scaranari D. , Montopoli M. , and Vulpiani G. , 2008: Supervised classification and estimation of hydrometeors from C-band dual-polarized radars: A Bayesian approach. IEEE Trans. Geosci. Remote Sens., 46, 85–98, doi:10.1109/TGRS.2007.906476.
Melnikov, V. M., and Zrnić D. S. , 2007: Autocorrelation and cross-correlation estimators of polarimetric variables. J. Atmos. Oceanic Technol., 24, 1337–1350, doi:10.1175/JTECH2054.1.
Park, H. S., Ryzhkov A. V. , Zrnić D. S. , and Kim K.-E. , 2009: The hydrometeor classification algorithm for the polarimetric WSR-88D: Description and application to an MCS. Wea. Forecasting, 24, 730–748, doi:10.1175/2008WAF2222205.1.
Ryzhkov, A. V., 2007: The impact of beam broadening on the quality of radar polarimetric data. J. Atmos. Oceanic Technol., 24, 729–744, doi:10.1175/JTECH2003.1.
Ryzhkov, A. V., Schuur T. J. , Burgess D. W. , Giangrande S. E. , and Zrnić D. S. , 2005: The Joint Polarization Experiment: Polarimetric rainfall measurements and hydrometeor classification. Bull. Amer. Meteor. Soc., 86, 809–824, doi:10.1175/BAMS-86-6-809.
Ryzhkov, A. V., Kumjian M. R. , and Ganson S. M. , 2013a: Polarimetric radar characteristics of melting hail. Part I: Theoretical simulations using spectral microphysical modeling. J. Appl. Meteor. Climatol., 52, 2849–2870, doi:10.1175/JAMC-D-13-073.1.
Ryzhkov, A. V., Kumjian M. R. , Ganson S. M. , and Zhang P. , 2013b: Polarimetric radar characteristics of melting hail. Part II: Practical implications. J. Appl. Meteor. Climatol., 52, 2871–2886, doi:10.1175/JAMC-D-13-074.1.
Straka, J. M., and Zrnić D. S. , 1993: An algorithm to deduce hydrometeor types and contents from multiparameter radar data. Preprints, 26th Int. Conf. on Radar Meteorology, Norman, OK, Amer. Meteor. Soc., 513–516.
Straka, J. M., Zrnić D. S. , and Ryzhkov A. V. , 2000: Bulk hydrometeor classification and quantification using polarimetric radar data: Synthesis of relations. J. Appl. Meteor., 39, 1341–1372, doi:10.1175/1520-0450(2000)039<1341:BHCAQU>2.0.CO;2.
Tabary, P., Le Henaff A. , Vulpiani G. , Parent-du-Chatelet J. , and Gourley J. J. , 2006: Melting layer characterization and identification with a C-band dual-polarization radar: A long-term analysis. Preprints, Fourth European Conf. on Radar in Meteorology and Hydrology, Barcelona, Spain, Servei Meteoròlogic de Catalunya, 1.8. [Available online at http://www.crahi.upc.edu/ERAD2006/proceedingsMask/00005.pdf.]
Tu, J. V., 1996: Advantages and disadvantages of using artificial neural networks versus logistic regression for predicting medical outcomes. J. Clin. Epidemiol., 49, 1225–1231, doi:10.1016/S0895-4356(96)00002-9.
Vivekanandan, J., Zrnić D. S. , Ellis S. M. , Oye R. , Ryzhkov A. V. , and Straka J. M. , 1999: Cloud microphysics retrieval using S-band dual-polarization radar measurements. Bull. Amer. Meteor. Soc., 80, 381–388, doi:10.1175/1520-0477(1999)080<0381:CMRUSB>2.0.CO;2.
Zhang, J., and Qi Y. , 2010: A real-time algorithm for the correction of brightband effects in radar-derived QPE. J. Hydrometeor., 11, 1157–1171, doi:10.1175/2010JHM1201.1.
Zhang, J., Wang S. , and Clarke B. , 2004: WSR-88D reflectivity quality control using horizontal and vertical reflectivity structure. 11th Conf. on Aviation, Range, and Aerospace Meteorology, Hyannis, MA, Amer. Meteor. Soc., 5.4. [Available online at https://ams.confex.com/ams/11aram22sls/techprogram/paper_81858.htm.]
Zhang, J., Langston C. , and Howard K. , 2008: Brightband identification based on vertical profiles of reflectivity from the WSR-88D. J. Atmos. Oceanic Technol., 25, 1859–1872, doi:10.1175/2008JTECHA1039.1.
Zhang, J., and Coauthors, 2014: Initial operating capabilities of quantitative precipitation estimation in the multi-radar multi-sensor system. 28th Conf. on Hydrology, Atlanta, GA, Amer. Meteor. Soc., 5.3. [Available online at https://ams.confex.com/ams/94Annual/webprogram/Paper240487.html.]
Zrnić, D. S., and Ryzhkov A. V. , 1999: Polarimetry for weather surveillance radars. Bull. Amer. Meteor. Soc., 80, 389–406, doi:10.1175/1520-0477(1999)080<0389:PFWSR>2.0.CO;2.
Zrnić, D. S., Ryzhkov A. V. , Straka J. M. , Liu Y. , and Vivekanandan J. , 2001: Testing a procedure for the automatic classification of hydrometeor types. J. Atmos. Oceanic Technol., 18, 892–913, doi:10.1175/1520-0426(2001)018<0892:TAPFAC>2.0.CO;2.