A Comparison of Thunderstorm Identification Methods

Stephen A. Shield aDepartment of Earth and Atmospheric Sciences, University of Nebraska–Lincoln, Lincoln, Nebraska

Search for other papers by Stephen A. Shield in
Current site
Google Scholar
PubMed
Close
https://orcid.org/0000-0002-2634-6523
and
Adam L. Houston aDepartment of Earth and Atmospheric Sciences, University of Nebraska–Lincoln, Lincoln, Nebraska

Search for other papers by Adam L. Houston in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Climatological analysis of thunderstorm occurrence is important since thunderstorms have far-reaching societal impacts. Historically, the majority of thunderstorm-related climatologies have focused on Eulerian frames of reference resulting in thunderstorm day or lightning density summaries. However, a Lagrangian frame of reference is required to answer more in-depth questions such as spatial distribution and variability in thunderstorm initiation. Lagrangian approaches generally utilize object identification and tracking algorithms with tracks then classified as being a thunderstorm or not. Prior methods for thunderstorm identification have been based on classification criteria such as radar reflectivity thresholds, a combination of radar reflectivity thresholds and temporal longevity thresholds, or a combination of radar reflectivity and cloud-to-ground lightning occurrence. However, a comparison of different methods and an evaluation of their accuracy have not been documented in the peer-reviewed literature. This study examines the impact of thunderstorm identification methodology choice. Differences in three thunderstorm identification methodologies are examined over the central plains of the United States during an 11-yr study period. Results show that there is a sensitivity to methodological choice with differences in the number of candidate thunderstorms classified as thunderstorms, as well as the resulting spatial pattern of thunderstorms. Additionally, this study provides insight into the accuracy of each method via a multiyear comparison of each method to regional lightning mapping array total lightning detections where significant differences were observed between methods with the method incorporating cloud-to-ground lightning data providing the best performance metrics.

Significance Statement

Previous research has utilized a variety of criteria to identify thunderstorms in order to generate datasets of thunderstorm occurrence. This study directly compares commonly used criteria, demonstrating that the choice of thunderstorm identification criteria impacts the composition and accuracy of resulting datasets of thunderstorm occurrence.

© 2024 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Stephen A. Shield, stephen_shield@outlook.com

Abstract

Climatological analysis of thunderstorm occurrence is important since thunderstorms have far-reaching societal impacts. Historically, the majority of thunderstorm-related climatologies have focused on Eulerian frames of reference resulting in thunderstorm day or lightning density summaries. However, a Lagrangian frame of reference is required to answer more in-depth questions such as spatial distribution and variability in thunderstorm initiation. Lagrangian approaches generally utilize object identification and tracking algorithms with tracks then classified as being a thunderstorm or not. Prior methods for thunderstorm identification have been based on classification criteria such as radar reflectivity thresholds, a combination of radar reflectivity thresholds and temporal longevity thresholds, or a combination of radar reflectivity and cloud-to-ground lightning occurrence. However, a comparison of different methods and an evaluation of their accuracy have not been documented in the peer-reviewed literature. This study examines the impact of thunderstorm identification methodology choice. Differences in three thunderstorm identification methodologies are examined over the central plains of the United States during an 11-yr study period. Results show that there is a sensitivity to methodological choice with differences in the number of candidate thunderstorms classified as thunderstorms, as well as the resulting spatial pattern of thunderstorms. Additionally, this study provides insight into the accuracy of each method via a multiyear comparison of each method to regional lightning mapping array total lightning detections where significant differences were observed between methods with the method incorporating cloud-to-ground lightning data providing the best performance metrics.

Significance Statement

Previous research has utilized a variety of criteria to identify thunderstorms in order to generate datasets of thunderstorm occurrence. This study directly compares commonly used criteria, demonstrating that the choice of thunderstorm identification criteria impacts the composition and accuracy of resulting datasets of thunderstorm occurrence.

© 2024 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Stephen A. Shield, stephen_shield@outlook.com
Save
  • AMS, 2012a: Thunderstorm. Glossary of Meteorology, https://glossary.ametsoc.org/wiki/Thunderstorm.

  • AMS, 2012b: Cell. Glossary of Meteorology, https://glossary.ametsoc.org/wiki/Cell.

  • Ashley, S. T., and W. S. Ashley, 2008: The storm morphology of deadly flooding events in the United States. Int. J. Climatol., 28, 493503, https://doi.org/10.1002/joc.1554.

    • Search Google Scholar
    • Export Citation
  • Biggerstaff, M. I., and S. A. Listemaa, 2000: An improved scheme for convective/stratiform echo classification using radar reflectivity. J. Appl. Meteor., 39, 21292150, https://doi.org/10.1175/1520-0450(2001)040<2129:AISFCS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Boughorbel, S., F. Jarray, and M. El-Anbari, 2017: Optimal classifier for imbalanced data using Matthews Correlation Coefficient metric. PLOS ONE, 12, e0177678, https://doi.org/10.1371/journal.pone.0177678.

    • Search Google Scholar
    • Export Citation
  • Brodersen, K. H., C. S. Ong, K. E. Stephan, and J. M. Buhmann, 2010: The balanced accuracy and its posterior distribution. 2010 20th Int. Conf. on Pattern Recognition, Istanbul, Turkey, Institute of Electrical and Electronics Engineers, 3121–3124, https://doi.org/10.1109/ICPR.2010.764.

  • Burcea, S., R. Cică, and R. Bojariu, 2019: Radar-derived convective storms’ climatology for the Prut River basin: 2003–2017. Nat. Hazards Earth Syst. Sci., 19, 13051318, https://doi.org/10.5194/nhess-19-1305-2019.

    • Search Google Scholar
    • Export Citation
  • Changnon, S. A., Jr., 1988a: Climatography of thunder events in the conterminous United States. Part I: Temporal aspects. J. Climate, 1, 389398, https://doi.org/10.1175/1520-0442(1988)001<0389:COTEIT>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Changnon, S. A., Jr., 1988b: Climatography of thunder events in the conterminous United States. Part II: Spatial aspects. J. Climate, 1, 399405, https://doi.org/10.1175/1520-0442(1988)001<0399:COTEIT>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Changnon, S. A., Jr., 2001: Thunderstorm rainfall in the conterminous United States. Bull. Amer. Meteor. Soc., 82, 19251940, https://doi.org/10.1175/1520-0477(2001)082<1925:TRITCU>2.3.CO;2.

    • Search Google Scholar
    • Export Citation
  • Changnon, S. A., Jr., 2003: Geographical and temporal variations in thunderstorms in the contiguous United States during the 20th century. Phys. Geogr., 24, 138152, https://doi.org/10.2747/0272-3646.24.2.138.

    • Search Google Scholar
    • Export Citation
  • Chmielewski, V. C., and E. C. Bruning, 2016: Lightning mapping array flash detection performance with variable receiver thresholds. J. Geophys. Res. Atmos., 121, 86008614, https://doi.org/10.1002/2016JD025159.

    • Search Google Scholar
    • Export Citation
  • Crum, T. D., and R. L. Alberty, 1993: The WSR-88D and the WSR-88D operational support facility. Bull. Amer. Meteor. Soc., 74, 16691688, https://doi.org/10.1175/1520-0477(1993)074<1669:TWATWO>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Davini, P., R. Bechini, R. Cremonini, and C. Cassardo, 2012: Radar-based analysis of convective storms over northwestern Italy. Atmosphere, 3, 3358, https://doi.org/10.3390/atmos3010033.

    • Search Google Scholar
    • Export Citation
  • Dixon, M., and G. Wiener, 1993: TITAN: Thunderstorm identification, tracking, analysis, and nowcasting—A radar-based methodology. J. Atmos. Oceanic Technol., 10, 785797, https://doi.org/10.1175/1520-0426(1993)010<0785:TTITAA>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Efron, B., and R. J. Tibshirani, 1994: An Introduction to the Bootstrap. CRC Press, 456 pp.

  • Federal Aviation Administration, 2010: Weather-related aviation accident study 2003–2007. 71 pp., https://www.asias.faa.gov/i/studies/2003-2007weatherrelatedaviationaccidentstudy.pdf.

  • Ford, T. W., S. M. Quiring, B. Thakur, R. Jogineedi, A. Houston, S. Yuan, A. Kalra, and N. Lock, 2018: Evaluating soil moisture–precipitation interactions using remote sensing: A sensitivity analysis. J. Hydrometeor., 19, 12371253, https://doi.org/10.1175/JHM-D-17-0243.1.

    • Search Google Scholar
    • Export Citation
  • Frye, J. D., and T. L. Mote, 2010: Convection initiation along soil moisture boundaries in the southern Great Plains. Mon. Wea. Rev., 138, 11401151, https://doi.org/10.1175/2009MWR2865.1.

    • Search Google Scholar
    • Export Citation
  • Fuchs, B. R., E. C. Bruning, S. A. Rutledge, L. D. Carey, P. R. Krehbiel, and W. Rison, 2016: Climatological analyses of LMA data with an open-source lightning flash-clustering algorithm. J. Geophys. Res. Atmos., 121, 86258648, https://doi.org/10.1002/2015JD024663.

    • Search Google Scholar
    • Export Citation
  • Haberlie, A. M., W. S. Ashley, and T. J. Pingel, 2015: The effect of urbanisation on the climatology of thunderstorm initiation. Quart. J. Roy. Meteor. Soc., 141, 663675, https://doi.org/10.1002/qj.2499.

    • Search Google Scholar
    • Export Citation
  • Haberlie, A. M., W. S. Ashley, A. J. Fultz, and S. M. Eagan, 2016: The effect of reservoirs on the climatology of warm-season thunderstorms in southeast Texas, USA. Int. J. Climatol., 36, 18081820, https://doi.org/10.1002/joc.4461.

    • Search Google Scholar
    • Export Citation
  • Houston, A. L., N. A. Lock, J. Lahowetz, B. L. Barjenbruch, G. Limpert, and C. Oppermann, 2015: Thunderstorm Observation by Radar (ThOR): An algorithm to develop a climatology of thunderstorms. J. Atmos. Oceanic Technol., 32, 961981, https://doi.org/10.1175/JTECH-D-14-00118.1.

    • Search Google Scholar
    • Export Citation
  • Hu, Q., and G. Buyanovsky, 2003: Climate effects on corn yield in Missouri. J. Appl. Meteor., 42, 16261635, https://doi.org/10.1175/1520-0450(2003)042<1626:CEOCYI>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Johnson, J., P. L. MacKeen, A. Witt, E. D. W. Mitchell, G. J. Stumpf, M. D. Eilts, and K. W. Thomas, 1998: The storm cell identification and tracking algorithm: An enhanced WSR-88D algorithm. Wea. Forecasting, 13, 263276, https://doi.org/10.1175/1520-0434(1998)013<0263:TSCIAT>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Kevat, A., 2020: Thunderstorm asthma: Looking back and looking forward. J. Asthma Allergy, 13, 293299, https://doi.org/10.2147/JAA.S265697.

    • Search Google Scholar
    • Export Citation
  • Koehler, T. L., 2020: Cloud-to-ground lightning flash density and thunderstorm day distributions over the contiguous United States derived from NLDN measurements: 1993–2018. Mon. Wea. Rev., 148, 313332, https://doi.org/10.1175/MWR-D-19-0211.1.

    • Search Google Scholar
    • Export Citation
  • Lakshmanan, V., T. Smith, K. Hondl, G. J. Stumpf, and A. Witt, 2006: A real-time, three-dimensional, rapidly updating, heterogeneous radar merger technique for reflectivity, velocity, and derived products. Wea. Forecasting, 21, 802823, https://doi.org/10.1175/WAF942.1.

    • Search Google Scholar
    • Export Citation
  • Lakshmanan, V., A. Fritz, T. Smith, K. Hondl, and G. Stumpf, 2007: An automated technique to quality control radar reflectivity data. J. Appl. Meteor. Climatol., 46, 288305, https://doi.org/10.1175/JAM2460.1.

    • Search Google Scholar
    • Export Citation
  • Lakshmanan, V., K. Hondl, and R. Rabin, 2009: An efficient, general-purpose technique for identifying storm cells in geospatial images. J. Atmos. Oceanic Technol., 26, 523537, https://doi.org/10.1175/2008JTECHA1153.1.

    • Search Google Scholar
    • Export Citation
  • Limpert, G., A. Houston, and N. Lock, 2015: The advanced algorithm for tracking objects (AALTO). Meteor. Appl., 22, 694704, https://doi.org/10.1002/met.1501.

    • Search Google Scholar
    • Export Citation
  • Liu, W., and X. Li, 2016: Life cycle characteristics of warm-season severe thunderstorms in central United States from 2010 to 2014. Climate, 4, 45, https://doi.org/10.3390/cli4030045.

    • Search Google Scholar
    • Export Citation
  • Lock, N. A., and A. L. Houston, 2014: Empirical examination of the factors regulating thunderstorm initiation. Mon. Wea. Rev., 142, 240258, https://doi.org/10.1175/MWR-D-13-00082.1.

    • Search Google Scholar
    • Export Citation
  • Manzato, A., S. Serafin, M. M. Miglietta, D. Kirshbaum, and W. Schulz, 2022: A pan-Alpine climatology of lightning and convective initiation. Mon. Wea. Rev., 150, 22132230, https://doi.org/10.1175/MWR-D-21-0149.1.

    • Search Google Scholar
    • Export Citation
  • Medici, G., K. L. Cummins, D. J. Cecil, W. J. Koshak, and S. D. Rudlosky, 2017: The intracloud lightning fraction in the contiguous United States. Mon. Wea. Rev., 145, 44814499, https://doi.org/10.1175/MWR-D-16-0426.1.

    • Search Google Scholar
    • Export Citation
  • Mesinger, F., and Coauthors, 2006: North American regional reanalysis. Bull. Amer. Meteor. Soc., 87, 343360, https://doi.org/10.1175/BAMS-87-3-343.

    • Search Google Scholar
    • Export Citation
  • Miller, P. W., and T. L. Mote, 2017: A climatology of weakly forced and pulse thunderstorms in the southeast United States. J. Appl. Meteor. Climatol., 56, 30173033, https://doi.org/10.1175/JAMC-D-17-0005.1.

    • Search Google Scholar
    • Export Citation
  • Mohee, F. M., and C. Miller, 2010: Climatology of thunderstorms for North Dakota, 2002–06. J. Appl. Meteor. Climatol., 49, 18811890, https://doi.org/10.1175/2010JAMC2400.1.

    • Search Google Scholar
    • Export Citation
  • Nag, A., M. J. Murphy, K. L. Cummins, A. E. Pifer, and J. A. Cramer, 2014: Recent evolution of the US National lightning detection network. 23rd Int. Lightning Detection Conf. and Fifth Int. Lightning Meteorology Conf., Tucson, AZ, Vaisala, https://www.vaisala.com/sites/default/files/documents/Nag%20et%20al-Recent%20Evolution%20of%20the%20U.S.%20National%20Lightning%20Detection%20Network-2014-ILDC-ILMC.pdf.

  • National Interagency Fire Center, 2024: Lightning-caused and human-caused fires and acres. 3 pp., https://www.nifc.gov/sites/default/files/document-media/Lightning-Human-Caused_2.pdf.

  • Reif, D. W., and H. B. Bluestein, 2017: A 20-year climatology of nocturnal convection initiation over the central and southern Great Plains during the warm season. Mon. Wea. Rev., 145, 16151639, https://doi.org/10.1175/MWR-D-16-0340.1.

    • Search Google Scholar
    • Export Citation
  • Roebber, P. J., 2009: Visualizing multiple measures of forecast quality. Wea. Forecasting, 24, 601608, https://doi.org/10.1175/2008WAF2222159.1.

    • Search Google Scholar
    • Export Citation
  • Shield, S. A., S. M. Quiring, J. V. Pino, and K. Buckstaff, 2021: Major impacts of weather events on the electrical power delivery system in the United States. Energy, 218, 119434, https://doi.org/10.1016/j.energy.2020.119434.

    • Search Google Scholar
    • Export Citation
  • Thomas, R. J., P. R. Krehbiel, W. Rison, S. J. Hunyady, W. P. Winn, T. Hamlin, and J. Harlin, 2004: Accuracy of the lightning mapping array. J. Geophys. Res., 109, D14207, https://doi.org/10.1029/2004JD004549.

    • Search Google Scholar
    • Export Citation
  • Tucker, D. F., and X. Li, 2009: Characteristics of warm season precipitating storms in the Arkansas–Red River basin. J. Geophys. Res. Atmos., 114, D13108, https://doi.org/10.1029/2008JD011093.

    • Search Google Scholar
    • Export Citation
  • Yuan, S., Y. Wang, S. M. Quiring, T. W. Ford, and A. L. Houston, 2020: A sensitivity study on the response of convection initiation to in situ soil moisture in the central United States. Climate Dyn., 54, 20132028, https://doi.org/10.1007/s00382-019-05098-0.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 12747 12747 4901
Full Text Views 332 332 139
PDF Downloads 215 215 93