An Analysis of 2016–18 Tornadoes and National Weather Service Tornado Warnings across the Contiguous United States

Evan S. Bentley aNOAA/NWS/NCEP/Storm Prediction Center, Norman, Oklahoma

Search for other papers by Evan S. Bentley in
Current site
Google Scholar
PubMed
Close
,
Richard L. Thompson aNOAA/NWS/NCEP/Storm Prediction Center, Norman, Oklahoma

Search for other papers by Richard L. Thompson in
Current site
Google Scholar
PubMed
Close
,
Barry R. Bowers bNational Weather Service Forecast Office, Norman, Oklahoma

Search for other papers by Barry R. Bowers in
Current site
Google Scholar
PubMed
Close
,
Justin G. Gibbs cNOAA/NWS Warning Decision Training Division, Norman, Oklahoma

Search for other papers by Justin G. Gibbs in
Current site
Google Scholar
PubMed
Close
, and
Steven E. Nelson dNational Weather Service, Peachtree City, Georgia

Search for other papers by Steven E. Nelson in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

Previous work has considered tornado occurrence with respect to radar data, both WSR-88D and mobile research radars, and a few studies have examined techniques to potentially improve tornado warning performance. To date, though, there has been little work focusing on systematic, large-sample evaluation of National Weather Service (NWS) tornado warnings with respect to radar-observable quantities and the near-storm environment. In this work, three full years (2016–18) of NWS tornado warnings across the contiguous United States were examined, in conjunction with supporting data in the few minutes preceding warning issuance, or tornado formation in the case of missed events. The investigation herein examines WSR-88D and Storm Prediction Center (SPC) mesoanalysis data associated with these tornado warnings with comparisons made to the current Warning Decision Training Division (WDTD) guidance. Combining low-level rotational velocity and the significant tornado parameter (STP), as used in prior work, shows promise as a means to estimate tornado warning performance, as well as relative changes in performance as criteria thresholds vary. For example, low-level rotational velocity peaking in excess of 30 kt (15 m s−1), in a near-storm environment, which is not prohibitive for tornadoes (STP > 0), results in an increased probability of detection and reduced false alarms compared to observed NWS tornado warning metrics. Tornado warning false alarms can also be reduced through limiting warnings with weak (<30 kt), broad (>1 n mi; 1 n mi = 1.852 km) circulations in a poor (STP = 0) environment, careful elimination of velocity data artifacts like sidelobe contamination, and through greater scrutiny of human-based tornado reports in otherwise questionable scenarios.

Significance Statement

Recent studies have explored the radar signatures associated with severe storms and tornadoes and recently these radar signatures have been correlated to surveyed damage from tornadoes. However, to date, there is no known research relating the radar signatures that prompt National Weather Service tornado warnings to the verification of those warnings. This research accomplished this goal and showed that the most skillful warning thresholds match current guidance for National Weather Service forecasters. Typically, an increase in POD will result in an increase in FAR and vice versa. However, this research showed there may be opportunities to improve POD and FAR with minimal negative consequences by focusing on the tails of the distribution (poor environment/weak signature and favorable environment and strong signature).

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Evan S. Bentley, evan.bentley@noaa.gov

Abstract

Previous work has considered tornado occurrence with respect to radar data, both WSR-88D and mobile research radars, and a few studies have examined techniques to potentially improve tornado warning performance. To date, though, there has been little work focusing on systematic, large-sample evaluation of National Weather Service (NWS) tornado warnings with respect to radar-observable quantities and the near-storm environment. In this work, three full years (2016–18) of NWS tornado warnings across the contiguous United States were examined, in conjunction with supporting data in the few minutes preceding warning issuance, or tornado formation in the case of missed events. The investigation herein examines WSR-88D and Storm Prediction Center (SPC) mesoanalysis data associated with these tornado warnings with comparisons made to the current Warning Decision Training Division (WDTD) guidance. Combining low-level rotational velocity and the significant tornado parameter (STP), as used in prior work, shows promise as a means to estimate tornado warning performance, as well as relative changes in performance as criteria thresholds vary. For example, low-level rotational velocity peaking in excess of 30 kt (15 m s−1), in a near-storm environment, which is not prohibitive for tornadoes (STP > 0), results in an increased probability of detection and reduced false alarms compared to observed NWS tornado warning metrics. Tornado warning false alarms can also be reduced through limiting warnings with weak (<30 kt), broad (>1 n mi; 1 n mi = 1.852 km) circulations in a poor (STP = 0) environment, careful elimination of velocity data artifacts like sidelobe contamination, and through greater scrutiny of human-based tornado reports in otherwise questionable scenarios.

Significance Statement

Recent studies have explored the radar signatures associated with severe storms and tornadoes and recently these radar signatures have been correlated to surveyed damage from tornadoes. However, to date, there is no known research relating the radar signatures that prompt National Weather Service tornado warnings to the verification of those warnings. This research accomplished this goal and showed that the most skillful warning thresholds match current guidance for National Weather Service forecasters. Typically, an increase in POD will result in an increase in FAR and vice versa. However, this research showed there may be opportunities to improve POD and FAR with minimal negative consequences by focusing on the tails of the distribution (poor environment/weak signature and favorable environment and strong signature).

© 2021 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Evan S. Bentley, evan.bentley@noaa.gov
Save
  • Anderson-Frey, A., Y. Richardson, A. Dean, R. Thompson, and B. Smith, 2016: Investigation of near-storm environments for tornado events and warnings. Wea. Forecasting, 31, 17711790, https://doi.org/10.1175/WAF-D-16-0046.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Anderson-Frey, A., Y. Richardson, A. Dean, R. Thompson, and B. Smith, 2019: Characteristics of tornado events and warnings in the southeastern United States. Wea. Forecasting, 34, 10171034, https://doi.org/10.1175/WAF-D-18-0211.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Barnes, L., E. Gruntfest, M. Hayden, D. Schultz, and C. Benight, 2007: False alarms and close calls: A conceptual model of warning accuracy. Wea. Forecasting, 22, 11401147, https://doi.org/10.1175/WAF1031.1; Corrigendum, 24, 1452–1454, https://doi.org/10.1175/2009WAF2222300.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Blair, S. F., and J. W. Leighton, 2014: Assessing real-time tornado information disseminated through NWS products. Wea. Forecasting, 29, 591600, https://doi.org/10.1175/WAF-D-13-00126.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bodine, D. J., M. R. Kumjian, R. D. Palmer, P. L. Heinselman, and A. V. Ryzhkov, 2013: Tornado damage estimation using polarimetric radar. Wea. Forecasting, 28, 139158, https://doi.org/10.1175/WAF-D-11-00158.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bothwell, P. D., J. A. Hart, and R. L. Thompson, 2002: An integrated three-dimensional objective analysis scheme in use at the Storm Prediction Center. 21st Conf. on Severe Local Storms/19th Conf. on Weather Analysis and Forecasting/15th Conf. on Numerical Weather Prediction, San Antonio, TX, Amer. Meteor. Soc., JP3.1, https://ams.confex.com/ams/SLS_WAF_NWP/techprogram/paper_47482.htm.

  • Brooks, H. E., and J. Correia Jr., 2018: Long-term performance metrics for National Weather Service tornado warnings. Wea. Forecasting, 33, 15011511, https://doi.org/10.1175/WAF-D-18-0120.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brotzge, J., and S. Erickson, 2009: NWS tornado warnings with zero or negative lead times. Wea. Forecasting, 24, 140154, https://doi.org/10.1175/2008WAF2007076.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brotzge, J., and S. Erickson, 2010: Tornadoes without NWS warning. Wea. Forecasting, 25, 159172, https://doi.org/10.1175/2009WAF2222270.1.

  • Brotzge, J., and W. Donner, 2013: The tornado warning process. A review of current research, challenges, and opportunities. Bull. Amer. Meteor. Soc., 94, 17151733, https://doi.org/10.1175/BAMS-D-12-00147.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brotzge, J., S. Erickson, and H. Brooks, 2011: A 5-yr climatology of tornado false alarms. Wea. Forecasting, 26, 534544, https://doi.org/10.1175/WAF-D-10-05004.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brotzge, J., S. Nelson, R. Thompson, and B. Smith, 2013: Tornado probability of detection and lead time as a function of convective mode and environmental parameters. Wea. Forecasting, 28, 12611276, https://doi.org/10.1175/WAF-D-12-00119.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brown, R. A., V. T. Wood, and D. Sirmans, 2002: Improved tornado detection using simulated and actual WSR-88D data with enhanced resolution. J. Atmos. Oceanic Technol., 19, 17591771, https://doi.org/10.1175/1520-0426(2002)019<1759:ITDUSA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Brown, R. A., B. A. Flickinger, E. Forren, D. M. Schultz, D. Sirmans, P. L. Spencer, V. T. Wood, and C. L. Ziegler, 2005: Improved detection of severe storms using experimental fine-resolution WSR-88D measurements. Wea. Forecasting, 20, 314, https://doi.org/10.1175/WAF-832.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Bunkers, M. J., D. A. Barber, R. L. Thompson, R. Edwards, and J. Garner, 2014: Choosing a universal mean wind for supercell motion prediction. J. Oper. Meteor., 2, 115129, https://doi.org/10.15191/nwajom.2014.0211.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Chrisman, J. N., 2011: Supplemental Adaptive Intra-Volume Low-Level Scan (SAILS). NOAA/NWS, 13 pp., http://www.roc.noaa.gov/wsr88d/PublicDocs/NewTechnology/SAILS_Initial_Presentation_Sep_2011.pdf.

  • Chrisman, J. N., 2014: Multiple elevation scan option for SAILS (MESO-SAILS). NOAA/NWS, 27 pp., http://www.roc.noaa.gov/wsr88d/PublicDocs/NewTechnology/MESO-SAILS_Description_Briefing_Jan_2014.pdf.

  • Doviak, R. J., and D. S. Zrnić, 1993: Doppler Radar and Weather Observations. Academic Press, 562 pp.

  • Edwards, R., and J. C. Picca, 2016: Tornadic debris signatures in tropical cyclones. Preprints, 28th Conf. Severe Local Storms, Portland, OR, Amer. Meteor. Soc., 162, https://ams.confex.com/ams/28SLS/webprogram/Paper300633.html.

  • Ferree, J. T., J. M. Looney, and K. R. Waters, 2006: NOAA/National Weather Services’ storm-based warnings. 23rd Conf. on Severe Local Storms, St. Louis, MO, Amer. Meteor. Soc., 11.6, https://ams.confex.com/ams/23SLS/techprogram/paper_115513.htm.

  • Gibbs, J. G., 2016: A skill assessment of techniques for real-time diagnosis and short-term prediction of tornado intensity using the WSR-88D. J. Oper. Meteor., 4, 170181, https://doi.org/10.15191/nwajom.2016.0413.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Gibbs, J. G., and B. R. Bowers, 2019: Techniques and thresholds of significance for using WSR-88D velocity data to anticipate significant tornadoes. J. Oper. Meteor., 7, 117137, https://doi.org/10.15191/nwajom.2019.0709.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Karstens, C. D., and Coauthors, 2018: Development of a human-machine mix for forecasting severe convective events. Wea. Forecasting, 33, 715–737, https://doi.org/10.1175/WAF-D-17-0188.1.

    • Crossref
    • Export Citation
  • Kingfield, D. M., and J. G. LaDue, 2015: The relationship between automated low-level velocity calculations from the WSR-88D and maximum tornado intensity determined from damage surveys. Wea. Forecasting, 30, 11251139, https://doi.org/10.1175/WAF-D-14-00096.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Krocak, M. J., and H. E. Brooks, 2021: The influence of weather watch type on the quality of tornado warnings and its implications for future forecasting systems. Wea. Forecasting, 36, 1675–1680, https://doi.org/10.1175/WAF-D-21-0052.1.

    • Crossref
    • Export Citation
  • NWS, 2011: NWS Central Region service assessment. NOAA/NWS, Joplin, MO, accessed 17 June 2019, https://www.weather.gov/publications/assessments.

  • Piltz, S. F., and D. W. Burgess, 2009: The impacts of thunderstorm geometry and WSR-88D beam characteristics on diagnosing supercell tornadoes. 34th Conf. on Radar Meteorology, Williamsburg, VA, Amer. Meteor. Soc., P6.18, https://ams.confex.com/ams/34Radar/techprogram/paper_155944.htm.

  • Ripberger, J. T., C. L. Silva, H. C. Jenkins-Smith, D. E. Carlson, M. James, and K. G. Herron, 2015: False alarms and missed events: The impact and origins of perceived inaccuracy in tornado warning systems. Risk Anal., 35, 4456, https://doi.org/10.1111/risa.12262.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ryzhkov, A., T. J. Schuur, D. W. Burgess, and D. S. Zrnić, 2005: Polarimetric tornado detection. J. Appl. Meteor., 44, 557570, https://doi.org/10.1175/JAM2235.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Saxion, D. S., and R. L. Ice, 2012: New science for the WSR-88D: Status of the dual-polarization upgrade. 28th Conf. on Interactive Information Processing Systems, New Orleans, LA, Amer. Meteor. Soc., 5, https://ams.confex.com/ams/92Annual/webprogram/Manuscript/Paper197645/NEXRAD_DP_Status_28th_IIPS_Jan2012.pdf.

  • Schaefer, J. T., 1990: The critical success index as an indicator of warning skill. Wea. Forecasting, 5, 570575, https://doi.org/10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Schneider, R. S., and A. R. Dean, 2008: A comprehensive 5-year severe storm environment climatology for the continental United States. 24th Conf. on Severe Local Storms, Savannah, GA, Amer. Meteor. Soc., 16A.4, http://ams.confex.com/ams/pdfpapers/141748.pdf.

  • Schultz, C. J., and Coauthors, 2012a: Dual-polarization tornadic debris signatures Part I: Examples and utility in an operational setting. Electron. J. Oper. Meteor., 13, 120137, http://nwafiles.nwas.org/ej/pdf/2012-EJ9.pdf .

    • Search Google Scholar
    • Export Citation
  • Schultz, C. J., and Coauthors, 2012b: Dual-polarization tornadic debris signatures Part II: Comparisons and caveats. Electron. J. Oper. Meteor., 13, 138150, http://nwafiles.nwas.org/ej/pdf/2012-EJ10.pdf.

    • Search Google Scholar
    • Export Citation
  • Simmons, K. M., and D. Sutter, 2009: False alarms, tornado warnings, and tornado casualties. Wea. Climate Soc., 1, 3853, https://doi.org/10.1175/2009WCAS1005.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Smith, B. T., R. L. Thompson, J. S. Grams, and J. C. Broyles, 2012: Convective modes for significant severe thunderstorms in the contiguous United States. Part I: Storm classification and climatology. Wea. Forecasting, 27, 11141135, https://doi.org/10.1175/WAF-D-11-00115.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Smith, B. T., R. L. Thompson, A. R. Dean, and P. T. Marsh, 2015: Diagnosing the conditional probability of tornado damage rating using environmental and radar attributes. Wea. Forecasting, 30, 914932, https://doi.org/10.1175/WAF-D-14-00122.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Smith, B. T., R. L. Thompson, D. A. Speheger, A. R. Dean, C. D. Karstens, and A. K. Anderson-Frey, 2020a: WSR-88D tornado intensity estimates. Part I: Real-time probabilities of peak tornado wind speeds. Wea. Forecasting, 35, 2479–2492, https://doi.org/10.1175/WAF-D-20-0010.1.

    • Crossref
    • Export Citation
  • Smith, B. T., R. L. Thompson, D. A. Speheger, A. R. Dean, C. D. Karstens, and A. K. Anderson-Frey, 2020b: WSR-88D tornado intensity estimates. Part II: Real-time applications to tornado warning timescales. Wea. Forecasting, 35, 2493–2506, https://doi.org/10.1175/WAF-D-20-0011.1.

    • Crossref
    • Export Citation
  • Snyder, J., and A. V. Ryzhkov, 2015: Automated detection of polarimetric tornadic debris signatures using a hydrometeor classification algorithm. J. Appl. Meteor. Climatol., 54, 18611870, https://doi.org/10.1175/JAMC-D-15-0138.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, R., R. Edwards, J. Hart, K. Elmore, and P. Markowski, 2003: Close proximity soundings within supercell environments obtained from the Rapid Update Cycle. Wea. Forecasting, 18, 12431261, https://doi.org/10.1175/1520-0434(2003)018<1243:CPSWSE>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, R., B. T. Smith, J. S. Grams, A. R. Dean, and C. Broyles, 2012: Convective modes for significant severe thunderstorms in the contiguous United States. Part II: Supercells and QLCS tornado environments. Wea. Forecasting, 27, 11361154, https://doi.org/10.1175/WAF-D-11-00116.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Thompson, R., and Coauthors, 2017: Tornado damage rating probabilities derived from WSR-88D data. Wea. Forecasting, 32, 15091528, https://doi.org/10.1175/WAF-D-17-0004.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Torres, S., and C. Curtis, 2007: Initial implementation of super-resolution data on the NEXRAD network. 23rd Int. Conf. on Interactive Information and Processing Systems for Meteorology, Oceanography, and Hydrology, San Antonio, TX, Amer. Meteor. Soc., 5B.10, https://ams.confex.com/ams/87ANNUAL/webprogram/Paper116240.html.

  • Toth, M., R. J. Trapp, J. Wurman, and K. A. Kosiba, 2013: Comparison of mobile-radar measurements of tornado intensity with corresponding WSR-88D measurements. Wea. Forecasting, 28, 418426, https://doi.org/10.1175/WAF-D-12- 00019.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van Den Broeke, M. S., and S. T. Jauernic, 2014: Spatial and temporal characteristics of polarimetric tornadic debris signatures. J. Appl. Meteor. Climatol., 53, 22172231, https://doi.org/10.1175/JAMC-D-14-0094.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Wagenmaker, R., G. Mann, and M. Hudson, 2014: NWS Central Region Impact-Based Warning project introduction and overview. NOAA, 17 pp.

  • Warning Decision Training Division, 2021: Warning content: Impact-based warnings. Accessed 19 May 2021, https://training.weather.gov/wdtd/courses/rac/warnings/warn-content/presentation_html5.html.

  • Wilks, S. S., 1935: The likelihood test of independence in contingency tables. Ann. Math. Stat. 6, 190–196, https://doi.org/10.1214/aoms/1177732564.

    • Crossref
    • Export Citation
  • Zrnić, D. S., 1987: Three-body scattering produces precipitation signature of special diagnostic value. Radio Sci., 22, 7686, https://doi.org/10.1029/RS022i001p00076.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 1935 0 0
Full Text Views 2001 863 244
PDF Downloads 1404 306 30