Editorial Type:
Article
Article Type:
Research Article

Understanding Broadcast Meteorologists’ Current and Future Use of Severe Weather Watches, Warnings, and Probabilistic Hazard Information

Holly B. Obermeier aCooperative Institute for Severe and High-Impact Weather Research and Operations, University of Oklahoma, Norman, Oklahoma
bNOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Holly B. Obermeier in
Current site
Google Scholar
PubMed Close
https://orcid.org/0000-0001-8532-9347
,
Kodi L. Berry bNOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Kodi L. Berry in
Current site
Google Scholar
PubMed Close
, and
Joseph E. Trujillo-Falcón aCooperative Institute for Severe and High-Impact Weather Research and Operations, University of Oklahoma, Norman, Oklahoma
bNOAA/OAR/National Severe Storms Laboratory, Norman, Oklahoma

Search for other papers by Joseph E. Trujillo-Falcón in
Current site
Google Scholar
PubMed Close
Online Publication:
03 Oct 2023
Print Publication:
01 Oct 2023
DOI:
https://doi.org/10.1175/WCAS-D-23-0013.1
Page(s):
893–907
Restricted access

Abstract

Broadcast meteorologists are essential in the communication of National Weather Service (NWS) warnings to the public. Therefore, it is imperative to include them in a user-centered approach for the design and implementation of new warning products. Forecasting a Continuum of Environmental Threats (FACETs) will modernize the way meteorologists forecast and communicate NWS warning information to the general public using rapidly updating probabilistic hazard information (PHI). Storm-scale PHI consists of probabilistic forecasts for severe wind/hail, tornadoes, and lightning hazards. Hence, NWS warnings would have the capacity to be supplemented by a quantitative or qualitative likelihood of hazard occurrence. The researchers conducting this study wanted to know what broadcast meteorologists thought about the inclusion of this likelihood information and how it could impact their decision-making and communication process. Using a nationwide survey, this team of researchers first asked broadcast meteorologists about their current practices for severe weather coverage using NWS watches and warnings. Next, broadcast meteorologists were introduced to multiple iterations of PHI prototypes and queried for their input. Findings indicated that broadcast meteorologists already face a complex decision-making and communication process under today’s warning paradigm. In addition, respondents were split on whether to explicitly communicate probabilities with their viewers. Respondents’ choices were also somewhat inconclusive regarding nomenclature, definitions of PHI and representations of PHI with warning polygons. These results suggest that PHI should feature user-driven, customizable options to fulfill broadcast meteorologists’ needs and that the iterative nature of the research-and-development process of PHI should continue.

Significance Statement

Broadcast meteorologists are vital communicators of dangerous weather to the public, leading researchers to study them more closely. Using a nationwide survey, this team of researchers wanted to know how broadcast meteorologists talk about tornadoes, large hail, and high winds to their viewers under today’s system of National Weather Service warnings. Survey findings indicated that broadcast meteorologists face a complex decision-making process when communicating dangerous weather. Any effort to modernize the current warning system, such as including hazard probability, should consider this complex process. Modernization should complement the role of broadcast meteorologists to ultimately serve the public and user-driven options should be a key component of any probabilistic information that is included in a future National Weather Service warning system.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Holly Obermeier, holly.obermeier@ou.edu

Abstract

Broadcast meteorologists are essential in the communication of National Weather Service (NWS) warnings to the public. Therefore, it is imperative to include them in a user-centered approach for the design and implementation of new warning products. Forecasting a Continuum of Environmental Threats (FACETs) will modernize the way meteorologists forecast and communicate NWS warning information to the general public using rapidly updating probabilistic hazard information (PHI). Storm-scale PHI consists of probabilistic forecasts for severe wind/hail, tornadoes, and lightning hazards. Hence, NWS warnings would have the capacity to be supplemented by a quantitative or qualitative likelihood of hazard occurrence. The researchers conducting this study wanted to know what broadcast meteorologists thought about the inclusion of this likelihood information and how it could impact their decision-making and communication process. Using a nationwide survey, this team of researchers first asked broadcast meteorologists about their current practices for severe weather coverage using NWS watches and warnings. Next, broadcast meteorologists were introduced to multiple iterations of PHI prototypes and queried for their input. Findings indicated that broadcast meteorologists already face a complex decision-making and communication process under today’s warning paradigm. In addition, respondents were split on whether to explicitly communicate probabilities with their viewers. Respondents’ choices were also somewhat inconclusive regarding nomenclature, definitions of PHI and representations of PHI with warning polygons. These results suggest that PHI should feature user-driven, customizable options to fulfill broadcast meteorologists’ needs and that the iterative nature of the research-and-development process of PHI should continue.

Significance Statement

Broadcast meteorologists are vital communicators of dangerous weather to the public, leading researchers to study them more closely. Using a nationwide survey, this team of researchers wanted to know how broadcast meteorologists talk about tornadoes, large hail, and high winds to their viewers under today’s system of National Weather Service warnings. Survey findings indicated that broadcast meteorologists face a complex decision-making process when communicating dangerous weather. Any effort to modernize the current warning system, such as including hazard probability, should consider this complex process. Modernization should complement the role of broadcast meteorologists to ultimately serve the public and user-driven options should be a key component of any probabilistic information that is included in a future National Weather Service warning system.

© 2023 American Meteorological Society. This published article is licensed under the terms of the default AMS reuse license. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Holly Obermeier, holly.obermeier@ou.edu

Supplementary Materials

    • Supplemental Materials (PDF 0.7427 MB)
Save
Cover Weather, Climate, and Society
Weather, Climate, and Society

  • AWARN, 2022: Advanced warning and response network. Accessed 27 April 2022, https://awarn.org.

  • Bitterman, A., M. Krocak, J. Ripberger, C. Silva, H. Jenkins-Smith, S. Ernst, and S. Stormer, 2022: Maintaining the series: Public reception, understanding, and responses to severe weather forecasts and warnings in the contiguous United States. Harvard Dataverse, accessed 1 August 2022, https://doi.org/10.7910/DVN/TD5DGD.

  • Braun, V., and V. Clarke, 2006: Using thematic analysis in psychology. Qual. Res. Psychol., 3, 77–101, https://doi.org/10.1191/1478088706qp063oa.

    • Search Google Scholar
    • Export Citation

  • Budescu, D. V., H.-H. Por, S. B. Broomell, and M. Smithson, 2014: The interpretation of IPCC probabilistic statements around the world. Nat. Climate Change, 4, 508–512, https://doi.org/10.1038/nclimate2194.

    • Search Google Scholar
    • Export Citation

  • Calhoun, K. M., and Coauthors, 2018: Cloud-to-ground lightning probabilities and warnings within an integrated warning team. Special Symp. on Impact-Based Decision Support Services, Austin, TX, Amer. Meteor. Soc., 4.4, https://ams.confex.com/ams/98Annual/webprogram/Paper329888.html.

  • Calhoun, K. M., K. L. Berry, D. M. Kingfield, T. Meyer, M. J. Krocak, T. M. Smith, G. Stumpf, and A. Gerard, 2021: The experimental warning program of NOAA’s Hazardous Weather Testbed. Bull. Amer. Meteor. Soc., 102, E2229–E2246, https://doi.org/10.1175/BAMS-D-21-0017.1.

    • Search Google Scholar
    • Export Citation

  • Cintineo, J. L., M. J. Pavolonis, J. M. Sieglaff, and D. T. Lindsey, 2014: An empirical model for assessing the severe weather potential of developing convection. Wea. Forecasting, 29, 639–653, https://doi.org/10.1175/WAF-D-13-00113.1.

    • Search Google Scholar
    • Export Citation

  • Cranford, A., 2018: Women weathercasters: Their positions, education, and presence in local TV. Bull. Amer. Meteor. Soc., 99, 281–288, https://doi.org/10.1175/BAMS-D-16-0317.1.

    • Search Google Scholar
    • Export Citation

  • Ernst, S. R., 2020: Colorful language: Investigating the interpretation of the Storm Prediction Center’s convective outlook by broadcast meteorologists and the U.S. public. M.S. thesis, Dept. of Meteorology, University of Oklahoma, 124 pp.

  • FCC, 2021: Access to emergency information on television. FCC, accessed 14 October 2022, https://www.fcc.gov/consumers/guides/accessibility-emergency-information-television.

  • Harrison, D. R., and C. D. Karstens, 2017: A climatology of operational storm-based warnings: A geospatial analysis. Wea. Forecasting, 32, 47–60, https://doi.org/10.1175/WAF-D-15-0146.1.

    • Search Google Scholar
    • Export Citation

  • Hatfield, K., S. F. Piltz, E. J. Calianese Jr., J. M. Frederick, J. B. McGavock, and M. E. Plate, 2018: Implementation of the WFO Tulsa vision for local impact-based decision support services. Special Symp. on Impact-Based Decision Support Services, Austin, TX, Amer. Meteor. Soc., 1.3, https://ams.confex.com/ams/98Annual/webprogram/Manuscript/Paper329294/1_3_Hatfield_ExtendedAbstract.pdf.

  • Hatfield, K., and Coauthors, 2023: Turning severe weather warning probabilities into action: NWS Tulsa efforts to better bridge the watch-to-warning gap. Special Symp. on Forecasting a Continuum of Environmental Threats (FACETs), Denver, CO, Amer. Meteor. Soc., J3.4, https://ams.confex.com/ams/103ANNUAL/meetingapp.cgi/Paper/414104.

  • Karstens, C., T. M. Smith, K. M. Calhoun, A. J. Clark, C. Ling, G. J. Stumpf, and L. P. Rothfusz, 2014: Prototype tool development for creating probabilistic hazard information for severe convective weather. Second Symp. on Building a Weather-Ready Nation: Enhancing Our Nation’s Readiness, Responsiveness, and Resilience to High Impact Weather Events, Atlanta, GA, Amer. Meteor. Soc., 2.2, https://ams.confex.com/ams/94Annual/webprogram/Manuscript/Paper241549/Karstens_AMS_2014.pdf.

  • Karstens, C., and Coauthors, 2015: Evaluation of a probabilistic forecasting methodology for severe convective weather in the 2014 Hazardous Weather Testbed. Wea. Forecasting, 30, 1551–1570, https://doi.org/10.1175/WAF-D-14-00163.1.

    • Search Google Scholar
    • Export Citation

  • Karstens, C., and Coauthors, 2018: Development of a human–machine mix for forecasting severe convective events. Wea. Forecasting, 33, 715–737, https://doi.org/10.1175/WAF-D-17-0188.1.

    • Search Google Scholar
    • Export Citation

  • Klockow-McClain, K. E., R. A. McPherson, and R. P. Thomas, 2020: Cartographic design for improved decision-making: Trade-offs in uncertainty visualization for tornado threats. Ann. Amer. Assoc. Geogr., 110, 314–333, https://doi.org/10.1080/24694452.2019.1602467.

    • Search Google Scholar
    • Export Citation

  • Kolakowski, C., K. Berry, A. Gerard, H. Obermeier, J. T. Ripberger, P. A. Campbell, T. C. Meyer, and K. E. Klockow-McClain, 2019: Broadcast meteorologist use of social media in the 2018 Hazardous Weather Testbed probabilistic hazard information project. Ninth Conf. on Transition of Research to Operations, Phoenix, AZ, Amer. Meteor. Soc., 8B.5, https://ams.confex.com/ams/2019Annual/recordingredirect.cgi/oid/Recording50929/paper351124_1.mp4.

  • Kox, T., L. Gerhold, and U. Ulbrich, 2015: Perception and use of uncertainty in severe weather warnings by emergency services in Germany. Atmos. Res., 158–159, 292–301, https://doi.org/10.1016/j.atmosres.2014.02.024.

    • Search Google Scholar
    • Export Citation

  • Krocak, M. J., J. T. Ripberger, C. L. Silva, H. C. Jenkins-Smith, S. Ernst, A. Bell, and J. Allan, 2020: Measuring change: Public reception, understanding, and responses to severe weather forecasts and warnings in the contiguous United States, version 2. University of Oklahoma Center for Risk and Crisis Management, Harvard Dataverse, accessed 1 August 2022, https://doi.org/10.7910/DVN/EWOCUA.

  • Krocak, M. J., J. T. Ripberger, C. Silva, H. Jenkins-Smith, S. Ernst, A. Gaviria-Pabón, A. Forney, and A. Bitterman, 2021: Continuing the baseline: Public reception, understanding, and responses to tropical cyclone forecasts and warnings in the contiguous United States. University of Oklahoma Center for Risk and Crisis Management, Harvard Dataverse, accessed 1 August 2022, https://doi.org/10.7910/DVN/QYZLSO.

  • Krocak, M. J., J. T. Ripberger, S. Ernst, C. L. Silva, and H. C. Jenkins-Smith, 2022: Exploring the differences in SPC convective outlook interpretation using categorical and numeric information. Wea. Forecasting, 37, 303–311, https://doi.org/10.1175/WAF-D-21-0123.1.

    • Search Google Scholar
    • Export Citation

  • Laio, R., and C. Shu, 2020: TikTok’s epic rise and stumble. TechCrunch, accessed 19 May 2023, https://techcrunch.com/2020/11/26/tiktok-timeline/.

  • Lenhardt, E. D., R. N. Cross, M. J. Krocak, J. T. Ripberger, S. R. Ernst, C. L. Silva, and H. C. Jenkins-Smith, 2020: How likely is that chance of thunderstorms? A study of how National Weather Service forecast offices use words of estimative probability and what they mean to the public. J. Oper. Meteor., 8, 64–78, https://doi.org/10.15191/nwajom.2020.0805.

    • Search Google Scholar
    • Export Citation

  • Lindell, M. K., 2020: Improving hazard map comprehension for protective action decision making. Front. Comput. Sci., 2, 27, https://doi.org/10.3389/fcomp.2020.00027.

    • Search Google Scholar
    • Export Citation

  • Meyer, T. C., K. Berry, K. M. Calhoun, H. Obermeier, A. Campbell, J. Wolfe, and K. E. Klockow-McClain, 2019: Visualization and communication of probabilistic lightning hazard information for a broad spectrum of end users. Ninth Conf. on the Meteorological Application of Lightning Data, Phoenix, AZ, Amer. Meteor. Soc., 6.3, https://ams.confex.com/ams/2019Annual/recordingredirect.cgi/oid/Recording50549/paper349844_1.mp4.

  • Nemunaitis-Berry, K. L., and H. M. Obermeier, 2017: Broadcast meteorologist decision-making in a probabilistic hazard information project. Bull. Amer. Meteor. Soc., 98, 2045–2047, https://doi.org/10.1175/BAMS_9810_2039-2052_Nowcast.

    • Search Google Scholar
    • Export Citation

  • Nemunaitis-Berry, K. L., H. Obermeier, S. A. Jasko, D. LaDue, C. D. Karstens, G. M. Eosco, A. Gerard, and L. Rothfusz, 2017: Broadcast meteorologist decision making in the 2016 Hazardous Weather Testbed probabilistic hazard information project. Fourth Conf. on Weather Warnings and Communication, Kansas City, MO, Amer. Meteor. Soc., 1.4, https://ams.confex.com/ams/45BC4WXCOMM/webprogram/Paper318190.html.

  • Nemunaitis-Berry, K. L., H. Obermeier, K. M. Calhoun, T. C. Meyer, K. E. Klockow-McClain, D. LaDue, Z. Stanford, and A. Gerard, 2020: Incorporating end users in Hazardous Weather Testbed experiments. 10th Conf. on Transition of Research to Operations, Boston, MA, Amer. Meteor. Soc., 2.3, https://ams.confex.com/ams/2020Annual/webprogram/Paper363946.html.

  • Obermeier, H., K. L. Nemunaitis-Berry, S. A. Jasko, D. LaDue, C. Karstens, G. M. Eosco, A. Gerard, and L. Rothfusz, 2017: Broadcast meteorologist decision making in the 2016 hazardous weather test probabilistic hazard information project. 12th Symp. on Societal Applications: Policy, Research and Practice, Seattle, WA, Amer. Meteor. Soc., 4.3, https://ams.confex.com/ams/97Annual/webprogram/Paper314239.html.

  • Obermeier, H., K. Nemunaitis-Berry, K. E. Klockow, C. D. Karstens, A. Gerard, and L. P. Rothfusz, 2018: Broadcast meteorologist decision-making in the 2017 Hazardous Weather Testbed probabilistic hazard information project. 13th Symp. on Societal Applications: Policy, Research and Practice, Austin, TX, Amer. Meteor. Soc., 8.4, https://ams.confex.com/ams/98Annual/webprogram/Paper329820.html.

  • Obermeier, H., K. L. Nemunaitis-Berry, K. E. Klockow-McClain, T. C. Meyer, P. A. Campbell, A. Gerard, and C. Kolakoski, 2019: Communicating probabilistic hazard information: Broadcast meteorologists in the 2018 Hazardous Weather Testbed. 47th Conf. on Broadcast Meteorology/Fifth Conf. on Weather Warnings and Communication, San Diego, CA, Amer. Meteor. Soc., J7.6, https://ams.confex.com/ams/47BC5WxComm/recordingredirect.cgi/oid/Recording54984/paper358620_1.mp4.

  • Obermeier, H., K. L. Nemunaitis-Berry, K. E. Klockow-McClain, T. C. Meyer, P. A. Campbell, A. Gerard, J. E. Trujillo, and C. Carithers, 2020: Communicating probabilistic hazard information: Broadcast meteorologists in the 2018-19 Hazardous Weather Testbed. 15th Symp. on Societal Applications: Policy, Research and Practice, Boston, MA, Amer. Meteor. Soc., 12A.4, https://ams.confex.com/ams/2020Annual/meetingapp.cgi/Paper/368267.

  • Obermeier, H., K. L. Berry, K. E. Klockow-McClain, A. Campbell, C. Carithers, A. Gerard, and J. E. Trujillo-Falcón, 2022: The creation of a research television studio to test probabilistic hazard information with broadcast meteorologists in NOAA’s Hazardous Weather Testbed. Wea. Climate Soc., 14, 949–963, https://doi.org/10.1175/WCAS-D-21-0171.1.

    • Search Google Scholar
    • Export Citation

  • Perkins, D. R., K. Timm, T. Myers, and E. Maibach, 2020: Broadcast meteorologists’ views on climate change: A state-of-the-community review. Wea. Climate Soc., 12, 249–262, https://doi.org/10.1175/WCAS-D-19-0003.1.

    • Search Google Scholar
    • Export Citation

  • Qin, C., S. Joslyn, S. Savelli, J. Demuth, R. Morss, and K. Ash, 2023: The impact of probabilistic tornado warnings on risk perceptions and responses. J. Exp. Psychol. Appl., https://doi.org/10.1037/xap0000486, in press.

    • Search Google Scholar
    • Export Citation

  • Reed, J. R., and J. C. Senkbeil, 2020: Perception and comprehension of the extended forecast graphic: A survey of broadcast meteorologists and the public. Bull. Amer. Meteor. Soc., 101, E221–E236, https://doi.org/10.1175/BAMS-D-19-0078.1.

    • Search Google Scholar
    • Export Citation

  • Ripberger, J., A. Bell, A. Fox, A. Forney, W. Livingston, C. Gaddie, C. Silva, and H. Jenkins-Smith, 2022: Communicating probability information in weather forecasts: Findings and recommendations from a living systematic review of the research literature. Wea. Climate Soc., 14, 481–498, https://doi.org/10.1175/WCAS-D-21-0034.1.

    • Search Google Scholar
    • Export Citation

  • Robertson, M. M., and K. K. Droegemeier, 1990: NEXRAD and the broadcast weather industry: Preparing to share the technology. Bull. Amer. Meteor. Soc., 71, 14–18, https://doi.org/10.1175/1520-0477(1990)071<0014:NATBWI>2.0.CO;2.

    • Search Google Scholar
    • Export Citation

  • Rothfusz, L. P., R. Schneider, D. Novak, K. Klockow-McClain, A. E. Gerard, C. Karstens, G. J. Stumpf, and T. M. Smith, 2018: FACETs: A proposed next-generation paradigm for high-impact weather forecasting. Bull. Amer. Meteor. Soc., 99, 2025–2043, https://doi.org/10.1175/BAMS-D-16-0100.1.

    • Search Google Scholar
    • Export Citation

  • Senkbeil, J. C., D. J. Griffin, K. Sherman-Morris, J. Saari, and K. Brothers, 2021: Improving tornado warning communication for deaf and hard of hearing audiences. J. Oper. Meteor., 9, 18–35, https://doi.org/10.15191/nwajom.2021.0902.

    • Search Google Scholar
    • Export Citation

  • Silva, C. L., J. T. Ripberger, H. C. Jenkins-Smith, and M. Krocak, 2017: Establishing a baseline: Public reception, understanding, and responses to severe weather forecasts and warnings in the contiguous United States. University of Oklahoma, Center for Risk and Crisis Management Reference Rep., 31 pp., https://www.e-education.psu.edu/meteo3/sites/www.e-education.psu.edu.meteo3/files/images/lesson13/WX17-Reference-Report.pdf.

  • Silva, C. L., J. T. Ripberger, H. C. Jenkins-Smith, M. Krocak, and W. W. Wehde, 2018: Refining the baseline: Public reception, understanding, and responses to severe weather forecasts and warnings in the contiguous United States. Center for Risk and Crisis Management Reference Rep., 29 pp.

  • Silva, C. L., J. T. Ripberger, H. C. Jenkins-Smith, M. Krocak, S. Ernst, and A. Bell, 2019: Continuing the baseline: Public reception, understanding, and responses to severe weather forecasts and warnings in the contiguous United States. Center for Risk and Crisis Management Reference Rep., 33 pp.

  • Trujillo-Falcón, J. E., O. Bermúdez, K. Negrón-Hernández, J. Lipski, E. Leitman, and K. Berry, 2021: Hazardous weather communication en español: Challenges, current resources, and future practices. Bull. Amer. Meteor. Soc., 102, E765–E773, https://doi.org/10.1175/BAMS-D-20-0249.1.

    • Search Google Scholar
    • Export Citation

  • Trujillo-Falcón, J. E., and Coauthors, 2022a: ¿Aviso o alerta? Developing effective, inclusive, and consistent watch and warning translations for U.S. Spanish speakers. Bull. Amer. Meteor. Soc., 103, E2791–E2803, https://doi.org/10.1175/BAMS-D-22-0050.1.

    • Search Google Scholar
    • Export Citation

  • Trujillo-Falcón, J. E., J. Reedy, K. E. Klockow-McClain, K. L. Berry, G. J. Stumpf, A. V. Bates, and J. G. LaDue, 2022b: Creating a communication framework for FACETs: How probabilistic hazard information affected warning operations in NOAA’s Hazardous Weather Testbed. Wea. Climate Soc., 14, 881–892, https://doi.org/10.1175/WCAS-D-21-0136.1.

    • Search Google Scholar
    • Export Citation

  • Wilson, K. A. P., and Coauthors, 2023: Five years of user-focused warn-on-forecast research. Special Symp. on Forecasting a Continuum of Environmental Threats (FACETs), Denver, CO, Amer. Meteor. Soc., 5.1, https://ams.confex.com/ams/103ANNUAL/meetingapp.cgi/Paper/417823.

All Time Past Year Past 30 Days
Abstract Views 833 692 22
Full Text Views 359 314 3
PDF Downloads 330 282 3