Severe Weather Warning Communication: Factors Impacting Audience Attention and Retention of Information during Tornado Warnings

Robert Drost Geocognition Research Lab, Department of Geological Sciences, Michigan State University, East Lansing, Michigan

Search for other papers by Robert Drost in
Current site
Google Scholar
PubMed
Close
,
Mark Casteel Department of Psychology, Penn State University, York, Pennsylvania

Search for other papers by Mark Casteel in
Current site
Google Scholar
PubMed
Close
,
Julie Libarkin Geocognition Research Lab, Department of Geological Sciences, Michigan State University, East Lansing, Michigan

Search for other papers by Julie Libarkin in
Current site
Google Scholar
PubMed
Close
,
Stephen Thomas Center for Integrative Studies in General Science, Michigan State University, East Lansing, Michigan

Search for other papers by Stephen Thomas in
Current site
Google Scholar
PubMed
Close
, and
Matt Meister Falcon School District 49, Peyton, Colorado

Search for other papers by Matt Meister in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Weather hazards in the United States inflict both personal and economic tolls on the public. Communicating warnings about weather hazards is an important duty of TV weathercasters. Televised weather warnings are typically conveyed through live radar, live coverage, and warning scrolls. However, these traditional approaches may not be entirely effective given the limited attention some members of the public pay to these warnings. A study comparing individual responses to a traditional warning, an animated warning, and an audio warning was undertaken to evaluate the impact of delivery methods on viewer attention, retention, and preferences during viewing of severe weather warnings. A Tobii T60 eye tracker was used to document visual interactions with on-screen warnings and surveys were used to collect evidence of warning retention and preference. Demographic variables were also collected to describe the study population. Results indicate that viewers of the animated warning retained more pertinent information about the tornado warning than viewers of the traditional warning, and retention during the traditional warning was equivalent to that of the audio warning. In addition, gaze patterns for the traditional warning were much more diffuse than for the animated warning, suggesting that attention was more focused on the animation than the live video. In addition, modifications to reduce visual complexity of traditional warnings may positively impact viewer attention to individual warning elements. Future studies will consider the effectiveness of a hybrid warning containing both traditional and animated components. The current research study can be used to advance current severe weather warning communication techniques and increase public awareness during severe weather events.

Current affiliation: Southern New Hampshire University, Manchester, New Hampshire.

Corresponding author address: Robert Drost, Geocognition Research Lab, Department of Geological Sciences, 206 Natural Science, Michigan State University, East Lansing, MI 48824. E-mail: drostrob@msu.edu

Abstract

Weather hazards in the United States inflict both personal and economic tolls on the public. Communicating warnings about weather hazards is an important duty of TV weathercasters. Televised weather warnings are typically conveyed through live radar, live coverage, and warning scrolls. However, these traditional approaches may not be entirely effective given the limited attention some members of the public pay to these warnings. A study comparing individual responses to a traditional warning, an animated warning, and an audio warning was undertaken to evaluate the impact of delivery methods on viewer attention, retention, and preferences during viewing of severe weather warnings. A Tobii T60 eye tracker was used to document visual interactions with on-screen warnings and surveys were used to collect evidence of warning retention and preference. Demographic variables were also collected to describe the study population. Results indicate that viewers of the animated warning retained more pertinent information about the tornado warning than viewers of the traditional warning, and retention during the traditional warning was equivalent to that of the audio warning. In addition, gaze patterns for the traditional warning were much more diffuse than for the animated warning, suggesting that attention was more focused on the animation than the live video. In addition, modifications to reduce visual complexity of traditional warnings may positively impact viewer attention to individual warning elements. Future studies will consider the effectiveness of a hybrid warning containing both traditional and animated components. The current research study can be used to advance current severe weather warning communication techniques and increase public awareness during severe weather events.

Current affiliation: Southern New Hampshire University, Manchester, New Hampshire.

Corresponding author address: Robert Drost, Geocognition Research Lab, Department of Geological Sciences, 206 Natural Science, Michigan State University, East Lansing, MI 48824. E-mail: drostrob@msu.edu
Save
  • Baddeley, A. D., and Hitch G. , 1974: Working memory. The Psychology of Learning and Motivation, G. A. Bower, Ed., Academic Press, 48–79.

  • Bech, J., Molina T. , Vilaclara E. , and Lorente J. , 2010: Improving TV weather broadcasts with technological advancements: Two cases from a 20 year perspective. Meteor. Appl., 17, 142–148, doi:10.1002/met.195.

    • Search Google Scholar
    • Export Citation
  • Bergen, L., Grimes T. , and Potter D. , 2005: How attention partitions itself during simultaneous message presentations. Hum. Commun. Res., 31, 311–336, doi:10.1111/j.1468-2958.2005.tb00874.x.

    • Search Google Scholar
    • Export Citation
  • Brotzge, J., and Donner W. R. , 2013: The tornado warning process: A review of current research, challenges, and opportunities. Bull. Amer. Meteor. Soc., 94, 1715–1733, doi:10.1175/BAMS-D-12-00147.1.

    • Search Google Scholar
    • Export Citation
  • Canham, M., and Hegarty M. , 2010: Effects of knowledge and display design on comprehension of complex graphics. Learn. Instr., 20, 155–166, doi:10.1016/j.learninstruc.2009.02.014.

    • Search Google Scholar
    • Export Citation
  • Drost, R., 2013: Memory and decision-making: Determining action when the sirens sound. Wea. Climate Soc., 5, 43–54, doi:10.1175/WCAS-D-11-00042.1.

    • Search Google Scholar
    • Export Citation
  • Duchowski, A. T., 2002: A breadth-first survey of eye-tracking applications. Behav. Res. Methods Instrum. Comput., 34, 455–470, doi:10.3758/BF03195475.

    • Search Google Scholar
    • Export Citation
  • Erickson, S. A., and Brooks H. E. , 2006: Lead time and time under tornado warnings: 1986–2004. 23rd Conf. on Severe Local Storms, St. Louis, MO, Amer. Meteor. Soc., 11.5. [Available online at https://ams.confex.com/ams/23SLS/techprogram/paper_115194.htm.]

  • Fiedrich, F., and Burghardt P. , 2007: Agent-based systems for disaster management. Commun. ACM, 50, 41–42, doi:10.1145/1226736.1226763.

    • Search Google Scholar
    • Export Citation
  • Folger, P., 2013: Severe thunderstorms and tornadoes in the United States. Congressional Research Service 7-5700, R40097, 23 pp. [Available online at https://www.fas.org/sgp/crs/misc/R40097.pdf.]

  • Hammer, B., and Schmidlin T. , 2002: Response to warnings during the 3 May 1999 Oklahoma City tornado: Reasons and relative injury rates. Wea. Forecasting, 17, 577–581, doi:10.1175/1520-0434(2002)017<0577:RTWDTM>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Hegarty, M., and Kriz S. , 2008: Effects of knowledge and spatial ability on learning from animation. Learning with Animation: Research Implications for Design, R. Lowe and W. Schnotz, Eds., Cambridge University Press, 3–29.

  • Hegarty, M., Smallman H. S. , Stull A. T. , and Canham M. S. , 2009: Naïve cartography: How intuitions about display configuration can hurt performance. Cartographica, 44, 171–186, doi:10.3138/carto.44.3.171.

    • Search Google Scholar
    • Export Citation
  • Hudson, M. J., Wagenmaker R. , Mann G. , Smith B. , Thompson R. , Ferree J. , and Entremont C. , 2015: Science that drives service: The NWS impact-based warning demonstration. Third Symp. on Building a Weather-Ready Nation: Enhancing Our Nation’s Readiness, Responsiveness, and Resilience to High Impact Weather Events, Phoenix, AZ, Amer. Meteor. Soc., TJ4.1. [Available online at https://ams.confex.com/ams/95Annual/webprogram/Paper260627.html.]

  • IPG Media Lab, 2011: Are all screens created equal? A research study by the IPG Media Lab. [Available online at https://www.ipglab.com/2013/08/22/are-all-screens-created-equal-a-research-study-by-the-ipg-media-lab/.]

  • Josephson, S., and Holmes M. , 2006: Clutter or content? How on-screen enhancements affect how TV viewers scan and what they learn. Proceedings ETRA 2006: Symposium on Eye Tracking Research and Applications, Stephen N. Spencer, Ed., Association for Computing Machinery, 155–162.

  • Kuligowski, E. D., Phan L. T. , Levitan M. L. , and Jorgensen D. P. , 2013: Preliminary reconnaissance of the May 20, 2013, Newcastle-Moore tornado in Oklahoma. National Institute of Standards and Technology, NIST SP 1164, 59 pp. [Available online at http://www.nist.gov/manuscript-publication-search.cfm?pub_id=914721.]

  • Lazo, J. K., Morss R. E. , and deMuth J. L. , 2009: 300 billion served: Sources, perceptions, uses, and values of weather forecasts. Bull. Amer. Meteor. Soc., 90, 785–798, doi:10.1175/2008BAMS2604.1.

    • Search Google Scholar
    • Export Citation
  • Mayer, R. E., and Moreno R. , 1998: A split-attention effect in multimedia learning: Evidence for dual processing systems in working memory. J. Educ. Psychol., 90, 312–320, doi:10.1037/0022-0663.90.2.312.

    • Search Google Scholar
    • Export Citation
  • Mayer, R. E., Hegarty M. , Mayer S. , and Campbell J. , 2005: When static media promote active learning: Annotated illustrations versus narrated animations in multimedia instruction. J. Exp. Psychol. Appl., 11, 256–265, doi:10.1037/1076-898X.11.4.256.

    • Search Google Scholar
    • Export Citation
  • Mendelson, A., 2001: Effects of novelty in news photographs on attention and memory. Media Psychol., 3, 119–157, doi:10.1207/S1532785XMEP0302_02.

    • Search Google Scholar
    • Export Citation
  • Mileti, D. S., 1999: Disasters by Design: A Reassessment of Natural Hazards in the United States. Joseph Henry Press, 371 pp.

  • Mileti, D. S., and Sorensen J. H. , 1990: Communication of emergency public warnings. A social science perspective and state-of-the-art assessment. Oak Ridge National Laboratory Rep. ORNL-6609, 166 pp.

  • Mileti, D. S., and Peek L. , 2000: The social psychology of public response to warnings of a nuclear power plant accident. J. Hazard. Mater., 75, 181–194, doi:10.1016/S0304-3894(00)00179-5.

    • Search Google Scholar
    • Export Citation
  • Munich Re, 2012: Severe weather in North America: Perils, risks, insurance. Munich Re, 8 pp. [Available online at https://www.munichreamerica.com/site/mram/get/documents_E1449378742/mram/assetpool.mr_america/PDFs/3_Publications/ks_severe_weather_na_exec_summary.pdf.]

  • National Research Council, 2011: Public response to alerts and warnings on mobile devices: Summary of a workshop on current knowledge and research gaps. National Academies Press, 78 pp. [Available online at http://www.nap.edu/catalog/15853/public-response-to-alerts-and-warnings-using-social-media-report.]

  • NCDC, 2013: Extreme events. National Climatic Data Center (now National Centers for Environmental Information), accessed December 2013. [Available online at www.ncdc.noaa.gov/climate-information/extreme-events.]

  • NOAA, 2009: Service Assessment of the Super Tuesday tornado outbreak of February 5–6, 2008. 48 pp. [Available online at http://www.nws.noaa.gov/om/assessments/pdfs/super_tuesday.pdf.]

  • NOAA, 2010: Thunderstorms, tornadoes, lightning … Nature’s most violent storms. 18 pp. [Available online at http://www.nws.noaa.gov/om/severeweather/resources/ttl6-10.pdf.]

  • NOAA, 2013: Weather. Accessed December 2013. [Available online at http://www.noaa.gov/wx.html.]

  • NWS, 2012: Impact based warnings. National Weather Service. Accessed December 2013. [Available online at http://www.weather.gov/impacts/#.Vdda6_lViko.]

  • NWS, 2013: National Weather Service mission statement. National Weather Service. Accessed December 2013. [Available online at http://www.nws.noaa.gov/mission.php.]

  • Perry, R. W., and Lindell M. , 1991: The effects of ethnicity on evacuation decision-making. Int. J. Mass Emerg. Disasters, 9, 47–68.

    • Search Google Scholar
    • Export Citation
  • Perry, R. W., Lindell M. , and Greene M. R. , 1981: Evacuation Planning in Emergency Management. Lexington Books, 199 pp.

  • Quarantelli, E. L., 1980: Evacuation behavior and problems: Findings and implications from the research literature. Disaster Research Center, Ohio State University, 214 pp.

  • Rayner, K., 1998: Eye movements in reading and information processing: 20 years of research. Psychol. Bull., 124, 372–422, doi:10.1037/0033-2909.124.3.372.

    • Search Google Scholar
    • Export Citation
  • Riad, J. K., Norris F. H. , and Ruback R. B. , 1999: Predicting evacuation in two major disasters: Risk perception, social influence, and access to resources. J. Appl. Soc. Psychol., 29, 918–934, doi:10.1111/j.1559-1816.1999.tb00132.x.

    • Search Google Scholar
    • Export Citation
  • Schmidlin, T. W., Hammer B. O. , Ono Y. , and King P. S. , 2009: Tornado shelter-seeking behavior and tornado shelter options among mobile home residents in the United States. Nat. Hazards, 48, 191–201, doi:10.1007/s11069-008-9257-z.

    • Search Google Scholar
    • Export Citation
  • Sherman-Morris, K., 2010: Tornado warning dissemination and response at a university campus. Nat. Hazards, 52, 623–638, doi:10.1007/s11069-009-9405-0.

    • Search Google Scholar
    • Export Citation
  • Simmons, K., and Sutter D. , 2009: False alarms, tornado warnings, and tornado casualties. Wea. Climate Soc., 1, 38–53, doi:10.1175/2009WCAS1005.1.

    • Search Google Scholar
    • Export Citation
  • Smith, D. F., 2013: The frequency of severe weather events. EQECAT, Casualty Actuarial Society, 36 pp. [Available online at https://www.casact.org/education/rpm/2013/handouts%5CPaper_1667_handout_877_0.pdf.]

  • Tobii Eye Tracking, 2010: An introduction to eye tracking and Tobii eye trackers. Tobii Technology White Paper, 12 pp.

  • Tversky, B., Morrision J. , and Betrancourt M. , 2002: Animation: Can it facilitate? Int. J. Hum. Comput. Stud., 57, 247–262, doi:10.1006/ijhc.2002.1017.

    • Search Google Scholar
    • Export Citation
  • USGS, 2007: Natural hazards—A national threat. United States Geological Survey. [Available online at http://pubs.usgs.gov/fs/2007/3009/2007-3009.pdf.]

  • VanRullen, R., Carlson T. , and Cavanagh P. , 2007: The blinking spotlight of attention. Proc. Natl. Acad. Sci. USA, 104, 19 204–19 209, doi:10.1073/pnas.0707316104.

    • Search Google Scholar
    • Export Citation
  • Wagenaar, W., Schreuder R. , and van der Heijden A. , 1985: Do TV pictures help people to remember the weather forecast? Ergonomics, 28, 765–772, doi:10.1080/00140138508963196.

    • Search Google Scholar
    • Export Citation
  • Wolf, P. L., 2009: Warning success rate: Increasing the convective warning’s role in protecting life and property. Electron. J. Oper. Meteor., 10, 1–17. [Available online at www.nwas.org/ej/pdf/2009-EJ7.pdf.]

    • Search Google Scholar
    • Export Citation
  • WMO, 2005: Guidelines on weather broadcasting and the use of radio for the delivery of weather information. WMO/TD No. 1278, 54 pp. [Available online at https://www.wmo.int/pages/prog/amp/pwsp/pdf/TD-1278.pdf.]

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 4635 1559 125
PDF Downloads 1612 284 39