Tornadoes, Social Science, and the False Alarm Effect

Joseph E. Trainor Disaster Research Center, School of Public Policy and Administration, University of Delaware, Newark, Delaware

Search for other papers by Joseph E. Trainor in
Current site
Google Scholar
PubMed
Close
,
Danielle Nagele NOAA/National Ocean Service/Center for Operational Oceanographic Products and Services, Silver Spring, Maryland, and Disaster Research Center, School of Public Policy and Administration, University of Delaware, Newark, Delaware

Search for other papers by Danielle Nagele in
Current site
Google Scholar
PubMed
Close
,
Brenda Philips Resource Economics, Center for Collaborative Adaptive Sensing of the Atmosphere, Electrical and Computer Engineering, University of Massachusetts Amherst, Amherst, Massachusetts

Search for other papers by Brenda Philips in
Current site
Google Scholar
PubMed
Close
, and
Brittany Scott Disaster Research Center, Department of Sociology, University of Delaware, Newark, Delaware

Search for other papers by Brittany Scott in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Despite considerable interest in the weather enterprise, there is little focused research on the “false alarm effect.” Within the body of research that does exist, findings are mixed. Some studies suggest that the false alarm effect is overstated, while several recent efforts have provided evidence that FAR may be a significant determinate of behavior. This effort contributes to the understanding of FAR through a sociological analysis of public perceptions and behavioral responses to tornadoes. This analysis begins by addressing public definitions of FAR and then provides two statistical models, one focused on perception of FAR and one focused on behavioral response to tornado warnings. The authors’ approach incorporates a number of sociological and other social science concepts as predictors in both of these models. Findings provide a number of important insights. Most notably, it is found that 1) there is a wide degree of variation in public definitions of false alarm, 2) actual county FAR rates do not predict perception of FAR, 3) actual county FAR rates do predict behavioral response, and 4) planning and family characteristics are also influential. Another major contribution is to illustrate the significant complexity associated with analysis of false alarms. Conclusions discuss the limits of this analysis and future direction for this type of research.

Corresponding author address: Joseph E. Trainor, School of Public Policy and Administration, University of Delaware, 166 Graham Hall, Newark, DE 19716. E-mail: jtrainor@udel.edu

Abstract

Despite considerable interest in the weather enterprise, there is little focused research on the “false alarm effect.” Within the body of research that does exist, findings are mixed. Some studies suggest that the false alarm effect is overstated, while several recent efforts have provided evidence that FAR may be a significant determinate of behavior. This effort contributes to the understanding of FAR through a sociological analysis of public perceptions and behavioral responses to tornadoes. This analysis begins by addressing public definitions of FAR and then provides two statistical models, one focused on perception of FAR and one focused on behavioral response to tornado warnings. The authors’ approach incorporates a number of sociological and other social science concepts as predictors in both of these models. Findings provide a number of important insights. Most notably, it is found that 1) there is a wide degree of variation in public definitions of false alarm, 2) actual county FAR rates do not predict perception of FAR, 3) actual county FAR rates do predict behavioral response, and 4) planning and family characteristics are also influential. Another major contribution is to illustrate the significant complexity associated with analysis of false alarms. Conclusions discuss the limits of this analysis and future direction for this type of research.

Corresponding author address: Joseph E. Trainor, School of Public Policy and Administration, University of Delaware, 166 Graham Hall, Newark, DE 19716. E-mail: jtrainor@udel.edu
Save
  • AAPOR, 2008: Cell phone task force report. American Association of Public Opinion Research, 60 pp.

  • Aguirre, B. E., Wenger D. , and Vigo G. , 1998: A test of emergent norm theory of collective behavior. Sociol. Forum, 13, 301320, doi:10.1023/A:1022145900928.

    • Search Google Scholar
    • Export Citation
  • Andra, D. L., Quoetone E. M. , and Bunting W. F. , 2002: Warning decision making: The relative roles of conceptual models, technology, strategy, and forecaster expertise on 3 May 1999. Wea. Forecasting, 17, 559566, doi:10.1175/1520-0434(2002)017<0559:WDMTRR>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Atwood, L. E., and Major A. M. , 1998: Exploring the “cry wolf” hypothesis. Int. J. Mass Emerg. Disasters, 16, 279302.

  • Baker, E. J., 1979: Predicting response to hurricane warnings: A reanalysis of data from four studies. Mass Emerg., 4, 924.

  • Baker, E. J., 1984: Public response to hurricane probability forecasts. NWS Tech. Rep., 35 pp.

  • Baker, E. J., 1987: Warning and evacuation in Hurricanes Elena and Kate. Tech. Rep., Dept. of Geography, Florida State University.

  • Balluz, L., Schieve L. , Holmes T. , Kiezak S. , and Malilay J. , 2000: Predictors for people’s response to a tornado warning: Arkansas, 1 March 1997. Disasters, 24, 7177, doi:10.1111/1467-7717.00132.

    • Search Google Scholar
    • Export Citation
  • Barnes, L. R., 2006: False alarms: Warning project research findings and warning accuracy conceptual model. WAS*IS Presentation. [Available online at http://www.sip.ucar.edu/wasis/boulder06/ppt/False%20alarms%20-%20Barnes.ppt.]

  • Barnes, L. R., Benight C. C. , Gruntfest E. C. , Hayden M. H. , and Schultz D. M. , 2006: False alarms and close calls: A conceptual model of warning accuracy. Wea. Forecasting, 22, 11401147, doi:10.1175/WAF1031.1.

    • Search Google Scholar
    • Export Citation
  • Bateman, J. M., and Edwards B. , 2002: Gender and evacuation: A closer look at why women are more likely to evacuate for hurricanes. Nat. Hazards Rev., 3, 107117, doi:10.1061/(ASCE)1527-6988(2002)3:3(107).

    • Search Google Scholar
    • Export Citation
  • Benight, C., Gruntfest E. , and Sparks K. , 2004: Colorado Wildfires 2002. Quick Response Rep. 167, Natural Hazards Center, University of Colorado Boulder, 9 pp. [Available online at http://www.colorado.edu/hazards/research/qr/qr167/qr167.html.]

  • Blanchard-Boehm, R. D., 1998: Understanding public response to increased risk from natural hazards: Application of the hazards risk communication framework. Int. J. Mass Emerg. Disasters, 16, 247278.

    • Search Google Scholar
    • Export Citation
  • Blanchard-Boehm, R. D., and Cook M. J. , 2004: Risk communication and public education in Edmonton, Alberta, Canada on the 10th anniversary of the “Black Friday” tornado. Int. Res. Geogr. Environ. Educ., 13, 3854, doi:10.1080/10382040408668791.

    • Search Google Scholar
    • Export Citation
  • Boyatzis, R. E., 1998: Transforming Qualitative Information: Thematic Analysis and Code Development. SAGE Publications, 200 pp.

  • Breznitz, S., 1984: Cry Wolf: The Psychology of False Alarms. Lawrence Erlbaum Associates, 280 pp.

  • Carter, M. T., Kendall S. , and Clark J. P. , 1983: Household response to warnings. Int. J. Mass Emerg. Disasters, 9, 94104.

  • Clarke, L., and Short J. F. Jr., 1993: Social organization and risk: Some current controversies. Annu. Rev. Sociol., 19, 375399, doi:10.1146/annurev.so.19.080193.002111.

    • Search Google Scholar
    • Export Citation
  • Cola, R. M., 1996: Responses of Pampanga households to lahar warnings: Lessons from two villages in the Pasig-Potrero River watershed. Fire and Mud: Eruptions and Lahars of Mount Pinatubo, Philippines, C. G. Newhall and R. S. Punongbayan, Eds., University of Washington Press, 141–149.

  • Comstock, R. D., and Mallonee S. , 2005: Comparing reactions to two severe tornadoes in one Oklahoma community. Disasters, 29, 277287, doi:10.1111/j.0361-3666.2005.00291.x.

    • Search Google Scholar
    • Export Citation
  • Corbin, J., and Strauss A. , 2008: Basics of Qualitative Research. 3rd ed. Sage Publications, 379 pp.

  • Cuthbertson, B. H., and Nigg J. M. , 1987: Technological disaster and the nontherapeutic community: A question of true victimization. Environ. Behavior, 19, 462–483, doi:10.1177/0013916587194004.

  • Cutter, S. L., 1987: Airborne toxic releases: Are communities prepared? Environment, 29, 1231, doi:10.1080/00139157.1987.9931330.

  • Cutter, S. L., and Barnes K. , 1982: Evacuation behavior and Three Mile Island. Disasters, 6, 116124, doi:10.1111/j.1467-7717.1982.tb00765.x.

    • Search Google Scholar
    • Export Citation
  • Dow, K., and Cutter S. L. , 1998: Crying wolf: Repeat responses to hurricane evacuation orders. Coast. Manage., 26, 237252, doi:10.1080/08920759809362356.

    • Search Google Scholar
    • Export Citation
  • Drabek, T. E., and Boggs K. S. , 1968: Families in disaster: Reactions and relatives. J. Marriage Fam., 30, 443451, doi:10.2307/349914.

    • Search Google Scholar
    • Export Citation
  • Drabek, T. E., and Stephenson J. S. III, 1971: When disaster strikes. J. Appl. Soc. Psychol., 1, 187203, doi:10.1111/j.1559-1816.1971.tb00362.x.

    • Search Google Scholar
    • Export Citation
  • Edwards, M. L., 1993: Social location and self protective behavior: Implications for earthquake preparedness. Int. J. Mass Emerg. Disasters, 11, 293303.

    • Search Google Scholar
    • Export Citation
  • Flynn, C. B., 1979: Three Mile Island Telephone Survey: Preliminary Report on Procedures and Findings. University of Michigan, 100 pp.

  • Flynn, C. B., and Chalmers J. A. , 1980: The social and economic effects of the accident at Three Mile Island. U.S. Nuclear Regulatory Commission Rep. NUREG/CR-1215, 99 pp.

  • Flynn, J., Slovic P. , and Mertz C. K. , 1994: Gender, race, and perception of environmental health risks. Risk Anal., 14, 11011108, doi:10.1111/j.1539-6924.1994.tb00082.x.

    • Search Google Scholar
    • Export Citation
  • Fothergill, A., 1996: Gender, risk, and disaster. Int. J. Mass Emerg. Disasters, 14, 3356.

  • Gruntfest, E., 1977: What people did during the Big Thompson Flood. Working Paper 32, University of Colorado, 62 pp.

  • Gruntfest, E., 1997: Warning dissemination and response with short lead times. Flood Hazard Management: British and International Perspectives, J. Handmer, Ed., GEO Books, 191–202.

  • Hodge, D., Sharp V. , and Marts M. , 1981: Contemporary responses to volcanisim: Case studies from the Cascades and Hawaii. Volcanic Activity and Human Ecology, P. D. Sheets and D. K. Grayson, Eds., Academic New York, 221–248.

  • Hodler, T. W., 1982: Residents’ preparedness and response to the Kalamazoo tornado. Disasters, 6, 4449, doi:10.1111/j.1467-7717.1982.tb00743.x.

    • Search Google Scholar
    • Export Citation
  • Houts, P. S., Lindell M. K. , Hu T. W. , Cleary P. D. , Tokuhata G. , and Flynn C. B. , 1984: The protective action decision model applied to evacuation during the Three Mile Island crisis. Int. J. Mass Emerg. Disasters, 2, 2739.

    • Search Google Scholar
    • Export Citation
  • Lachman, R., Tatsuoka M. , and Bonk W. , 1961: Human behavior during the tsunami of 1960. Science, 133, 14051409, doi:10.1126/science.133.3462.1405.

    • Search Google Scholar
    • Export Citation
  • Landry, T., and Rogers G. , 1982: Warning confirmation and dissemination. Rep., Center for Social and Urban Research, University of Pittsburgh.

  • Lerner, J. S., Gonzalez R. M. , Small D. A. , and Fischhoff B. , 2003: Effects of fear and anger on perceived risks of terrorism: A national field experiment. Psychol. Sci., 14, 144150, doi:10.1111/1467-9280.01433.

    • Search Google Scholar
    • Export Citation
  • Lindell, M. K., and Perry R. W. , 1987: Warning mechanisms in emergency response systems. Int. J. Mass Emerg. Disasters, 5, 137153.

  • Lindell, M. K., Perry R. W. , and Greene M. R. , 1980: Race and disaster warning response. Research Rep., Battelle Human Affairs Research Centers, 13 pp.

  • Mack, R. W., and Baker G. W. , 1961: The Occasion Instant: The Structure of Social Response to Unanticipated Air Raid Warnings. National Research Council, 69 pp.

  • Mileti, D. S., and Sorenson J. H. , 1990: Communication of emergency public warnings: A social science perspective and state of-the-art assessment. Oak Ridge National Rep. ORNL-6609, 145 pp.

  • Mileti, D. S., and O’Brien P. W. , 1992: Warnings during disaster: Normalizing communicated risk. Soc. Probl., 39, 4057, doi:10.2307/3096912.

    • Search Google Scholar
    • Export Citation
  • Mileti, D. S., and Darlington J. , 1997: The role of searching in shaping reactions to earthquake risk information. Soc. Probl., 44, 89103, doi:10.2307/3096875.

    • Search Google Scholar
    • Export Citation
  • Nagele, D., and Trainor J. E. , 2012: Geographic specificity, tornadoes, and protective action. Wea. Climate Soc., 4, 145155, doi:10.1175/WCAS-D-11-00047.1.

    • Search Google Scholar
    • Export Citation
  • National Weather Service, 2011: National Weather Service Instruction 10-1601. Accessed 17 August 2015. [Available online at http://www.nws.noaa.gov/directives/sym/pd01016001curr.pdf.]

  • NOAA/NWS Office of Climate, Water, and Weather Services, 1986a: Verification: Severe weather (updated daily). NWS Performance Branch Verification Program. Subset used: January 2009–January 2014, accessed 1 September 2014. [Available online at https://verification.nws.noaa.gov/content/pm/verif/index.aspx.]

  • NOAA/NWS Office of Climate, Water, and Weather Services, 1986b: Verification: Severe weather (updated daily) and interactive product database (updated daily). NWS Performance Branch Verification Program. Subset used: October 2007–December 2010, accessed 12 December 2012. [Available online at https://verification.nws.noaa.gov/content/pm/verif/index.aspx.]

  • O’Brien, P. W., and Atchison P. , 1998: Gender differentiation and aftershock warning response. The Gendered Terrain of Disaster: Through Women’s Eyes, E. Enarson and B. H. Morrow, Ed., Greenwood Publishing Group, 173–180.

  • Perry, R. W., 1982: The Social Psychology of Civil Defense. Lexington Books, 127 pp.

  • Perry, R. W., and Lindell M. K. , 1997: Aged citizens in the warning phase of disasters: Re-examining the evidence. Int. J. Aging Hum. Dev., 44, 257267, doi:10.2190/RT3X-6MEJ-24AQ-03PT.

    • Search Google Scholar
    • Export Citation
  • Perry, R. W., Lindell M. K. , and Green M. R. , 1981: Evacuation Planning in Emergency Management. D. C. Heath, 201 pp.

  • Pew Research Center, 2012: Assessing the representativeness of public opinion surveys. Accessed 17 August 2015. [Available online at http://www.people-press.org/2012/05/15/assessing-the-representativeness-of-public-opinion-surveys/.]

  • Riad, J. K., and Norris F. H. , 1998: Hurricane threat and evacuation intentions: An analysis of risk perception, preparedness, social influence and resources. Preliminary Paper 271, Disaster Research Center, University of Delaware, 34 pp.

  • Ripberger, J. T., Silva C. L. , Jenkins-Smith H. C. , Carlson D. E. , James M. , and Herron K. G. , 2015: False alarms and missed events: The impact and origins of perceived inaccuracy in tornado warning systems. Risk Anal., 35, 44–56, doi:10.1111/risa.12262.

    • Search Google Scholar
    • Export Citation
  • Schultz, D. M., Gruntfest E. C. , Hayden M. H. , Benight C. C. , Drobot S. , and Barnes L. R. , 2010: Decision making by Austin, Texas, residents in hypothetical tornado scenarios. Wea. Climate Soc., 2, 249254, doi:10.1175/2010WCAS1067.1.

    • Search Google Scholar
    • Export Citation
  • Simmons, K. M., and Sutter D. , 2006: Improvements in tornado warnings and tornado casualties. Int. J. Mass Emerg. Disasters, 24, 351369.

    • Search Google Scholar
    • Export Citation
  • Simmons, K. M., and Sutter D. , 2007: The Groundhog Day Florida tornadoes: A case study of high-vulnerability tornadoes. Quick Response Rep. 193, Natural Hazards Center, 9 pp. [Available online at http://www.colorado.edu/hazards/research/qr/qr193/qr193.html.]

  • Simmons, K. M., and Sutter D. , 2009: False alarms tornado warnings, and tornado casualties. Wea. Climate Soc., 1, 3853, doi:10.1175/2009WCAS1005.1.

    • Search Google Scholar
    • Export Citation
  • Simmons, K. M., and Sutter D. , 2011: Economic and Societal Impacts of Tornadoes. Amer. Meteor. Soc., 282 pp.

  • Tierney, K. J., 1999: Towards a critical sociology of risk. Sociol. Forum, 14, 215242.

  • Turner, B. A., 1976: The organizational and interorganizational development of disasters. Adm. Sci. Quart., 21, 378–397, doi:10.2307/2391850.

    • Search Google Scholar
    • Export Citation
  • Turner, R. H., Nigg J. M. , Paz D. H. , and Young B. S. , 1981: Community Response to Earthquake Threat in Southern California: Part 10, Summary and Recommendations. Institute for Social Science Research, University of California, Los Angeles, 133 pp.

  • White, M. P., and Eiser J. R. , 2006: Marginal trust in risk managers: Building and losing trust following decisions under uncertainty. Risk Anal., 26, 11871203, doi:10.1111/j.1539-6924.2006.00807.x.

    • Search Google Scholar
    • Export Citation
  • Wilkinson, K. P., and Ross P. J. , 1970: Citizen response to warnings of Hurricane Camille. Social Science Research Center Rep., Mississippi State University, 60 pp.

  • Yin, R. K., 2009: Case Study Research: Design and Methods. 4th ed. Sage Publications, 240 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1933 534 43
PDF Downloads 1206 391 30