Search Results
You are looking at 1 - 3 of 3 items for
- Author or Editor: Eve C. Gruntfest x
- Refine by Access: Content accessible to me x
Abstract
Two items need to be clarified from an earlier work of the authors. The first is that the layout of the 2 × 2 contingency table was reversed from standard practice, with the titles of “observed event” and “forecast” transposed. The second is that FAR should have represented “false alarm ratio,” not “false alarm rate.” Unfortunately, the terminology used in the atmospheric sciences is confusing, with authors as early as 1965 having used the terminology differently from currently accepted practice. More recent studies are not much better. A survey of peer-reviewed articles published in American Meteorological Society journals between 2001 and 2007 found that, of 26 articles using those terms, 10 (38%) used them inconsistently with the currently accepted definitions. This article recommends that authors make explicit how their verification statistics are calculated in their manuscripts and consider using the terms probability of false detection and probability of false alarm instead of false alarm rate and false alarm ratio.
Abstract
Two items need to be clarified from an earlier work of the authors. The first is that the layout of the 2 × 2 contingency table was reversed from standard practice, with the titles of “observed event” and “forecast” transposed. The second is that FAR should have represented “false alarm ratio,” not “false alarm rate.” Unfortunately, the terminology used in the atmospheric sciences is confusing, with authors as early as 1965 having used the terminology differently from currently accepted practice. More recent studies are not much better. A survey of peer-reviewed articles published in American Meteorological Society journals between 2001 and 2007 found that, of 26 articles using those terms, 10 (38%) used them inconsistently with the currently accepted definitions. This article recommends that authors make explicit how their verification statistics are calculated in their manuscripts and consider using the terms probability of false detection and probability of false alarm instead of false alarm rate and false alarm ratio.
Abstract
The false alarm rate (FAR) measures the fraction of forecasted events that did not occur, and it remains one of the key metrics for verifying National Weather Service (NWS) weather warnings. The national FAR for tornado warnings in 2003 was 0.76, indicating that only one in four tornado warnings was verified. The NWS’s goal for 2010 is to reduce this value to 0.70. Conventional wisdom is that false alarms reduce the public’s willingness to respond to future events. This paper questions this conventional wisdom. In addition, this paper argues that the metrics used to evaluate false alarms do not accurately represent the numbers of actual false alarms or the forecasters’ abilities because current metrics categorize events as either a hit or a miss and do not give forecasters credit for close calls. Aspects discussed in this paper include how the NWS FAR is measured, how humans respond to warnings, and what are alternative approaches to measure FAR. A conceptual model is presented as a framework for a new perspective on false alarms that includes close calls, providing a more balanced view of forecast verification.
Abstract
The false alarm rate (FAR) measures the fraction of forecasted events that did not occur, and it remains one of the key metrics for verifying National Weather Service (NWS) weather warnings. The national FAR for tornado warnings in 2003 was 0.76, indicating that only one in four tornado warnings was verified. The NWS’s goal for 2010 is to reduce this value to 0.70. Conventional wisdom is that false alarms reduce the public’s willingness to respond to future events. This paper questions this conventional wisdom. In addition, this paper argues that the metrics used to evaluate false alarms do not accurately represent the numbers of actual false alarms or the forecasters’ abilities because current metrics categorize events as either a hit or a miss and do not give forecasters credit for close calls. Aspects discussed in this paper include how the NWS FAR is measured, how humans respond to warnings, and what are alternative approaches to measure FAR. A conceptual model is presented as a framework for a new perspective on false alarms that includes close calls, providing a more balanced view of forecast verification.
Abstract
One of the goals of the Warning Project is to understand how people receive warnings of hazardous weather and subsequently use this information to make decisions. As part of the project, 519 surveys from Austin, Texas, floodplain residents were collected and analyzed. About 90% of respondents understood that a tornado warning represented a more serious and more likely threat than a tornado watch. Most respondents (86%) were not concerned about a limited number of false alarms or close calls reducing their confidence in future warnings, suggesting no cry-wolf effect. Most respondents reported safe decisions in two hypothetical scenarios: a tornado warning issued while the respondent was home and a tornado visible by the respondent while driving. However, nearly half the respondents indicated that they would seek shelter from a tornado under a highway overpass if they were driving. Despite the limitations of this study, these results suggest that more education is needed on the dangers of highway overpasses as shelter from severe weather.
Abstract
One of the goals of the Warning Project is to understand how people receive warnings of hazardous weather and subsequently use this information to make decisions. As part of the project, 519 surveys from Austin, Texas, floodplain residents were collected and analyzed. About 90% of respondents understood that a tornado warning represented a more serious and more likely threat than a tornado watch. Most respondents (86%) were not concerned about a limited number of false alarms or close calls reducing their confidence in future warnings, suggesting no cry-wolf effect. Most respondents reported safe decisions in two hypothetical scenarios: a tornado warning issued while the respondent was home and a tornado visible by the respondent while driving. However, nearly half the respondents indicated that they would seek shelter from a tornado under a highway overpass if they were driving. Despite the limitations of this study, these results suggest that more education is needed on the dangers of highway overpasses as shelter from severe weather.
