I am grateful to Dr. Michael Baldwin and Dr. Fedor Mesinger for the many interesting and educational conversations and e-mail exchanges related to bias sensitivity of performance measures for dichotomous forecasts over the past several years. Their respective reviews of the draft of this paper were very helpful. I am grateful for the positive comments and helpful suggestions of the formal reviewers. Funding from NCEP/HPC to provide computational tools and to cover the publication costs is much appreciated.
Baldwin, M. E., , and Kain J. S. , 2006: Sensitivity of several performance measures to displacement error, bias, and event frequency. Wea. Forecasting, 21 , 636–648.
Barnes, L. R., , Gruntfest E. C. , , Hayden M. H. , , Schultz D. M. , , and Benight C. , 2007: False alarms and close calls: A conceptual model of warning accuracy. Wea. Forecasting, 22 , 1140–1147.
Doswell C. A. III, , , Davies-Jones R. , , and Keller D. L. , 1990: On summary measures of skill in rare event forecasting based on contingency tables. Wea. Forecasting, 5 , 576–585.
Gandin, L. S., , and Murphy A. H. , 1992: Equitable skill scores for categorical forecasts. Mon. Wea. Rev., 120 , 361–370.
Hamill, T. M., 1999: Hypothesis tests for evaluating numerical precipitation forecasts. Wea. Forecasting, 14 , 155–167.
Hilliker, J. L., 2004: The sensitivity of the number of correctly forecasted events to the threat score: A practical application. Wea. Forecasting, 19 , 646–650.
Marzban, C., , and Lakshmanan V. , 1999: On the uniqueness of Gandin and Murphy’s equitable performance measures. Mon. Wea. Rev., 127 , 1134–1136.
Mesinger, F., , and Brill K. , 2004: Bias normalized precipitation scores. Preprints, 17th Conf. on Probability and Statistics, Seattle, WA, Amer. Meteor. Soc., J12.6. [Available online at http://ams.confex.com/ams/pdfpapers/69561.pdf.].
Murphy, A. H., 1991: Forecast verification: Its complexity and dimensionality. Mon. Wea. Rev., 119 , 1590–1601.
Schaefer, J. T., 1990: The critical success index as an indicator of warning skill. Wea. Forecasting, 5 , 570–575.
Stephenson, D. B., 2000: Use of the “odds ratio” for diagnosing forecast skill. Wea. Forecasting, 15 , 221–232.
Stephenson, D. B., , Casati B. , , Ferro C. A. T. , , and Wilson C. A. , 2008: The extreme dependency score: A non-vanishing measure for forecasts of rare events. Meteor. Appl., 15 , 41–50.