Evaluating the Skill of Categorical Forecasts

Neil D. Gordon New Zealand Meteorological Service, Wellington, New Zealand

Search for other papers by Neil D. Gordon in
Current site
Google Scholar
PubMed
Close
Full access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

A generalized skill score is presented for evaluating forecasts in any number of categories. Each forecast in a sample is given a mark; the skill score for the sample is just the average mark. Each mark has an expected value of zero for an unskillful forecast and unity for a correct forecast. In the particular case of two categories the score corresponds to that of Hanssen and Kuipers (1965). For three or more categories an arbitrary penalty factor for incorrect forecasts, which may be as simple as the rank difference between forecast and observed categories, must be specified.

Abstract

A generalized skill score is presented for evaluating forecasts in any number of categories. Each forecast in a sample is given a mark; the skill score for the sample is just the average mark. Each mark has an expected value of zero for an unskillful forecast and unity for a correct forecast. In the particular case of two categories the score corresponds to that of Hanssen and Kuipers (1965). For three or more categories an arbitrary penalty factor for incorrect forecasts, which may be as simple as the rank difference between forecast and observed categories, must be specified.

Save