• Daan, H., 1985: Sensitivity of the verification scores to classification of the predictand. Mon. Wea. Rev.,113, 1384–1392.

    • Crossref
    • Export Citation
  • Dallavalle, J. P., J. S. Jensenius Jr., and S. A. Gilbert, 1992: NGM- based MOS guidance—The FOUS14/FWC message. Technical Procedures Bull. 408, NOAA/National Weather Service, Washington, DC, 9 pp. [Available from NOAA/NWS, Services Development Branch, 1325 East–West Highway, Room 13466, Silver Spring, MD 20910.].

  • Epstein, E. S., 1969: A scoring system for probability forecasts of ranked categories. J. Appl. Meteor.,8, 985–987.

  • Hamill, T. M., and D. S. Wilks, 1995: A probabilistic forecast contest and the difficulty in assessing short-range forecast uncertainty. Wea. Forecasting,10, 620–631.

  • Murphy, A. H., 1971: A note on the ranked probability score. J. Appl. Meteor.,10, 155–156.

  • Wilks, D. S., 1990a: On the combination of forecast probabilities for consecutive precipitation periods. Wea. Forecasting,5, 640–650.

    • Crossref
    • Export Citation
  • ——, 1990b: Probabilistic quantitative precipitation forecasts derived from PoPs and conditional precipitation amount climatologies. Mon. Wea. Rev.,118, 874–882.

    • Crossref
    • Export Citation
  • ——, 1995: Statistical Methods in the Atmospheric Sciences: An Introduction. Academic Press, 467 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 469 185 10
PDF Downloads 374 213 13

Reliability Diagrams for Multicategory Probabilistic Forecasts

View More View Less
  • 1 Department of Soil, Crop, and Atmospheric Sciences, Cornell University, Ithaca, New York
Restricted access

Abstract

The most common method of verifying multicategory probabilistic forecasts such as are used in probabilistic quantitative precipitation forecasting is through the use of the ranked probability score. This single number description of forecast accuracy can never capture the multidimensional nature of forecast quality and does not inform the forecaster about the sources of forecast deficiencies. A new type of reliability diagram is developed here and applied to probabilistic quantitative precipitation forecasts from a university contest. This diagram is shown to potentially be useful in helping the forecaster to correct some errors in assigning the categorical probabilities.

Corresponding author address: Dr. Thomas M. Hamill, NCAR/RAP, P.O. Box 3000, Boulder, CO 80307-3000.

Email: hamill@ucar.edu

Abstract

The most common method of verifying multicategory probabilistic forecasts such as are used in probabilistic quantitative precipitation forecasting is through the use of the ranked probability score. This single number description of forecast accuracy can never capture the multidimensional nature of forecast quality and does not inform the forecaster about the sources of forecast deficiencies. A new type of reliability diagram is developed here and applied to probabilistic quantitative precipitation forecasts from a university contest. This diagram is shown to potentially be useful in helping the forecaster to correct some errors in assigning the categorical probabilities.

Corresponding author address: Dr. Thomas M. Hamill, NCAR/RAP, P.O. Box 3000, Boulder, CO 80307-3000.

Email: hamill@ucar.edu

Save