Spatial Forecast Verification: Baddeley’s Delta Metric Applied to the ICP Test Cases

Eric Gilleland Joint Numerical Testbed, Research Applications Laboratory, National Center for Atmospheric Research, Boulder, Colorado

Search for other papers by Eric Gilleland in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

A mathematical displacement metric, Baddeley’s Δ, is examined for verifying gridded forecasts against gridded observations using the Spatial Forecast Verification Methods Intercomparison Project test cases. Results are compared with several other new approaches. The metric performs similarly to other displacement methods, complementing neighborhood techniques.

Corresponding author address: Eric Gilleland, Joint Numerical Testbed, Research Applications Laboratory, National Center for Atmospheric Research, P.O. Box 3000, Boulder, CO 80307. E-mail: ericg@ucar.edu

Abstract

A mathematical displacement metric, Baddeley’s Δ, is examined for verifying gridded forecasts against gridded observations using the Spatial Forecast Verification Methods Intercomparison Project test cases. Results are compared with several other new approaches. The metric performs similarly to other displacement methods, complementing neighborhood techniques.

Corresponding author address: Eric Gilleland, Joint Numerical Testbed, Research Applications Laboratory, National Center for Atmospheric Research, P.O. Box 3000, Boulder, CO 80307. E-mail: ericg@ucar.edu
Save
  • Ahijevych, D., Gilleland E. , Brown B. , and Ebert E. , 2009: Application of spatial verification methods to idealized and NWP gridded precipitation forecasts. Wea. Forecasting, 24, 14851497.

    • Search Google Scholar
    • Export Citation
  • Atger, F., 2001: Verification of intense precipitation forecasts from single models and ensemble prediction systems. Nonlinear Processes Geophys., 8, 401417.

    • Search Google Scholar
    • Export Citation
  • Baddeley, A., 1992a: An error metric for binary images. Robust Computer Vision Algorithms, W. Forstner and S. Ruwiedel, Eds., Wichmann, 59–78.

    • Search Google Scholar
    • Export Citation
  • Baddeley, A., 1992b: Errors in binary images and an Lp version of the Hausdorff metric. Nieuw Arch. Wiskunde, 10, 157183.

  • Baddeley, A., and Turner R. , 2005: Spatstat: An R package for analyzing spatial point patterns. J. Stat. Softw., 12 (6), 142.

  • Borgefors, G., 1986: Distance transformations in digital images. Comput. Visual Graph. Image Process., 5 (34), 344371.

  • Carley, J., Schwedler B. , Baldwin M. , Trapp R. , Kwiatkowski J. , Logsdon J. , and Weiss S. , 2011: A proposed model-based methodology for feature-specific prediction for high-impact weather. Wea. Forecasting, 26, 243249.

    • Search Google Scholar
    • Export Citation
  • Casati, B., and Coauthors, 2008: Forecast verification: Current status and future directions. Meteor. Appl., 15, 318.

  • Davis, C., Brown B. , and Bullock R. , 2006a: Object-based verification of precipitation forecasts. Part I: Methodology and application to mesoscale rain areas. Mon. Wea. Rev., 134, 17721784.

    • Search Google Scholar
    • Export Citation
  • Davis, C.,Brown B. , and Bullock R. , 2006b: Object-based verification of precipitation forecasts. Part II: Application to convective rain systems. Mon. Wea. Rev., 134, 17851795.

    • Search Google Scholar
    • Export Citation
  • Davis, C., Brown B. , Bullock R. , and Halley Gotway J. , 2009: The method for object-based diagnostic evaluation (MODE) applied to numerical forecasts from the 2005 NSSL/SPC Spring Program. Wea. Forecasting, 24, 12521267.

    • Search Google Scholar
    • Export Citation
  • Ebert, E., 2009: Fuzzy verification: A strategy for rewarding close forecasts. Wea. Forecasting, 24, 14981510.

  • Gilleland, E., 2010: Confidence intervals for forecast verification. NCAR Tech. Note NCAR/TN-479+STR, 71 pp.

  • Gilleland, E., Lee T. , Halley-Gotway J. , Bullock R. , and Brown B. , 2008: Computationally efficient spatial forecast verification using Baddeley’s δ image metric. Mon. Wea. Rev., 136, 17471757.

    • Search Google Scholar
    • Export Citation
  • Gilleland, E., Ahijevych D. , Brown B. , Casati B. , and Ebert E. , 2009: Intercomparison of Spatial Forecast Verification Methods. Wea. Forecasting, 24, 14161430.

    • Search Google Scholar
    • Export Citation
  • Gilleland, E., Ahijevych D. , Brown B. , and Ebert E. , 2010a: Verifying forecasts spatially. Bull. Amer. Meteor. Soc., 91, 13651373.

  • Gilleland, E., Lindström J. , and Lindgren F. , 2010b: Analyzing the image warp forecast verification method on precipitation fields from the ICP. Wea. Forecasting, 25, 12491262.

    • Search Google Scholar
    • Export Citation
  • Kain, J., and Coauthors, 2008: Some practical considerations regarding horizontal resolution in the first generation of operational convection-allowing NWP. Wea. Forecasting, 23, 931952.

    • Search Google Scholar
    • Export Citation
  • Keil, C., and Craig G. , 2009: A displacement-based error measure applied in a regional ensemble forecasting system. Wea. Forecasting, 24, 12971308.

    • Search Google Scholar
    • Export Citation
  • Lin, Y., and Mitchell K. , 2005: The NCEP stage II/IV hourly precipitation analyses: Development and applications. Preprints, 19th Conf. on Hydrology, Orlando, FL, Amer. Meteor. Soc., 1.2. [Available online at http://www.emc.ncep.noaa.gov/mmb/ylin/pcpanl/refs/stage2-4.19hydro.pdf.]

    • Search Google Scholar
    • Export Citation
  • Mass, C., Ovens D. , Westrick K. , and Colle B. , 2002: Does increasing horizontal resolution produce more skillful forecasts? The results of two years of real-time numerical weather prediction over the Pacific Northwest. Bull. Amer. Meteor. Soc., 83, 407430.

    • Search Google Scholar
    • Export Citation
  • Mittermaier, M., and Roberts N. , 2010: Intercomparison of Spatial Forecast Verification Methods: Identifying skillful spatial scales using the fractions skill score. Wea. Forecasting, 25, 343354.

    • Search Google Scholar
    • Export Citation
  • R Development Core Team, 2009: R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, 409 pp.

    • Search Google Scholar
    • Export Citation
  • Roberts, N., and Lean H. , 2008: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events. Mon. Wea. Rev., 136, 7896.

    • Search Google Scholar
    • Export Citation
  • Rosenfeld, A., and Pfalz J. , 1966: Sequential operations in digital picture processing. J. ACM, 13, 471494.

  • Rosenfeld, A., and Pfalz J. , 1968: Distance functions on digital pictures. Pattern Recognit., 5, 3361.

  • Rossa, A., Nurmi P. , and Ebert E. , 2008: Overview of methods for the verification of quantitative precipitation forecasts. Precipitation: Advances in Measurement, Estimation, and Prediction, S. C. Michaelides, Ed., Springer, 418–450.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 486 266 44
PDF Downloads 167 52 3