Mesoscale Verification Using Meteorological Composites

Jason E. Nachamkin Naval Research Laboratory, Monterey, California

Search for other papers by Jason E. Nachamkin in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Mesoscale models are often used to explicitly predict discrete, highly structured phenomena. Information regarding the ability of the model to predict events as coherent entities is thus a useful statement of performance. Observational constraints are a significant problem, though, as the shape, size, and intensity of any given event are often only partially known. Composite techniques offer an attractive approach because the full deterministic information about any one event need not be known. If enough quasi-random observations of a distribution of events exist, bulk properties of the distributions of forecasts and observations can be estimated. Composites are also useful in that the verification measures are based on conditional samples of events. Sample distributions contingent on event existence in either the forecasts or the observations can be compared to one another.

A verification technique in which meteorological events are located and composited on a relative grid centered on each event is described herein. This technique is described and demonstrated by comparing the 27-km Naval Research Laboratory's Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) mistral wind forecasts to the Special Sensor Microwave Imager (SSM/I) observations for a 1-yr period. Diagnostic information regarding the forecast reliability, error type, and error spatial characteristics are derived. Also, statistics from the conditional distributions of both the observed and predicted events are compared. The difference between the two conditional biases (CBD) is found to reveal valuable information regarding the contribution of false alarms and missed forecasts to the forecast errors. The results indicate the mistral is remarkably predictable with high pattern correlations out to 66 h.

Corresponding author address: Jason E. Nachamkin, Naval Research Laboratory, 7 Grace Hopper Avenue, Monterey, CA 93943- 5502. Email: nachamkin@nrlmry.navy.mil

Abstract

Mesoscale models are often used to explicitly predict discrete, highly structured phenomena. Information regarding the ability of the model to predict events as coherent entities is thus a useful statement of performance. Observational constraints are a significant problem, though, as the shape, size, and intensity of any given event are often only partially known. Composite techniques offer an attractive approach because the full deterministic information about any one event need not be known. If enough quasi-random observations of a distribution of events exist, bulk properties of the distributions of forecasts and observations can be estimated. Composites are also useful in that the verification measures are based on conditional samples of events. Sample distributions contingent on event existence in either the forecasts or the observations can be compared to one another.

A verification technique in which meteorological events are located and composited on a relative grid centered on each event is described herein. This technique is described and demonstrated by comparing the 27-km Naval Research Laboratory's Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS) mistral wind forecasts to the Special Sensor Microwave Imager (SSM/I) observations for a 1-yr period. Diagnostic information regarding the forecast reliability, error type, and error spatial characteristics are derived. Also, statistics from the conditional distributions of both the observed and predicted events are compared. The difference between the two conditional biases (CBD) is found to reveal valuable information regarding the contribution of false alarms and missed forecasts to the forecast errors. The results indicate the mistral is remarkably predictable with high pattern correlations out to 66 h.

Corresponding author address: Jason E. Nachamkin, Naval Research Laboratory, 7 Grace Hopper Avenue, Monterey, CA 93943- 5502. Email: nachamkin@nrlmry.navy.mil

Save
  • Baldwin, M. E., S. Lakshmivarahan, and J. S. Kain, 2001: Verification of mesoscale features in NWP models. Preprints, Ninth Conf. on Mesoscale Processes, Fort Lauderdale, FL, Amer. Meteor. Soc., 255–258.

    • Search Google Scholar
    • Export Citation
  • Baldwin, M. E., S. Lakshmivarahan, and J. S. Kain, 2002: Development of an “events-oriented” approach to forecast verification. Preprints, 19th Conf. on Weather Analysis and Forecasting, San Antonio, TX, Amer. Meteor. Soc., 255–258.

    • Search Google Scholar
    • Export Citation
  • Barker, E. H., 1992: Design of the navy's multivariate optimum interpolation analysis system. Wea. Forecasting, 7 , 220231.

  • Bernardet, L. R., L. D. Grasso, J. E. Nachamkin, C. A. Finley, and W. R. Cotton, 2000: Simulating convective events using a high- resolution mesoscale model. J. Geophys. Res, 105 , 1496314  982.

    • Search Google Scholar
    • Export Citation
  • Colle, B. A., K. J. Westrick, and C. F. Mass, 1999: Evaluation of MM5 and Eta-10 precipitation forecasts over the Pacific Northwest during the cool season. Wea. Forecasting, 14 , 137154.

    • Search Google Scholar
    • Export Citation
  • Colle, B. A., C. F. Mass, and D. Ovens, 2001: Evaluation of the timing and strength of MM5 and Eta surface trough passages over the eastern Pacific. Wea. Forecasting, 16 , 553572.

    • Search Google Scholar
    • Export Citation
  • Davies, H. C., 1976: A lateral boundary formulation for multi-level prediction models. Quart. J. Roy. Meteor. Soc, 102 , 405418.

  • Doyle, J. D., 1997: The influence of mesoscale orography on a coastal jet and rainband. Mon. Wea. Rev, 125 , 14651488.

  • Ebert, E., and J. L. McBride, 2000: Verification of precipitation in weather systems: Determination of systematic errors. J. Hydrol, 239 , 179202.

    • Search Google Scholar
    • Export Citation
  • Gemmill, W. H., and V. M. Krasnopolsky, 1999: The use of SSM/I data in operational marine analysis. Wea. Forecasting, 14 , 789800.

  • Goodberlet, M. A., C. T. Swift, and J. C. Wilkerson, 1990: Ocean surface wind speed measurements of the Special Sensor Microwave/Imager (SSM/I). IEEE Trans. Geosci. Remote Sens, 28 , 823827.

    • Search Google Scholar
    • Export Citation
  • Gray, W. M., and W. M. Frank, 1977: Tropical cyclone research by data compositing. NEPRF Tech. Rep. TR-177-01, Naval Environmental Prediction Research Facility, Monterey, CA, 70 pp.

    • Search Google Scholar
    • Export Citation
  • Hodur, R. M., 1997: The Naval Research Laboratory's Coupled Ocean/Atmosphere Mesoscale Prediction System (COAMPS). Mon. Wea. Rev, 125 , 14141430.

    • Search Google Scholar
    • Export Citation
  • Hogan, T. F., M. S. Peng, J. A. Ridout, and W. M. Clune, 2002: A description of the impact of changes to NOGAPS convection parameterization and the increase in resolution to T239L30. NRL Memo. Rep. NRL/MR/7530-02-52, Naval Research Laboratory, Monterey, CA, 10 pp.

    • Search Google Scholar
    • Export Citation
  • Jiang, Q., R. B. Smith, and J. D. Doyle, 2003: The nature of the mistral: Observations and modelling of two MAP events. Quart. J. Roy. Meteor. Soc, 129 , 857875.

    • Search Google Scholar
    • Export Citation
  • Koch, S. E., 1985: Ability of a regional scale model to predict the genesis of intense mesoscale convective systems. Mon. Wea. Rev, 113 , 16931713.

    • Search Google Scholar
    • Export Citation
  • Mass, C. F., D. Ovens, K. Westrick, and B. A. Colle, 2002: Does increasing horizontal resolution produce more skillful forecasts? The results of two years of real-time numerical weather prediction over the Pacific Northwest. Bull. Amer. Meteor. Soc, 83 , 407430.

    • Search Google Scholar
    • Export Citation
  • Murphy, A. H., 1991: Forecast verification: Its complexity and dimensionality. Mon. Wea. Rev, 119 , 15901601.

  • Nachamkin, J. E., 2002: Forecast verification using meteorological event composites. Preprints, 19th Conf. on Weather Analysis and Forecasting, San Antonio, TX, Amer. Meteor. Soc., 206– 209.

    • Search Google Scholar
    • Export Citation
  • Petty, G. W., 1993: A comparison of SSM/I algorithms for the estimation of surface wind. Proc. Shared Processing Network DMSP SSM/I Algorithm Symp., Monterey, CA, Fleet Numerical Meteorology and Oceanography Center.

    • Search Google Scholar
    • Export Citation
  • Tustison, B., D. Harris, and E. Foufoula-Georgiou, 2001: Scale issues in verification of precipitation forecasts. J. Geophys. Res, 106D , 1177511784.

    • Search Google Scholar
    • Export Citation
  • White, G. B., J. Paegle, W. J. Steeenburgh, J. D. Horel, R. T. Swanson, L. K. Cook, D. J. Onton, and J. G. Miles, 1999: Short-term forecast validation of six models. Wea. Forecasting, 14 , 84108.

    • Search Google Scholar
    • Export Citation
  • Xue, M., and Coauthors, 2001: The Advanced Regional Prediction System (ARPS)—A multi-scale nonhydrostatic atmospheric simulation and prediction tool. Part II: Model physics and applications. Meter. Atmos. Phys, 76 , 143165.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 200 80 4
PDF Downloads 87 40 1