Accounting for Skewness in Ensemble Data Assimilation

Daniel Hodyss Naval Research Laboratory, Monterey, California

Search for other papers by Daniel Hodyss in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

A practical data assimilation algorithm is presented that explicitly accounts for skewness in the prior distribution. The algorithm operates as a global solve (all observations are considered at once) using a minimization-based approach and Schur–Hadamard (elementwise) localization. The central feature of this technique is the squaring of the innovation and the ensemble perturbations so as to create an extended state space that accounts for the second, third, and fourth moments of the prior distribution. This new technique is illustrated in a simple scalar system as well as in a Boussinesq model configured to simulate nonlinearly evolving shear instabilities (Kelvin–Helmholtz waves). It is shown that an ensemble size of at least 100 members is needed to adequately resolve the third and fourth moments required for the algorithm. For ensembles of this size it is shown that this new technique is superior to a state-of-the-art ensemble Kalman filter in situations with significant skewness; otherwise, the new algorithm reduces to the performance of the ensemble Kalman filter.

Corresponding author address: Daniel Hodyss, Naval Research Laboratory, 7 Grace Hopper Ave., Stop 2, Monterey, CA 93933. E-mail: daniel.hodyss@nrlmry.navy.mil

Abstract

A practical data assimilation algorithm is presented that explicitly accounts for skewness in the prior distribution. The algorithm operates as a global solve (all observations are considered at once) using a minimization-based approach and Schur–Hadamard (elementwise) localization. The central feature of this technique is the squaring of the innovation and the ensemble perturbations so as to create an extended state space that accounts for the second, third, and fourth moments of the prior distribution. This new technique is illustrated in a simple scalar system as well as in a Boussinesq model configured to simulate nonlinearly evolving shear instabilities (Kelvin–Helmholtz waves). It is shown that an ensemble size of at least 100 members is needed to adequately resolve the third and fourth moments required for the algorithm. For ensembles of this size it is shown that this new technique is superior to a state-of-the-art ensemble Kalman filter in situations with significant skewness; otherwise, the new algorithm reduces to the performance of the ensemble Kalman filter.

Corresponding author address: Daniel Hodyss, Naval Research Laboratory, 7 Grace Hopper Ave., Stop 2, Monterey, CA 93933. E-mail: daniel.hodyss@nrlmry.navy.mil
Save
  • Anderson, J., T. Hoar, K. Raeder, H. Liu, N. Collins, R. Torn, and A. Avellano, 2009: The Data Assimilation Research Testbed: A community facility. Bull. Amer. Meteor. Soc., 90, 12831296.

    • Search Google Scholar
    • Export Citation
  • Bishop, C. H., D. Hodyss, P. Steinle, H. Sims, A. M. Clayton, A. C. Lorenc, D. M. Barker, and M. Buehner, 2011: Efficient ensemble covariance localization in variational data assimilation. Mon. Wea. Rev., 139, 573580.

    • Search Google Scholar
    • Export Citation
  • Buehner, M., 2005: Ensemble-derived stationary and flow-dependent background-error covariances: Evaluation in a quasi-operational NWP setting. Quart. J. Roy. Meteor. Soc., 131, 10131043.

    • Search Google Scholar
    • Export Citation
  • Burgers, G., P. J. Van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 17191724.

  • Chen, Y., and C. Snyder, 2007: Assimilating vortex position with an ensemble Kalman filter. Mon. Wea. Rev., 135, 18281845.

  • Dowell, D. C., L. J. Wicker, and C. Snyder, 2011: Ensemble Kalman filter assimilation of radar observations of the 8 May 2003 Oklahoma City supercell: Influences of reflectivity observations on storm-scale analyses. Mon. Wea. Rev., 139, 272294.

    • Search Google Scholar
    • Export Citation
  • Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10 14310 162.

    • Search Google Scholar
    • Export Citation
  • Evensen, G., 2003: The Ensemble Kalman Filter: Theoretical formulation and practical implementation. Ocean Dyn., 53, 343367.

  • Hacker, J. P., C. Snyder, S.-Y. Ha, and M. Pocernich, 2011: Linear and non-linear response to parameter variations in a mesoscale model. Tellus, 63A, 429444.

    • Search Google Scholar
    • Export Citation
  • Hodyss, D., 2011: Ensemble state estimation for nonlinear systems using polynomial expansions in the innovation. Mon. Wea. Rev., 139, 35713588.

    • Search Google Scholar
    • Export Citation
  • Houtekamer, P. L., and H. L. Mitchell, 2001: A sequential ensemble Kalman filter for atmospheric data assimilation. Mon. Wea. Rev., 129, 123137.

    • Search Google Scholar
    • Export Citation
  • Houtekamer, P. L., H. L. Mitchell, G. Pellerin, M. Buehner, M. Charron, L. Spacek, and B, Hansen, 2005: Atmospheric data assimilation with an ensemble Kalman filter: Results with real observations. Mon. Wea. Rev., 133, 604620.

    • Search Google Scholar
    • Export Citation
  • Khare, S. P., J. L. Anderson, T. J. Hoar, and D. Nychka, 2008: An investigation into the application of an ensemble Kalman smoother to high-dimensional geophysical systems. Tellus, 60A, 97112.

    • Search Google Scholar
    • Export Citation
  • Lawson, G. W., and J. A. Hansen, 2005: Alignment error models and ensemble-based data assimilation. Mon. Wea. Rev., 133, 16871709.

  • Meng, Z., and F. Zhang, 2008: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part IV: Comparison with 3DVAR in a month-long experiment. Mon. Wea. Rev., 136, 36713682.

    • Search Google Scholar
    • Export Citation
  • Ott, E., and Coauthors, 2004: A local ensemble Kalman filter for atmospheric data assimilation. Tellus, 56A, 415428.

  • Szunyogh, I., E. J. Kostelich, G. Gyarmati, E. Kalnay, B. R. Hunt, E. Ott, E. Satterfield, and J. A. Yorke, 2008: A local ensemble transform Kalman filter data assimilation system for the NCEP global model. Tellus, 60A, 113130.

    • Search Google Scholar
    • Export Citation
  • Torn, R. D., and G. J. Hakim, 2008: Performance characteristics of a pseudo-operational ensemble Kalman filter. Mon. Wea. Rev., 136, 39473963.

    • Search Google Scholar
    • Export Citation
  • Whitaker, J. S., T. M. Hamill, X. Wei, Y. Song, and Z. Toth, 2008: Ensemble data assimilation with the NCEP global forecast system. Mon. Wea. Rev., 136, 463482.

    • Search Google Scholar
    • Export Citation
  • Wilks, D. S., 2006: Statistical Methods in the Atmospheric Sciences. 2nd ed. Academic Press, 627 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 215 103 17
PDF Downloads 124 69 14