Data Assimilation with Gaussian Mixture Models Using the Dynamically Orthogonal Field Equations. Part II: Applications

Thomas Sondergaard Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts

Search for other papers by Thomas Sondergaard in
Current site
Google Scholar
PubMed
Close
and
Pierre F. J. Lermusiaux Department of Mechanical Engineering, Massachusetts Institute of Technology, Cambridge, Massachusetts

Search for other papers by Pierre F. J. Lermusiaux in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The properties and capabilities of the Gaussian Mixture Model–Dynamically Orthogonal filter (GMM-DO) are assessed and exemplified by applications to two dynamical systems: 1) the double well diffusion and 2) sudden expansion flows; both of which admit far-from-Gaussian statistics. The former test case, or twin experiment, validates the use of the Expectation-Maximization (EM) algorithm and Bayesian Information Criterion with GMMs in a filtering context; the latter further exemplifies its ability to efficiently handle state vectors of nontrivial dimensionality and dynamics with jets and eddies. For each test case, qualitative and quantitative comparisons are made with contemporary filters. The sensitivity to input parameters is illustrated and discussed. Properties of the filter are examined and its estimates are described, including the equation-based and adaptive prediction of the probability densities; the evolution of the mean field, stochastic subspace modes, and stochastic coefficients; the fitting of GMMs; and the efficient and analytical Bayesian updates at assimilation times and the corresponding data impacts. The advantages of respecting nonlinear dynamics and preserving non-Gaussian statistics are brought to light. For realistic test cases admitting complex distributions and with sparse or noisy measurements, the GMM-DO filter is shown to fundamentally improve the filtering skill, outperforming simpler schemes invoking the Gaussian parametric distribution.

Corresponding author address: Pierre F. J. Lermusiaux, Massachusetts Institute of Technology, 77 Massachusetts Ave., Cambridge, MA 02139. E-mail: pierrel@mit.edu

Abstract

The properties and capabilities of the Gaussian Mixture Model–Dynamically Orthogonal filter (GMM-DO) are assessed and exemplified by applications to two dynamical systems: 1) the double well diffusion and 2) sudden expansion flows; both of which admit far-from-Gaussian statistics. The former test case, or twin experiment, validates the use of the Expectation-Maximization (EM) algorithm and Bayesian Information Criterion with GMMs in a filtering context; the latter further exemplifies its ability to efficiently handle state vectors of nontrivial dimensionality and dynamics with jets and eddies. For each test case, qualitative and quantitative comparisons are made with contemporary filters. The sensitivity to input parameters is illustrated and discussed. Properties of the filter are examined and its estimates are described, including the equation-based and adaptive prediction of the probability densities; the evolution of the mean field, stochastic subspace modes, and stochastic coefficients; the fitting of GMMs; and the efficient and analytical Bayesian updates at assimilation times and the corresponding data impacts. The advantages of respecting nonlinear dynamics and preserving non-Gaussian statistics are brought to light. For realistic test cases admitting complex distributions and with sparse or noisy measurements, the GMM-DO filter is shown to fundamentally improve the filtering skill, outperforming simpler schemes invoking the Gaussian parametric distribution.

Corresponding author address: Pierre F. J. Lermusiaux, Massachusetts Institute of Technology, 77 Massachusetts Ave., Cambridge, MA 02139. E-mail: pierrel@mit.edu
Save
  • Bengtsson, L., M. Ghil, and E. Kallen, 1981: Dynamic Meteorology: Data Assimilation Methods. Springer, 330 pp.

  • Bertsekas, D. P., and J. N. Tsitsiklis, 2008: Introduction to Probability. 2nd ed. Athena Scientific, 544 pp.

  • Cherdron, W., F. Durst, and J. H. Whitelaw, 1978: Asymmetric flows and instabilities in symmetric ducts with sudden expansions. J. Fluid Mech., 84, 1331.

    • Search Google Scholar
    • Export Citation
  • Cover, T. M., and J. A. Thomas, 2006: Elements of Information Theory. Wiley-Interscience, 748 pp.

  • Deleersnijder, E., and P. F. J. Lermusiaux, 2008: Multi-scale modeling: Nested grid and unstructured grid approaches. Ocean Dyn., 58, 335336, doi:10.1007/s10236-008-0170-5.

    • Search Google Scholar
    • Export Citation
  • Deleersnijder, E., V. Legat, and P. Lermusiaux, 2010: Multi-scale modelling of coastal, shelf and global ocean dynamics. Ocean Dyn., 60, 13571359, doi:10.1007/s10236-010-0363-6.

    • Search Google Scholar
    • Export Citation
  • Dovera, L., and E. Della Rossa, 2011: Multimodal ensemble Kalman filtering using Gaussian mixture models. Comput. Geosci., 15, 307323.

    • Search Google Scholar
    • Export Citation
  • Durst, F., A. Melling, and J. H. Whitelaw, 1974: Low Reynolds number flow over a plane symmetric sudden expansion. J. Fluid Mech., 64, 111128.

    • Search Google Scholar
    • Export Citation
  • Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte-Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10 14310 162.

    • Search Google Scholar
    • Export Citation
  • Eyink, G. L., and S. Kim, 2006: A maximum entropy method for particle filtering. J. Stat. Phys., 123, 10711128.

  • Fearn, R. M., T. Mullin, and K. A. Cliffe, 1990: Nonlinear flow phenomena in a symmetric sudden expansion. J. Fluid Mech., 211, 595608.

    • Search Google Scholar
    • Export Citation
  • Frei, M., and H. R. Kunsch, 2013: Mixture ensemble Kalman filters. Comput. Stat. Data Anal., 58, 127138.

  • Haley, P. J., and P. F. J. Lermusiaux, 2010: Multiscale two-way embedding schemes for free-surface primitive-equations in the multidisciplinary simulation, estimation and assimilation system. Ocean Dyn., 60, 14971537, doi:10.1007/s10236-010-0349-4.

    • Search Google Scholar
    • Export Citation
  • Higham, D. J., 2001: An algorithmic introduction to numerical simulation of stochastic differential equations. SIAM Rev., 43, 525546.

    • Search Google Scholar
    • Export Citation
  • Houtekamer, P. L., H. L. Mitchell, and L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796811.

    • Search Google Scholar
    • Export Citation
  • Ide, K., and M. Ghil, 1997a: Extended Kalman filtering for vortex systems. Part I: Methodology and points vortices. Dyn. Atmos. Oceans, 27, 301332.

    • Search Google Scholar
    • Export Citation
  • Ide, K., and M. Ghil, 1997b: Extended Kalman filtering for vortex systems. Part II: Rankine vortices and observing-system design. Dyn. Atmos. Oceans, 27, 333350.

    • Search Google Scholar
    • Export Citation
  • Ide, K., P. Courtier, M. Ghil, and A. Lorenc, 1997: Unified notation for data assimilation: Operational, sequential and variational. J.Meteor. Soc. Japan, 75, 181189.

    • Search Google Scholar
    • Export Citation
  • Kullback, S., 1968: Information Theory and Statistics. Dover Publications, Inc., 399 pp.

  • Kundu, P., and I. Cohen, 2008: Fluid Mechanics. 4th ed. Academic Press, 872 pp.

  • Lermusiaux, P. F. J., and A. Robinson, 1999: Data assimilation via error subspace statistical estimation. Part I: Theory and schemes. Mon. Wea. Rev., 127, 13851407.

    • Search Google Scholar
    • Export Citation
  • Lynch, D., and D. McGillicuddy, 2001: Objective analysis of coastal regimes. Cont. Shelf Res., 21, 12991315.

  • Miller, R. N., 1997: Data assimilation in nonlinear stochastic models. Monte Carlo Simulations in Oceanography: Proc. ‘Aha Huliko‘a Hawaiian Winter Workshop, Honolulu, HI, University of Hawai‘i at Mānoa, 23–34. [Available online at http://www.soest.hawaii.edu/PubServices/1997pdfs/Miller.pdf.]

  • Miller, R. N., M. Ghil, and F. Gauthiez, 1994: Advanced data assimilation in strongly nonlinear dynamical systems. J. Atmos. Sci., 51, 10371056.

    • Search Google Scholar
    • Export Citation
  • Qiu, B., and W. Miao, 2000: Kuroshio path variations south of Japan: Bimodality as a self-sustained internal oscillation. J. Phys. Oceanogr., 30, 21242137.

    • Search Google Scholar
    • Export Citation
  • Sapsis, T., and P. F. J. Lermusiaux, 2009: Dynamically orthogonal field equations for continuous stochastic dynamical systems. Physica D, 238, 23472360, doi:10.1016/j.physd.2009.09.017.

    • Search Google Scholar
    • Export Citation
  • Sapsis, T., and P. F. J. Lermusiaux, 2012: Dynamical criteria for the evolution of the stochastic dimensionality in flows with uncertainty. Physica D, 241, 6076, doi:10.1016/j.physd.2011.10.001.

    • Search Google Scholar
    • Export Citation
  • Schmeits, M. J., and H. A. Dijkstra, 2001: Bimodal behavior of the Kuroshio and the Gulf Stream. J. Phys. Oceanogr., 31, 34353456.

  • Sekine, Y., 1990: A numerical experiment on the path dynamics of the Kuroshio with reference to the formation of the large meander path south of Japan. Deep-Sea Res., 37A, 359380.

    • Search Google Scholar
    • Export Citation
  • Silverman, B., 1992: Density Estimation for Statistics and Data Analysis. Chapman & Hall, 175 pp.

  • Smith, K. W., 2007: Cluster ensemble Kalman filter. Tellus, 59A, 749757.

  • Sondergaard, T., 2011: Data assimilation with Gaussian mixture models using the dynamically orthogonal field equations. M.S. thesis, Dept. of Mechanical Engineering, Massachusetts Institute of Technology, 180 pp.

  • Sondergaard, T. and P. F. J. Lermusiaux, 2013: Data assimilation with Gaussian Mixture Models using the Dynamically Orthogonal field equations. Part I: Theory and scheme. Mon. Wea. Rev., 141, 17371760.

    • Search Google Scholar
    • Export Citation
  • Ueckermann, M. P., P. F. J. Lermusiaux, and T. P. Sapsis, 2013: Numerical schemes for dynamically orthogonal equations of stochastic fluid and ocean flows. J. Comput. Phys., 233, 272294, doi:10.1016/j.jcp.2012.08.041.

    • Search Google Scholar
    • Export Citation
  • van Leer, B., 1977: Towards the ultimate conservative difference scheme III. Upstream-centered finite-difference schemes for ideal compressible flow. J. Comput. Phys., 23, 263275.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 523 167 2
PDF Downloads 329 60 3