Editorial Type:
Article
Article Type:
Research Article

Particle Kalman Filtering: A Nonlinear Bayesian Framework for Ensemble Kalman Filters

Ibrahim Hoteit King Abdullah University of Sciences and Technology, Thuwal, Saudia Arabia

Search for other papers by Ibrahim Hoteit in
Current site
Google Scholar
PubMed Close
,
Xiaodong Luo King Abdullah University of Sciences and Technology, Thuwal, Saudia Arabia

Search for other papers by Xiaodong Luo in
Current site
Google Scholar
PubMed Close
, and
Dinh-Tuan Pham Centre National de la Recherche Scientifique, Grenoble, France

Search for other papers by Dinh-Tuan Pham in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Feb 2012
DOI:
https://doi.org/10.1175/2011MWR3640.1
Page(s):
528–542
Restricted access

Abstract

This paper investigates an approximation scheme of the optimal nonlinear Bayesian filter based on the Gaussian mixture representation of the state probability distribution function. The resulting filter is similar to the particle filter, but is different from it in that the standard weight-type correction in the particle filter is complemented by the Kalman-type correction with the associated covariance matrices in the Gaussian mixture. The authors show that this filter is an algorithm in between the Kalman filter and the particle filter, and therefore is referred to as the particle Kalman filter (PKF).

In the PKF, the solution of a nonlinear filtering problem is expressed as the weighted average of an “ensemble of Kalman filters” operating in parallel. Running an ensemble of Kalman filters is, however, computationally prohibitive for realistic atmospheric and oceanic data assimilation problems. For this reason, the authors consider the construction of the PKF through an “ensemble” of ensemble Kalman filters (EnKFs) instead, and call the implementation the particle EnKF (PEnKF). It is shown that different types of the EnKFs can be considered as special cases of the PEnKF. Similar to the situation in the particle filter, the authors also introduce a resampling step to the PEnKF in order to reduce the risk of weights collapse and improve the performance of the filter. Numerical experiments with the strongly nonlinear Lorenz-96 model are presented and discussed.

Supplemental information related to this paper is available at the Journals Online Web site: http://dx.doi.org/10.1175/2011MWR3640.s1.

Corresponding author address: Ibrahim Hoteit, Earth Sciences and Engineering/Applied Mathematics and Computational Science, King Abdullah University of Science and Technology, Thuwal 23955-6900, Saudi Arabia. E-mail: ibrahim.hoteit@kaust.edu.sa

Abstract

This paper investigates an approximation scheme of the optimal nonlinear Bayesian filter based on the Gaussian mixture representation of the state probability distribution function. The resulting filter is similar to the particle filter, but is different from it in that the standard weight-type correction in the particle filter is complemented by the Kalman-type correction with the associated covariance matrices in the Gaussian mixture. The authors show that this filter is an algorithm in between the Kalman filter and the particle filter, and therefore is referred to as the particle Kalman filter (PKF).

In the PKF, the solution of a nonlinear filtering problem is expressed as the weighted average of an “ensemble of Kalman filters” operating in parallel. Running an ensemble of Kalman filters is, however, computationally prohibitive for realistic atmospheric and oceanic data assimilation problems. For this reason, the authors consider the construction of the PKF through an “ensemble” of ensemble Kalman filters (EnKFs) instead, and call the implementation the particle EnKF (PEnKF). It is shown that different types of the EnKFs can be considered as special cases of the PEnKF. Similar to the situation in the particle filter, the authors also introduce a resampling step to the PEnKF in order to reduce the risk of weights collapse and improve the performance of the filter. Numerical experiments with the strongly nonlinear Lorenz-96 model are presented and discussed.

Supplemental information related to this paper is available at the Journals Online Web site: http://dx.doi.org/10.1175/2011MWR3640.s1.

Corresponding author address: Ibrahim Hoteit, Earth Sciences and Engineering/Applied Mathematics and Computational Science, King Abdullah University of Science and Technology, Thuwal 23955-6900, Saudi Arabia. E-mail: ibrahim.hoteit@kaust.edu.sa
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Anderson, J. L., 2001: An ensemble adjustment Kalman filter for data assimilation. Mon. Wea. Rev., 129, 2884–2903.

  • Anderson, J. L., 2003: A local least squares framework for ensemble filtering. Mon. Wea. Rev., 131, 634–642.

  • Anderson, J. L., and S. L. Anderson, 1999: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilations and forecasts. Mon. Wea. Rev., 127, 2741–2758.

    • Search Google Scholar
    • Export Citation

  • Bengtsson, T., C. Snyder, and D. Nychka, 2003: Toward a nonlinear ensemble filter for high-dimensional systems. J. Geophys. Res., 108, 8775, doi:10.1029/2002JD002900.

    • Search Google Scholar
    • Export Citation

  • Bengtsson, T., P. Bickel, and B. Li, 2008: Curse-of-dimensionality revisited: Collapse of the particle filter in very large scale systems. IMS Collect., 2, 316–334.

    • Search Google Scholar
    • Export Citation

  • Bishop, C. H., B. J. Etherton, and S. J. Majumdar, 2001: Adaptive sampling with ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Wea. Rev., 129, 420–436.

    • Search Google Scholar
    • Export Citation

  • Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: On the analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719–1724.

    • Search Google Scholar
    • Export Citation

  • Chen, R., and J. Liu, 2000: Mixture Kalman filters. J. Roy. Stat. Soc. Series B Stat. Methodol., 62 (3), 493–508.

  • Doucet, A., N. De Freitas, and N. Gordon, Eds., 2001: Sequential Monte Carlo Methods in Practice. Springer Verlag, 612 pp.

  • Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99 (C5), 10 143–10 162.

    • Search Google Scholar
    • Export Citation

  • Evensen, G., and P. J. van Leeuwen, 1996: Assimilation of Geosat altimeter data for the Aghulas Current using the ensemble Kalman filter with a quasi-geostrophic model. Mon. Wea. Rev., 124, 85–96.

    • Search Google Scholar
    • Export Citation

  • Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723–757.

    • Search Google Scholar
    • Export Citation

  • Ghil, M., and P. Malanotte-Rizzoli, 1991: Data assimilation in meteorology and oceanography. Advances in Geophysics, Vol. 33, Academic Press, 141–266.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., J. S. Whitaker, and C. Snyder, 2001: Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Wea. Rev., 129, 2776–2790.

    • Search Google Scholar
    • Export Citation

  • Hamill, T. M., J. S. Whitaker, J. L. Anderson, and C. Snyder, 2009: Comments on “Sigma-point Kalman filter data assimilation methods for strongly nonlinear systems.” J. Atmos. Sci., 66, 3498–3500.

    • Search Google Scholar
    • Export Citation

  • Han, X., and X. Li, 2008: An evaluation of the nonlinear/non-Gaussian filters for the sequential data assimilation. Remote Sens. Environ., 112, 1434–1449.

    • Search Google Scholar
    • Export Citation

  • Hoteit, I., D.-T. Pham, and J. Blum, 2002: A simplified reduced order Kalman filtering and application to altimetric data assimilation in the tropical Pacific. J. Mar. Syst., 36, 101–127.

    • Search Google Scholar
    • Export Citation

  • Hoteit, I., D.-T. Pham, G. Triantafyllou, and G. Korres, 2008: A new approximate solution of the optimal nonlinear filter for data assimilation in meteorology and oceanography. Mon. Wea. Rev., 136, 317–334.

    • Search Google Scholar
    • Export Citation

  • Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796–811.

    • Search Google Scholar
    • Export Citation

  • Jazwinski, A. H., 1970: Stochastic Processes and Filtering Theory. Academic Press, 376 pp.

  • Kotecha, J., and P. Djurić, 2003: Gaussian particle filtering. IEEE Trans. Signal Process., 51 (10), 2592–2601.

  • Lorenz, E. N., and K. A. Emanuel, 1998: Optimal sites for supplementary weather observations: Simulation with a small model. J. Atmos. Sci., 55, 399–414.

    • Search Google Scholar
    • Export Citation

  • Luo, X., I. M. Moroz, and I. Hoteit, 2010: Scaled unscented transform Gaussian sum filter: Theory and application. Physica D, 239, 684–701.

    • Search Google Scholar
    • Export Citation

  • Musso, C., N. Oudjane, and F. Le Gland, 2001: Improving regularized particle filters. Sequential Monte Carlo Methods in Practice, A. Doucet, N. De Freitas, and N. Gordon, Eds., Springer-Verlag, 247–271.

    • Search Google Scholar
    • Export Citation

  • Nakano, S., G. Ueno, and T. Higuchi, 2007: Merging particle filter for sequential data assimilation. Nonlinear Processes Geophys., 14, 395–408.

    • Search Google Scholar
    • Export Citation

  • Pham, D.-T., 2001: Stochastic methods for sequential data assimilation in strongly nonlinear systems. Mon. Wea. Rev., 129, 1194–1207.

  • Redner, R., and H. Walker, 1984: Mixture densities, maximum likelihood and the EM algorithm. SIAM Rev., 26 (2), 195–239.

  • Silverman, B. W., 1986: Density Estimation for Statistics and Data Analysis. Chapman & Hall, 176 pp.

  • Simon, D., 2006: Optimal State Estimation: Kalman, H-Infinity, and Nonlinear Approaches. Wiley-Interscience, 552 pp.

  • Smith, K. W., 2007: Cluster ensemble Kalman filter. Tellus, 59A, 749–757.

  • Snyder, C., T. Bengtsson, P. Bickel, and J. Anderson, 2008: Obstacles to high-dimensional particle filtering. Mon. Wea. Rev., 136, 4629–4640.

    • Search Google Scholar
    • Export Citation

  • Sorenson, H. W., and D. L. Alspach, 1971: Recursive Bayesian estimation using Gaussian sums. Automatica, 7, 465–479.

  • Stavropoulos, P., and D. M. Titterington, 2001: Improved particle filters and smoothing. Sequential Monte Carlo Methods in Practice, A. Doucet, N. De Freitas, and N. Gordo, Eds., Springer-Verlag, 295–317.

    • Search Google Scholar
    • Export Citation

  • Todling, R., 1999: Estimation theory and foundations of atmospheric data assimilation. DAO Office Note 1999-01, 187 pp.

  • Van Leeuwen, P. J., 2003: A variance minimizing filter for large-scale applications. Mon. Wea. Rev., 131, 2071–2084.

  • Van Leeuwen, P. J., 2009: Particle filtering in geophysical systems. Mon. Wea. Rev., 137, 4089–4114.

  • Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 1913–1924.

  • Xiong, X., I. Navon, and B. Uzunoglu, 2006: A note on the particle filter with posterior Gaussian resampling. Tellus, 58A, 456–460.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 3542 2383 738
PDF Downloads 807 148 7