Editorial Type:
Article
Article Type:
Research Article

Implicit Particle Methods and Their Connection with Variational Data Assimilation

Ethan Atkins Department of Mathematics, University of California, Berkeley, Berkeley, California

Search for other papers by Ethan Atkins in
Current site
Google Scholar
PubMed Close
,
Matthias Morzfeld Lawrence Berkeley National Laboratory, Berkeley, California

Search for other papers by Matthias Morzfeld in
Current site
Google Scholar
PubMed Close
, and
Alexandre J. Chorin Department of Mathematics, University of California, Berkeley, Berkeley, California

Search for other papers by Alexandre J. Chorin in
Current site
Google Scholar
PubMed Close
Print Publication:
01 Jun 2013
DOI:
https://doi.org/10.1175/MWR-D-12-00145.1
Page(s):
1786–1803
Restricted access

Abstract

The implicit particle filter is a sequential Monte Carlo method for data assimilation that guides the particles to the high-probability regions via a sequence of steps that includes minimizations. A new and more general derivation of this approach is presented and the method is extended to particle smoothing as well as to data assimilation for perfect models. Minimizations required by implicit particle methods are shown to be similar to those that one encounters in variational data assimilation, and the connection of implicit particle methods with variational data assimilation is explored. In particular, it is argued that existing variational codes can be converted into implicit particle methods at a low additional cost, often yielding better estimates that are also equipped with quantitative measures of the uncertainty. A detailed example is presented.

Corresponding author address: Matthias Morzfeld, Lawrence Berkeley National Laboratory, 1 Cyclotron Rd., Berkeley, CA 94720. E-mail: mmo@math.lbl.gov

Abstract

The implicit particle filter is a sequential Monte Carlo method for data assimilation that guides the particles to the high-probability regions via a sequence of steps that includes minimizations. A new and more general derivation of this approach is presented and the method is extended to particle smoothing as well as to data assimilation for perfect models. Minimizations required by implicit particle methods are shown to be similar to those that one encounters in variational data assimilation, and the connection of implicit particle methods with variational data assimilation is explored. In particular, it is argued that existing variational codes can be converted into implicit particle methods at a low additional cost, often yielding better estimates that are also equipped with quantitative measures of the uncertainty. A detailed example is presented.

Corresponding author address: Matthias Morzfeld, Lawrence Berkeley National Laboratory, 1 Cyclotron Rd., Berkeley, CA 94720. E-mail: mmo@math.lbl.gov
Save
Cover Monthly Weather Review
Monthly Weather Review

  • Arulampalam, M. S., S. Maskell, N. Gordon, and T. Clapp, 2002: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process., 50, 174–188.

    • Search Google Scholar
    • Export Citation

  • Bennet, A. F., L. M. Leslie, C. R. Hagelberg, and P. E. Powers, 1993: A cyclone prediction using a barotropic model initialized by a general inverse method. Mon. Wea. Rev., 121, 1714–1728.

    • Search Google Scholar
    • Export Citation

  • Bickel, P., T. Bengtsson, and J. Anderson, 2008: Sharp failure rates for the bootstrap particle filter in high dimensions. Pushing the Limits of Contemporary Statistics: Contributions in Honor of Jayanta K. Ghosh, Vol. 3, Institute of Mathematical Statistics, 318–329.

  • Buehner, M., 2005: Ensemble-derived stationary and flow dependent background error covariances: Evaluation in a quasi-operaion NWP setting. Quart. J. Roy. Meteor. Soc., 131, 1013–1043.

    • Search Google Scholar
    • Export Citation

  • Cappé, O., R. Douc, A. Guillin, J. Marin, and C. Robert, 2008: Adaptive importance sampling in general mixture classes. Stat. Comput., 18, 447–459.

    • Search Google Scholar
    • Export Citation

  • Carpenter, J., P. Clifford, and P. Fearnhead, 1999: Improved particle filter for nonlinear problems. Proc. IEEE Radar, Sonar, Navig., 146, 2–7.

    • Search Google Scholar
    • Export Citation

  • Chorin, A. J., 2008: Monte Carlo without chains. Commun. Appl. Math. Comput. Sci., 3, 77–93.

  • Chorin, A. J., and P. Krause, 2004: Dimensional reduction for a Bayesian filter. Proc. Natl. Acad. Sci. USA, 101, 15 013–15 017.

  • Chorin, A. J., and O. H. Hald, 2006: Stochastic Tools in Mathematics and Science. Springer, 147 pp.

  • Chorin, A. J., and X. Tu, 2009: Implicit sampling for particle filters. Proc. Natl. Acad. Sci. USA, 106, 17 249–17 254.

  • Chorin, A. J., M. Morzfeld, and X. Tu, 2010: Implicit particle filters for data assimilation. Commun. Appl. Math. Comput. Sci., 5, 221–240.

    • Search Google Scholar
    • Export Citation

  • Conn, A. R., N. I. M. Gould, and P. L. Toint, 2000: Trust-Region Methods. Society for Industrial and Applied Mathematics, 959 pp.

  • Cornebise, J., E. Moulines, and J. Olsson, 2008: Adaptive methods for sequential importance sampling with application to state space models. Stat. Comput., 18, 461–480.

    • Search Google Scholar
    • Export Citation

  • Courtier, P., 1997: Dual formulation of four-dimensional variational data assimilation. Quart. J. Roy. Meteor. Soc., 123, 2449–2461.

    • Search Google Scholar
    • Export Citation

  • Courtier, P., J. Thepaut, and A. Hollingsworth, 1994: A strategy for operational implementation of 4D-Var, using an incremental approach. Quart. J. Roy. Meteor. Soc., 120, 1367–1387.

    • Search Google Scholar
    • Export Citation

  • Dimet, F. X. L., and O. Talagrand, 1986: Variational algorithms for analysis and assimilation of meteorological observations: Theoretical aspects. Tellus, 38A, 97–110.

    • Search Google Scholar
    • Export Citation

  • Doucet, A., S. Godsill, and C. Andrieu, 2000: On sequential Monte Carlo sampling methods for Bayesian filtering. Stat. Comput., 10, 197–208.

    • Search Google Scholar
    • Export Citation

  • Doucet, A., N. de Freitas, and N. Gordon, Eds., 2001: Sequential Monte Carlo Methods in Practice. Springer, 581 pp.

  • Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99, 10 143–10 162.

    • Search Google Scholar
    • Export Citation

  • Evensen, G., 1997: Advanced data assimilation for strongly nonlinear dynamics. Mon. Wea. Rev., 125, 1342–1354.

  • Evensen, G., 2006: Data Assimilation: The Ensemble Kalman Filter. Springer, 279 pp.

  • Fedorenko, R. P., 1961: A relaxation method for solving elliptic difference equations. USSR Comput. Math. Math. Phys., 1 (5), 922–927.

    • Search Google Scholar
    • Export Citation

  • Fertig, E. J., J. Harlim, and B. R. Hunt, 2007: A comparative study of 4D-Var and a 4D ensemble Kalman filter: Perfect model simulations with Lorenz-96. Tellus,59A, 96–100.

  • Fletcher, R., 1987: Practical Methods of Optimization. 2d ed. Wiley, 436 pp.

  • Fournier, A., and Coauthors, 2010: An introduction to data assimilation and predictability in geomagnetism. Space Sci. Rev., 155, 247–291.

    • Search Google Scholar
    • Export Citation

  • Geweke, J., 1989: Bayesian inference in econometric models using Monte Carlo integration. Econometrica, 24, 1317–1399.

  • Goodman, J., and A. D. Sokal, 1989: Multigrid Monte Carlo method: Conceptual foundations. Phys. Rev. D, 40, 2035–2071.

  • Gordon, N. J., D. J. Salmond, and A. F. M. Smith, 1993: Novel approach to nonlinear/non-Gaussian Bayesian state estimation. Proc. IEEE Radar Signal Process., 140, 107–113.

    • Search Google Scholar
    • Export Citation

  • Hammersley, J. M., and D. Handscomb, 1964: Monte Carlo Methods. Vol. 1. Methuen, 178 pp.

  • Hunt, B. R., and Coauthors, 2004: Four-dimensional ensemble Kalman filtering. Tellus,56A, 273–277.

  • Johansen, A. M., and A. Doucet, 2008: A note on auxiliary particle filters. Stat. Probab. Lett., 78, 1498–1504.

  • Kalman, R. E., 1960: A new approach to linear filtering and prediction theory. J. Basic Eng.,82D, 35–48.

  • Kalman, R. E., and R. S. Bucy, 1961: New results in linear filtering and prediction theory. J. Basic Eng.,83D, 95–108.

  • Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 341 pp.

  • Kalnay, E., H. Li, T. Miyoshi, S. C. Yang, and J. Ballabrera-Poy, 2007: 4-D-Var or ensemble Kalman filter. Tellus, 59A, 758–773.

  • Kalos, M. H., and P. A. Whitlock, 1986: Monte Carlo Methods. Vol. 1. John Wiley and Sons, 199 pp.

  • Kass, R., and A. Raftery, 1995: Bayes factors. J. Amer. Stat. Assoc., 90, 773–795.

  • Kass, R., L. Tierny, and J. Kadane, 1990: The validity of posterior expansions based on Laplace’s method. Bayesian and Likelihood Methods in Statistics and Econometrics: Essays in Honor of George A. Barnard, S. Geisser et al., Eds., Studies in Bayesian Econometrics and Statistics, Vol. 7, 473–488.

  • Kloeden, P. E., and E. Platen, 1999: Numerical Solution of Stochastic Differential Equations. 3rd ed. Springer, 636 pp.

  • Kurapov, A., G. D. Egbert, J. S. Allen, and R. N. Miller, 2007: Representer-based variational data assimilation in a nonlinear model of nearshore circulation. J. Geophys. Res.,112, C11019, doi:10.1029/2007JC004117.

  • Liu, C., Q. Xiao, and B. Wang, 2008: An ensemble-based four-dimensional variational data assimilation scheme. Part I: Technical formulation and preliminary test. Mon. Wea. Rev., 136, 3363–3373.

    • Search Google Scholar
    • Export Citation

  • Liu, J. S., and R. Chen, 1995: Blind deconvolution via sequential imputations. J. Amer. Stat. Assoc., 90, 567–576.

  • Liu, J. S., R. Chen, and W. H. Wong, 1998: Rejection control and sequential importance sampling. J. Amer. Stat. Assoc., 93, 1022–1031.

    • Search Google Scholar
    • Export Citation

  • Liu, J. S., R. Chen, and T. Logvinenko, 2001: A theoretical framework for sequential importance sampling with resampling. Sequential Monte Carlo Methods in Practice, A. Doucet, N. de Freitas, and N. Gordon, Eds., Springer, 225–247.

  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130–148.

  • Miller, R. N., E. F. Carter, and S. T. Blue, 1999: Data assimilation into nonlinear stochastic models. Tellus, 51A, 167–194.

  • Moral, P. D., A. Doucet, and A. Jasra, 2012: On adaptive resampling strategies for sequential Monte Carlo methods. Bernoulli, 18, 252–278.

    • Search Google Scholar
    • Export Citation

  • Morzfeld, M., and A. J. Chorin, 2012: Implicit particle filtering for models with partial noise, and an application to geomagnetic data assimilation. Nonlinear Processes Geophys., 19, 365–382.

    • Search Google Scholar
    • Export Citation

  • Morzfeld, M., X. Tu, E. Atkins, and A. J. Chorin, 2012: A random map implementation of implicit filters. J. Comput. Phys., 231, 2049–2066.

    • Search Google Scholar
    • Export Citation

  • Nocedal, J., and S. T. Wright, 2006: Numerical Optimization. 2nd ed. Springer, 664 pp.

  • Pitt, M., and N. Shephard, 1999: Filtering via simulation: Auxiliary particle fitlers. J. Amer. Stat. Assoc., 94, 590–599.

  • Rabier, F., and P. Courtier, 1992: Four-dimensional assimilation in the presence of baroclinic instability. Quart. J. Roy. Meteor. Soc., 118, 649–672.

    • Search Google Scholar
    • Export Citation

  • Smídl, V., and R. Hofman, 2012: Application of sequential Monte Carlo estimation for early phase of radiation accident. Institute of Information Theory and Automation Tech. Rep. 2322, Prague, Czech Republic, 25 pp.

  • Smith, A. F. M., and A. E. Gelfand, 1992: Bayesian statistics without tears: A sampling–resampling perspective. Amer. Stat., 46, 84–88.

    • Search Google Scholar
    • Export Citation

  • Snyder, C., T. Bengtsson, P. Bickel, and J. Anderson, 2008: Obstacles to high-dimensional particle filtering. Mon. Wea. Rev., 136, 4629–4640.

    • Search Google Scholar
    • Export Citation

  • Talagrand, O., 1997: Assimilation of observations, an introduction. J. Meteor. Soc. Japan, 75, 191–209.

  • Talagrand, O., and P. Courtier, 1987: Variational assimilation of meteorological observations with the adjoint vorticity equation. I: Theory. Quart. J. Roy. Meteor. Soc., 113, 1311–1328.

    • Search Google Scholar
    • Export Citation

  • Tremolet, Y., 2006: Accounting for an imperfect model in 4D-Var. Quart. J. Roy. Meteor. Soc., 132, 2483–2504, doi:10.1256/qj.05.224.

    • Search Google Scholar
    • Export Citation

  • van Leeuwen, P. J., 2010: Nonlinear data assimilation in geosciences: An extremely efficient particle filter. Quart. J. Roy. Meteor. Soc., 136, 1991–1999.

    • Search Google Scholar
    • Export Citation

  • van Leeuwen, P. J., 2011: Efficient nonlinear data-assimilation in geophysical fluid dynamics. Comput. Fluids, 46, 52–58.

  • Zupanski, D., 1997: A general weak constraint applicable to operational 4DVAR data assimilation systems. Mon. Wea. Rev., 125, 2274–2292.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 269 101 7
PDF Downloads 193 73 5