Evolutionary Algorithm-Based Error Parameterization Methods for Data Assimilation

Yulong Bai Cold and Arid Regions Environmental and Engineering Research Institute, Chinese Academy of Sciences, and College of Physics and Electrical Engineering, Northwest Normal University, Lanzhou, China

Search for other papers by Yulong Bai in
Current site
Google Scholar
PubMed
Close
and
Xin Li Cold and Arid Regions Environmental and Engineering Research Institute, Chinese Academy of Sciences, Lanzhou, China

Search for other papers by Xin Li in
Current site
Google Scholar
PubMed
Close
Restricted access

We are aware of a technical issue preventing figures and tables from showing in some newly published articles in the full-text HTML view.
While we are resolving the problem, please use the online PDF version of these articles to view figures and tables.

Abstract

The methods of parameterizing model errors have a substantial effect on the accuracy of ensemble data assimilation. After a review of the current error-handling methods, a new blending error parameterization method was designed to combine the advantages of multiplicative inflation and additive inflation. Motivated by evolutionary algorithm concepts that have been developed in the control engineering field for years, the authors propose a new data assimilation method coupled with crossover principles of genetic algorithms based on ensemble transform Kalman filters (ETKFs). The numerical experiments were developed based on the classic nonlinear model (i.e., the Lorenz model). Convex crossover, affine crossover, direction-based crossover, and blending crossover data assimilation systems were consequently designed. When focusing on convex crossover and affine crossover data assimilation problems, the error adjustment factors were investigated with respect to four aspects, which were the initial conditions of the Lorenz model, the number of ensembles, observation covariance, and the observation interval. A new data assimilation system, coupled with genetic algorithms, is proposed to solve the difficult problem of the error adjustment factor search, which is usually performed using trial-and-error methods. The results show that all of the methods can adaptively obtain the best error factors within the constraints of the fitness function.

Corresponding author address: Yulong Bai, College of Physics and Electrical Engineering, Northwest Normal University, Lanzhou 730070, China. E-mail: yulongbai@gmail.com

Abstract

The methods of parameterizing model errors have a substantial effect on the accuracy of ensemble data assimilation. After a review of the current error-handling methods, a new blending error parameterization method was designed to combine the advantages of multiplicative inflation and additive inflation. Motivated by evolutionary algorithm concepts that have been developed in the control engineering field for years, the authors propose a new data assimilation method coupled with crossover principles of genetic algorithms based on ensemble transform Kalman filters (ETKFs). The numerical experiments were developed based on the classic nonlinear model (i.e., the Lorenz model). Convex crossover, affine crossover, direction-based crossover, and blending crossover data assimilation systems were consequently designed. When focusing on convex crossover and affine crossover data assimilation problems, the error adjustment factors were investigated with respect to four aspects, which were the initial conditions of the Lorenz model, the number of ensembles, observation covariance, and the observation interval. A new data assimilation system, coupled with genetic algorithms, is proposed to solve the difficult problem of the error adjustment factor search, which is usually performed using trial-and-error methods. The results show that all of the methods can adaptively obtain the best error factors within the constraints of the fitness function.

Corresponding author address: Yulong Bai, College of Physics and Electrical Engineering, Northwest Normal University, Lanzhou 730070, China. E-mail: yulongbai@gmail.com
Save
  • Anderson, J. L., 2007: Exploring the need for localization in ensemble data assimilation using a hierarchical ensemble filter. Physica D, 230, 99–111.

    • Search Google Scholar
    • Export Citation
  • Anderson, J. L., and S. L. Anderson, 1999: A Monte Carlo implementation of the nonlinear filtering problem to produce ensemble assimilation and forecasts. Mon. Wea. Rev., 127, 2741–2758.

    • Search Google Scholar
    • Export Citation
  • Baek, S.-J., B. R. Hunt, E. Kalnay, E. Ott, and I. Szunyogh, 2006: Local ensemble Kalman filtering in the presence of model bias. Tellus, 58A, 293–306.

    • Search Google Scholar
    • Export Citation
  • Barth, N. H., 1992: Oceanographic experiment design. II: Genetic algorithms. J. Atmos. Oceanic Technol., 9, 434–443.

  • Bishop, C. H., B. J. Etherton, and S. J. Majumdar, 2001: Adaptive sampling with the ensemble transform Kalman filter. Part I: Theoretical aspects. Mon. Wea. Rev., 129, 420–436.

    • Search Google Scholar
    • Export Citation
  • Burgers, G., P. J. van Leeuwen, and G. Evensen, 1998: Analysis scheme in the ensemble Kalman filter. Mon. Wea. Rev., 126, 1719–1724.

    • Search Google Scholar
    • Export Citation
  • Daley, R., 1991: Atmospheric Data Analysis. Cambridge University Press, 457 pp.

  • Dee, D. P., and A. M. da Silva, 1998: Data assimilation in the presence of forecast bias. Quart. J. Roy. Meteor. Soc., 124, 269–295.

    • Search Google Scholar
    • Export Citation
  • Drecourt, J. P., H. Madsen, and D. Rosbjerg, 2005: Bias aware Kalman filters: Comparison and improvements. Adv. Water Resour., 29, 707–718.

    • Search Google Scholar
    • Export Citation
  • Evensen, G., 1994: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics. J. Geophys. Res., 99, 10 143–10 162.

    • Search Google Scholar
    • Export Citation
  • Evensen, G., 2007: Data Assimilation: The Ensemble Kalman Filter. Springer-Verlag, 279 pp.

  • Gelb, A., 1974: Applied Optimal Estimation. MIT Press, 362 pp.

  • Hamill, T. M., and J. S. Whitaker, 2005: Accounting for the error due to unresolved scales in ensemble data assimilation: A comparison of different approaches. Mon. Wea. Rev., 133, 3132–3147.

    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., J. S. Whitaker, and C. Snyder, 2001: Distance-dependent filtering of background error covariance estimates in an ensemble Kalman filter. Mon. Wea. Rev., 129, 2776–2790.

    • Search Google Scholar
    • Export Citation
  • Holland, J. H., 1992: Adaptation in Natural and Artificial Systems. 2nd ed. MIT Press, 228 pp.

  • Houtekamer, P. L., and H. L. Mitchell, 1998: Data assimilation using an ensemble Kalman filter technique. Mon. Wea. Rev., 126, 796–811.

    • Search Google Scholar
    • Export Citation
  • Houtekamer, P. L., and H. L. Mitchell, 2005: Ensemble Kalman filtering. Quart. J. Roy. Meteor. Soc., 131, 3269–3289.

  • Hunt, B. R., E. Kostelich, and I. Szunyogh, 2007: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. Physica D, 230, 112–126.

    • Search Google Scholar
    • Export Citation
  • Jazwinski, A. H., 1970: Stochastic Processes and Filtering Theory. Academic Press, 376 pp.

  • Kailath, T., 1980: Linear Systems. Prentice-Hall, 854 pp.

  • Kalman, R., 1960: A new approach to linear filtering and predication problems. J. Basic Eng., 82, 35–45.

  • Kalnay, E., 2002: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 341 pp.

  • Kalnay, E., H. Li, T. Miyoshi, S.-C. Yang, and J. Ballabrera Poy, 2007: 4D-Var or ensemble Kalman filter? Tellus, 59A, 758–773.

  • Katul, G. G., O. Wendroth, M. B. Parlange, C. E. Puente, M. V. Folegatti, and D. R. Nielsen, 1993: Estimation of in situ hydraulic conductivity functions from nonlinear filtering theory. Water Resour. Res., 29, 1063–1070.

    • Search Google Scholar
    • Export Citation
  • Keppenne, C. L., M. M. Rienecker, N. P. Kurkowski, and D. A. Adamec, 2005: Ensemble Kalman filters assimilation of temperature and altimeter data with bias correction and application to seasonal predication. Nonlinear Processes Geophys., 12, 491–503.

    • Search Google Scholar
    • Export Citation
  • Lee, Y. H., S. K. Park, and D. E. Chang, 2006: Parameter estimation using the genetic algorithm and its impact on quantitative precipitation forecast. Ann. Geophys., 24, 3185–3189.

    • Search Google Scholar
    • Export Citation
  • Li, H., E. Kalnay, T. Miyoshi, and C. M. Danforth, 2009: Accounting for model errors in ensemble data assimilation. Mon. Wea. Rev., 137, 3407–3419.

    • Search Google Scholar
    • Export Citation
  • Li, X., and Coauthors, 2007: Development of a Chinese land data assimilation system: Its progress and prospects. Prog. Nat. Sci., 17, 881–892.

    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130–141.

  • Ma, Y. J., Y. L. Bai, and Z. Y. Jiang, 2009: Fast multi-objective constrained evolutionary algorithm and its convergence. Systems Eng. Theor. Practice, 29, 149–157.

    • Search Google Scholar
    • Export Citation
  • McLaughlin, D., 2002: An integrated approach to hydrologic data assimilation: interpolation, smoothing, and filtering. Adv. Water Resour., 25, 1275–1286.

    • Search Google Scholar
    • Export Citation
  • Meng, Z., and F. Zhang, 2007: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part II: Imperfect model experiments. Mon. Wea. Rev., 135, 1403–1423.

    • Search Google Scholar
    • Export Citation
  • Meng, Z., and F. Zhang, 2008: Tests of an ensemble Kalman filter for mesoscale and regional-scale data assimilation. Part III: Comparison with 3DVAR in a real-data case study. Mon. Wea. Rev., 136, 522–540.

    • Search Google Scholar
    • Export Citation
  • Ott, E., and Coauthors, 2004: A local ensemble Kalman filter for atmospheric data assimilation. Tellus, 56A, 415–428.

  • Reichle, R. H., 2008: Data assimilation methods in the earth sciences. Adv. Water Resour., 31, 1411–1418.

  • Walters, G. A., and D. K. Smith, 1995: Evolutionary design algorithm for optimal layout of tree networks. Eng. Optim., 24, 261–281.

    • Search Google Scholar
    • Export Citation
  • Wang, D. B., and X. M. Cai, 2007: Optimal estimation of irrigation schedule—An example of quantifying human interferences to hydrologic process. Adv. Water Resour., 30, 1844–1857.

    • Search Google Scholar
    • Export Citation
  • Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observation. Mon. Wea. Rev., 130, 1913–1924.

    • Search Google Scholar
    • Export Citation
  • Whitaker, J. S., T. M. Hamill, X. Wei, Y. Song, and Z. Toth, 2008: Ensemble data assimilation with the NCEP global forecast system. Mon. Wea. Rev., 136, 463–482.

    • Search Google Scholar
    • Export Citation
  • Whitley, D., 2001: An overview of evolutionary algorithms: Practical issues and common pitfalls. Info. Software Technol., 43, 817–831.

    • Search Google Scholar
    • Export Citation
  • Zhang, F., C. Snyder, and J. Sun, 2004: Impacts of initial estimate and observation availability on convective-scale data assimilation with an ensemble Kalman filter. Mon. Wea. Rev., 132, 1238–1253.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1270 849 356
PDF Downloads 269 76 4