Correlation between System and Observation Errors in Data Assimilation

Tyrus Berry George Mason University, Fairfax, Virginia

Search for other papers by Tyrus Berry in
Current site
Google Scholar
PubMed
Close
and
Timothy Sauer George Mason University, Fairfax, Virginia

Search for other papers by Timothy Sauer in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Accurate knowledge of two types of noise, system and observational, is an important aspect of Bayesian filtering methodology. Traditionally, this knowledge is reflected in individual covariance matrices for the two noise contributions, while correlations between the system and observational noises are ignored. We contend that in practical problems, it is unlikely that system and observational errors are uncorrelated, in particular for geophysically motivated examples where errors are dominated by model and observation truncations. Moreover, it is shown that accounting for the cross correlations in the filtering algorithm, for example in a correlated ensemble Kalman filter, can result in significant improvements in filter accuracy for data from typical dynamical systems. In particular, we discuss the extreme case where the two types of errors are maximally correlated relative to the individual covariances.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Timothy Sauer, tsauer@gmu.edu

Abstract

Accurate knowledge of two types of noise, system and observational, is an important aspect of Bayesian filtering methodology. Traditionally, this knowledge is reflected in individual covariance matrices for the two noise contributions, while correlations between the system and observational noises are ignored. We contend that in practical problems, it is unlikely that system and observational errors are uncorrelated, in particular for geophysically motivated examples where errors are dominated by model and observation truncations. Moreover, it is shown that accounting for the cross correlations in the filtering algorithm, for example in a correlated ensemble Kalman filter, can result in significant improvements in filter accuracy for data from typical dynamical systems. In particular, we discuss the extreme case where the two types of errors are maximally correlated relative to the individual covariances.

© 2018 American Meteorological Society. For information regarding reuse of this content and general copyright information, consult the AMS Copyright Policy (www.ametsoc.org/PUBSReuseLicenses).

Corresponding author: Timothy Sauer, tsauer@gmu.edu
Save
  • Bélanger, P. R., 1974: Estimation of noise covariance matrices for a linear time-varying stochastic process. Automatica, 10, 267275, https://doi.org/10.1016/0005-1098(74)90037-5.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Berry, T., and T. Sauer, 2013: Adaptive ensemble Kalman filtering of non-linear systems. Tellus, 65A, 20331, https://doi.org/10.3402/tellusa.v65i0.20331.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Dee, D. P., 1995: On-line estimation of error covariance parameters for atmospheric data assimilation. Mon. Wea. Rev., 123, 11281145, https://doi.org/10.1175/1520-0493(1995)123<1128:OLEOEC>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Guttman, L., 1946: Enlargement methods for computing the inverse matrix. Ann. Math. Stat., 17, 336343, https://doi.org/10.1214/aoms/1177730946.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hamill, T. M., and J. S. Whitaker, 2005: Accounting for the error due to unresolved scales in ensemble data assimilation: A comparison of different approaches. Mon. Wea. Rev., 133, 31323147, https://doi.org/10.1175/MWR3020.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Hodyss, D., and N. Nichols, 2015: The error of representation: Basic understanding. Tellus, 67A, 24822, https://doi.org/10.3402/tellusa.v67.24822.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Janjić, T., and S. E. Cohn, 2006: Treatment of observation error due to unresolved scales in atmospheric data assimilation. Mon. Wea. Rev., 134, 29002915, https://doi.org/10.1175/MWR3229.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Janjić, T., and Coauthors, 2018: On the representation error in data assimilation. Quart. J. Roy. Meteor. Soc., https://doi.org/10.1002/qj.3130, in press.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Julier, S. J., and J. K. Uhlmann, 2004: Unscented filtering and nonlinear estimation. Proc. IEEE, 92, 401422, https://doi.org/10.1109/JPROC.2003.823141.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Kuramoto, Y., and T. Tsuzuki, 1976: Persistent propagation of concentration waves in dissipative media far from thermal equilibrium. Prog. Theor. Phys., 55, 356369, https://doi.org/10.1143/PTP.55.356.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Liu, Z.-Q., and F. Rabier, 2002: The interaction between model resolution, observation resolution and observation density in data assimilation: A one-dimensional study. Quart. J. Roy. Meteor. Soc., 128, 13671386, https://doi.org/10.1256/003590002320373337.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1963: Deterministic nonperiodic flow. J. Atmos. Sci., 20, 130141, https://doi.org/10.1175/1520-0469(1963)020<0130:DNF>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Lorenz, E. N., 1996: Predictability—A problem partly solved. Proc. Seminar on Predictability, Vol. 1, Reading, United Kingdom, ECMWF, 18 pp., https://www.ecmwf.int/sites/default/files/elibrary/1995/10829-predictability-problem-partly-solved.pdf.

  • Mehra, R., 1970: On the identification of variances and adaptive Kalman filtering. IEEE Trans. Autom. Control, 15, 175184, https://doi.org/10.1109/TAC.1970.1099422.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Mehra, R., 1972: Approaches to adaptive filtering. IEEE Trans. Autom. Control, 17, 693698, https://doi.org/10.1109/TAC.1972.1100100.

  • Mitchell, H. L., and R. Daley, 1997: Discretization error and signal/error correlation in atmospheric data assimilation. Tellus, 49A, 3253, https://doi.org/10.3402/tellusa.v49i1.12210.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Oke, P. R., and P. Sakov, 2008: Representation error of oceanic observations for data assimilation. J. Atmos. Oceanic Technol., 25, 10041017, https://doi.org/10.1175/2007JTECHO558.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Ran, A., and R. Vreugdenhil, 1988: Existence and comparison theorems for algebraic Riccati equations for continuous- and discrete-time systems. Linear Algebra Appl., 99, 6383, https://doi.org/10.1016/0024-3795(88)90125-5.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Satterfield, E., D. Hodyss, D. D. Kuhl, and C. H. Bishop, 2017: Investigating the use of ensemble variance to predict observation error of representation. Mon. Wea. Rev., 145, 653667, https://doi.org/10.1175/MWR-D-16-0299.1.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Simon, D., 2006: Optimal State Estimation: Kalman, H Infinity, and Nonlinear Approaches. Wiley-Interscience, 552 pp.

    • Crossref
    • Export Citation
  • Sivashinsky, G., 1977: Nonlinear analysis of hydrodynamic instability in laminar flames I. Derivation of basic equations. Acta Astronaut., 4, 11771206, https://doi.org/10.1016/0094-5765(77)90096-0.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Van Leeuwen, P. J., 2015: Representation errors and retrievals in linear and nonlinear data assimilation. Quart. J. Roy. Meteor. Soc., 141, 16121623, https://doi.org/10.1002/qj.2464.

    • Crossref
    • Search Google Scholar
    • Export Citation
  • Whitaker, J. S., and T. M. Hamill, 2002: Ensemble data assimilation without perturbed observations. Mon. Wea. Rev., 130, 19131924, https://doi.org/10.1175/1520-0493(2002)130<1913:EDAWPO>2.0.CO;2.

    • Crossref
    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 1322 391 47
PDF Downloads 969 90 16