Localized Ensemble-Based Tangent Linear Models and Their Use in Propagating Hybrid Error Covariance Models

Sergey Frolov University Corporation for Atmospheric Research, Monterey, California

Search for other papers by Sergey Frolov in
Current site
Google Scholar
PubMed
Close
and
Craig H. Bishop Naval Research Laboratory, Marine Meteorology Division, Monterey, California

Search for other papers by Craig H. Bishop in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Hybrid error covariance models that blend climatological estimates of forecast error covariances with ensemble-based, flow-dependent forecast error covariances have led to significant reductions in forecast error when employed in 4DVAR data assimilation schemes. Tangent linear models (TLMs) designed to predict the differences between perturbed and unperturbed simulations of the weather forecast are a key component of such 4DVAR schemes. However, many forecasting centers have found that TLMs and their adjoints do not scale well computationally and are difficult to create and maintain—particularly for coupled ocean–wave–ice–atmosphere models. In this paper, the authors create ensemble-based TLMs (ETLMs) and test their ability to propagate both climatological and flow-dependent parts of hybrid error covariance models. These tests demonstrate that rank deficiency limits the utility of unlocalized ETLMs. High-rank, time-evolving, flow-adaptive localization functions are constructed and tested using recursive application of short-duration ETLMs, each of which is localized using a static localization. Since TLM operators do not need to be semipositive definite, the authors experiment with a variety of localization approaches including step function localization. The step function localization leads to a local formulation that was found to be highly effective. In tests using simple one-dimensional models with both dispersive and nondispersive dynamics, it is shown that practical ETLM configurations were effective at propagating covariances as far as four error correlation scales.

Corresponding author address: Sergey Frolov, University Corporation for Atmospheric Research, 7 Grace Hopper Ave., Monterey, CA 93943-5502. E-mail: frolov@nrlmry.navy.mil

Abstract

Hybrid error covariance models that blend climatological estimates of forecast error covariances with ensemble-based, flow-dependent forecast error covariances have led to significant reductions in forecast error when employed in 4DVAR data assimilation schemes. Tangent linear models (TLMs) designed to predict the differences between perturbed and unperturbed simulations of the weather forecast are a key component of such 4DVAR schemes. However, many forecasting centers have found that TLMs and their adjoints do not scale well computationally and are difficult to create and maintain—particularly for coupled ocean–wave–ice–atmosphere models. In this paper, the authors create ensemble-based TLMs (ETLMs) and test their ability to propagate both climatological and flow-dependent parts of hybrid error covariance models. These tests demonstrate that rank deficiency limits the utility of unlocalized ETLMs. High-rank, time-evolving, flow-adaptive localization functions are constructed and tested using recursive application of short-duration ETLMs, each of which is localized using a static localization. Since TLM operators do not need to be semipositive definite, the authors experiment with a variety of localization approaches including step function localization. The step function localization leads to a local formulation that was found to be highly effective. In tests using simple one-dimensional models with both dispersive and nondispersive dynamics, it is shown that practical ETLM configurations were effective at propagating covariances as far as four error correlation scales.

Corresponding author address: Sergey Frolov, University Corporation for Atmospheric Research, 7 Grace Hopper Ave., Monterey, CA 93943-5502. E-mail: frolov@nrlmry.navy.mil
Save
  • Bishop, C. H., and E. Heifetz, 2000: Apparent absolute instability and the continuous spectrum. J. Atmos. Sci., 57, 35923608, doi:10.1175/1520-0469(2000)057<3592:AAIATC>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Bishop, C. H., and E. Satterfield, 2013: Hidden error variance theory. Part I: Exposition and analytic model. Mon. Wea. Rev., 141, 14541468, doi:10.1175/MWR-D-12-00118.1.

    • Search Google Scholar
    • Export Citation
  • Bishop, C. H., B. Huang, and X. Wang, 2015: A nonvariational consistent hybrid ensemble filter. Mon. Wea. Rev., 143, 50735090, doi:10.1175/MWR-D-14-00391.1.

    • Search Google Scholar
    • Export Citation
  • Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010a: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part I: Description and single-observation experiments. Mon. Wea. Rev., 138, 15501566, doi:10.1175/2009MWR3157.1.

    • Search Google Scholar
    • Export Citation
  • Buehner, M., P. L. Houtekamer, C. Charette, H. L. Mitchell, and B. He, 2010b: Intercomparison of variational data assimilation and the ensemble Kalman filter for global deterministic NWP. Part II: One-month experiments with real observations. Mon. Wea. Rev., 138, 15671586, doi:10.1175/2009MWR3158.1.

    • Search Google Scholar
    • Export Citation
  • Gaspari, G., and S. E. Cohn, 1999: Construction of correlation functions in two and three dimensions. Quart. J. Roy. Meteor. Soc., 125, 723757, doi:10.1002/qj.49712555417.

    • Search Google Scholar
    • Export Citation
  • Hakim, G. J., 2005: Vertical structure of midlatitude analysis and forecast errors. Mon. Wea. Rev., 133, 567578, doi:10.1175/MWR-2882.1.

    • Search Google Scholar
    • Export Citation
  • Harris, F. J., 1978: On the use of windows for harmonic analysis with the discrete Fourier transform. Proc. IEEE, 66, 5183, doi:10.1109/PROC.1978.10837.

    • Search Google Scholar
    • Export Citation
  • Holton, J. R., 2004: An Introduction to Dynamic Meteorology. 4th ed. Academic Press, 535 pp.

  • Hunt, B. R., E. J. Kostelich, and I. Szunyogh, 2007: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter. Physica D, 230, 112126, doi:10.1016/j.physd.2006.11.008.

    • Search Google Scholar
    • Export Citation
  • Kleist, D. T., and K. Ide, 2015: An OSSE-based evaluation of hybrid variational–ensemble data assimilation for the NCEP GFS. Part II: 4DEnVar and hybrid variants. Mon. Wea. Rev., 143, 452470, doi:10.1175/MWR-D-13-00350.1.

    • Search Google Scholar
    • Export Citation
  • Kuhl, D. D., T. E. Rosmond, C. H. Bishop, J. McLay, and N. L. Baker, 2013: Comparison of hybrid ensemble/4DVar and 4DVar within the NAVDAS-AR data assimilation framework. Mon. Wea. Rev., 141, 27402758, doi:10.1175/MWR-D-12-00182.1.

    • Search Google Scholar
    • Export Citation
  • Lermusiaux, P. F. J., and A. R. Robinson, 1999: Data assimilation via error subspace statistical estimation. Part I: Theory and schemes. Mon. Wea. Rev., 127, 13851407, doi:10.1175/1520-0493(1999)127<1385:DAVESS>2.0.CO;2.

    • Search Google Scholar
    • Export Citation
  • Lorenc, A. C., 2003a: The potential of the ensemble Kalman filter for NWP—A comparison with 4DVAR. Quart. J. Roy. Meteor. Soc., 129, 31833203, doi:10.1256/qj.02.132.

    • Search Google Scholar
    • Export Citation
  • Lorenc, A. C., 2003b: Modelling of error covariances by 4D-Var data assimilation. Quart. J. Roy. Meteor. Soc., 129, 31673182, doi:10.1256/qj.02.131.

    • Search Google Scholar
    • Export Citation
  • Lorenc, A. C., N. E. Bowler, A. M. Clayton, S. R. Pring, and D. Fairbairn, 2015: Comparison of hybrid-4DEnVar and hybrid-4DVar data assimilation methods for global NWP. Mon. Wea. Rev., 143, 212229, doi:10.1175/MWR-D-14-00195.1.

    • Search Google Scholar
    • Export Citation
  • Pelc, J. S., E. Simon, L. Bertino, G. El Serafy, and A. W. Heemink, 2012: Application of model reduced 4D-Var to a 1D ecosystem model. Ocean Modell., 57–58, 4358, doi:10.1016/j.ocemod.2012.09.003.

    • Search Google Scholar
    • Export Citation
  • Van der Merwe, R., and E. Wan, 2001: Efficient derivative-free Kalman filters for online learning. Proc. European Symp. on Artificial Neural Networks: ESANN’2001, Bruges, Belgium, 205–210.

  • Zhang, M., and F. Zhang, 2012: E4DVar: Coupling an ensemble Kalman filter with four-dimensional variational data assimilation in a limited-area weather prediction model. Mon. Wea. Rev., 140, 587600, doi:10.1175/MWR-D-11-00023.1.

    • Search Google Scholar
    • Export Citation
All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 447 127 12
PDF Downloads 283 93 4