Information Theory and Predictability for Low-Frequency Variability

Rafail Abramov Courant Institute of Mathematical Sciences, Center for Atmosphere Ocean Science, New York University, New York, New York

Search for other papers by Rafail Abramov in
Current site
Google Scholar
PubMed
Close
,
Andrew Majda Courant Institute of Mathematical Sciences, Center for Atmosphere Ocean Science, New York University, New York, New York

Search for other papers by Andrew Majda in
Current site
Google Scholar
PubMed
Close
, and
Richard Kleeman Courant Institute of Mathematical Sciences, Center for Atmosphere Ocean Science, New York University, New York, New York

Search for other papers by Richard Kleeman in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

A predictability framework, based on relative entropy, is applied here to low-frequency variability in a standard T21 barotropic model on the sphere with realistic orography. Two types of realistic climatology, corresponding to different heights in the troposphere, are used. The two dynamical regimes with different mixing properties, induced by the two types of climate, allow the testing of the predictability framework in a wide range of situations. The leading patterns of empirical orthogonal functions, projected onto physical space, mimic the large-scale teleconnections of observed flow, in particular the Arctic Oscillation, Pacific–North American pattern, and North Atlantic Oscillation. In the ensemble forecast experiments, relative entropy is utilized to measure the lack of information in three different situations: the lack of information in the climate relative to the forecast ensemble, the lack of information by using only the mean state and variance of the forecast ensemble, and information flow—the time propagation of the lack of information in the direct product of marginal probability densities relative to joint probability density in a forecast ensemble. A recently developed signal–dispersion–cross-term decomposition is utilized for climate-relative entropy to determine different physical sources of forecast information. It is established that though dispersion controls both the mean state and variability of relative entropy, the sum of signal and cross-term governs physical correlations between a forecast ensemble and EOF patterns. Information flow is found to be responsible for correlated switches in the EOF patterns within a forecast ensemble.

Corresponding author address: Dr. Rafail Abramov, Courant Institute of Mathematical Sciences, New York University, 251 Mercer Street, New York, NY 10012. Email: abramov@cims.nyu.edu

Abstract

A predictability framework, based on relative entropy, is applied here to low-frequency variability in a standard T21 barotropic model on the sphere with realistic orography. Two types of realistic climatology, corresponding to different heights in the troposphere, are used. The two dynamical regimes with different mixing properties, induced by the two types of climate, allow the testing of the predictability framework in a wide range of situations. The leading patterns of empirical orthogonal functions, projected onto physical space, mimic the large-scale teleconnections of observed flow, in particular the Arctic Oscillation, Pacific–North American pattern, and North Atlantic Oscillation. In the ensemble forecast experiments, relative entropy is utilized to measure the lack of information in three different situations: the lack of information in the climate relative to the forecast ensemble, the lack of information by using only the mean state and variance of the forecast ensemble, and information flow—the time propagation of the lack of information in the direct product of marginal probability densities relative to joint probability density in a forecast ensemble. A recently developed signal–dispersion–cross-term decomposition is utilized for climate-relative entropy to determine different physical sources of forecast information. It is established that though dispersion controls both the mean state and variability of relative entropy, the sum of signal and cross-term governs physical correlations between a forecast ensemble and EOF patterns. Information flow is found to be responsible for correlated switches in the EOF patterns within a forecast ensemble.

Corresponding author address: Dr. Rafail Abramov, Courant Institute of Mathematical Sciences, New York University, 251 Mercer Street, New York, NY 10012. Email: abramov@cims.nyu.edu

Save
  • Abramov, R., and A. Majda, 2004: Quantifying uncertainty for non-Gaussian ensembles in complex systems. SIAM J. Sci. Stat. Comp., in press.

    • Search Google Scholar
    • Export Citation
  • Abramov, R., G. Kovačič, and A. Majda, 2003: Hamiltonian structure and statistically relevant conserved quantities for the truncated Burgers–Hopf equation. Comm. Pure Appl. Math., 56 , 146.

    • Search Google Scholar
    • Export Citation
  • Anderson, J., and W. Stern, 1996: Evaluating the potential predictive utility of ensemble forecasts. J. Climate, 9 , 260269.

  • Branstator, G., and S. Haupt, 1998: An empirical model of barotropic atmospheric dynamics and its response to tropical forcing. J. Climate, 11 , 26452667.

    • Search Google Scholar
    • Export Citation
  • Buizza, R., and T. Palmer, 1998: Impact of ensemble size on ensemble prediction. Mon. Wea. Rev., 126 , 25032518.

  • Cai, D., K. Haven, and A. Majda, 2004: Quantifying predictability in a simple model with complex features, I: The perfect predictability scenario. Stochast. Dyn., in press.

    • Search Google Scholar
    • Export Citation
  • Carnevale, G., and G. Holloway, 1982: Information decay and the predictability of turbulent flows. J. Fluid Mech., 116 , 115121.

  • Cover, T., and J. Thomas, 1991: Elements of Information Theory. Wiley, 542 pp.

  • Crommelin, D., 2003: Regime transitions and heteroclinic connections in a barotropic atmosphere. J. Atmos. Sci., 60 , 229246.

  • Ehrendorfer, M., 1994: The Liouville equation and its potential usefulness for the prediction of forecast skill. Part I: Theory. Mon. Wea. Rev., 122 , 703713.

    • Search Google Scholar
    • Export Citation
  • Ehrendorfer, M., and J. Tribbia, 1997: Optimal prediction of forecast error covariances through singular vectors. J. Atmos. Sci., 54 , 286313.

    • Search Google Scholar
    • Export Citation
  • Franzke, C., A. Majda, and E. Vanden-Eijnden, 2005: Low-order stochastic mode reduction for a realistic barotropic model climate. J. Atmos. Sci., in press.

    • Search Google Scholar
    • Export Citation
  • Kalnay, E., 2003: Atmospheric Modeling, Data Assimilation and Predictability. Cambridge University Press, 363 pp.

  • Kleeman, R., 2002: Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci., 59 , 20572072.

  • Kleeman, R., A. Majda, and I. Timofeyev, 2002: Quantifying predictability in a model with statistical features of the atmosphere. Proc. Natl. Acad. Sci., 99 , 1529115296.

    • Search Google Scholar
    • Export Citation
  • Lorenz, E., 1963: Deterministic non-periodic flows. J. Atmos. Sci., 20 , 130141.

  • Lorenz, E., and K. Emanuel, 1998: Optimal sites for supplementary weather observations. J. Atmos. Sci., 55 , 399414.

  • Majda, A., and I. Timofeyev, 2000: Remarkable statistical behavior for truncated Burgers-Hopf dynamics. Proc. Natl. Acad. Sci., 97 , 1241312416.

    • Search Google Scholar
    • Export Citation
  • Majda, A., and I. Timofeyev, 2002: Statistical mechanics for truncations of the Burgers–Hopf equation: A model for intrinsic stochastic behavior with scaling. Milan J. Math., 70 , 3996.

    • Search Google Scholar
    • Export Citation
  • Majda, A., R. Kleeman, and D. Cai, 2002: A mathematical framework for quantifying predictability through relative entropy. Meth. Appl. Anal., 9 , 425444.

    • Search Google Scholar
    • Export Citation
  • Mead, L., and N. Papanicolaou, 1984: Maximum entropy in the problem of moments. J. Math. Phys., 25 , 24042417.

  • Palmer, T., 2000: Predicting uncertainty in forecasts of weather and climate. Rep. Prog. Phys., 63 , 71116.

  • Palmer, T., F. Molteni, R. Mureau, R. Buizza, P. Chapelet, and J. Tribbia, 1993: Ensemble prediction. Proc. Vol. 1, of the ECMFW Seminar on the validation of Models over Europe, Reading, United Kingdom, 21–66.

    • Search Google Scholar
    • Export Citation
  • Reynolds, C. A., and T. N. Palmer, 1998: Decaying singular vectors and their impact on analysis and forecast correction. J. Atmos. Sci., 55 , 30053032.

    • Search Google Scholar
    • Export Citation
  • Roads, J., 1987: Predictability in the extended range. J. Atmos. Sci., 44 , 34953527.

  • Roulston, M., and L. Smith, 2002: Evaluating probabilistic forecasts using information theory. Mon. Wea. Rev., 130 , 16531660.

  • Schneider, T., and S. Griffies, 1999: A conceptual framework for predictability studies. J. Climate, 12 , 31333155.

  • Selten, F., 1995: An efficient description of the dynamics of barotropic flow. J. Atmos. Sci., 52 , 915936.

  • Simmons, A., J. Wallace, and G. Branstator, 1983: Barotropic wave propagation and instability, and atmospheric teleconnection patterns. J. Atmos. Sci., 40 , 13631392.

    • Search Google Scholar
    • Export Citation
  • Toth, Z., and E. Kalnay, 1993: Ensemble forecasting at NMC: The Generation of Perturbations. Bull. Amer. Meteor. Soc., 74 , 23172330.

  • Toth, Z., and E. Kalnay, 1997: Ensemble forecasting at NCEP and the breeding method. Mon. Wea. Rev., 125 , 32973319.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 235 114 7
PDF Downloads 168 77 3