Average Predictability Time. Part I: Theory

Timothy DelSole George Mason University, Fairfax, Virginia, and Center for Ocean–Land–Atmosphere Studies, Calverton, Maryland

Search for other papers by Timothy DelSole in
Current site
Google Scholar
PubMed
Close
and
Michael K. Tippett International Research Institute for Climate and Society, Palisades, New York

Search for other papers by Michael K. Tippett in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

This paper introduces the average predictability time (APT) for characterizing the overall predictability of a system. APT is the integral of a predictability measure over all lead times. The underlying predictability measure is based on the Mahalanobis metric, which is invariant to linear transformation of the prediction variables and hence gives results that are independent of the (arbitrary) basis set used to represent the state. The APT is superior to some integral time scales used to characterize the time scale of a random process because the latter vanishes in situations when it should not, whereas the APT converges to reasonable values. The APT also can be written in terms of the power spectrum, thereby clarifying the connection between predictability and the power spectrum. In essence, predictability is related to the width of spectral peaks, with strong, narrow peaks associated with high predictability and nearly flat spectra associated with low predictability. Closed form expressions for the APT for linear stochastic models are derived. For a given dynamical operator, the stochastic forcing that minimizes APT is one that allows transformation of the original stochastic model into a set of uncoupled, independent stochastic models. Loosely speaking, coupling enhances predictability. A rigorous upper bound on the predictability of linear stochastic models is derived, which clarifies the connection between predictability at short and long lead times, as well as the choice of norm for measuring error growth. Surprisingly, APT can itself be interpreted as the “total variance” of an alternative stochastic model, which means that generalized stability theory and dynamical systems theory can be used to understand APT. The APT can be decomposed into an uncorrelated set of components that maximize predictability time, analogous to the way principle component analysis decomposes variance. Part II of this paper develops a practical method for performing this decomposition and applies it to meteorological data.

Corresponding author address: Timothy DelSole, Center for Ocean–Land–Atmosphere Studies, 4041 Powder Mill Rd., Suite 302, Calverton, MD 20705. Email: delsole@cola.iges.org

Abstract

This paper introduces the average predictability time (APT) for characterizing the overall predictability of a system. APT is the integral of a predictability measure over all lead times. The underlying predictability measure is based on the Mahalanobis metric, which is invariant to linear transformation of the prediction variables and hence gives results that are independent of the (arbitrary) basis set used to represent the state. The APT is superior to some integral time scales used to characterize the time scale of a random process because the latter vanishes in situations when it should not, whereas the APT converges to reasonable values. The APT also can be written in terms of the power spectrum, thereby clarifying the connection between predictability and the power spectrum. In essence, predictability is related to the width of spectral peaks, with strong, narrow peaks associated with high predictability and nearly flat spectra associated with low predictability. Closed form expressions for the APT for linear stochastic models are derived. For a given dynamical operator, the stochastic forcing that minimizes APT is one that allows transformation of the original stochastic model into a set of uncoupled, independent stochastic models. Loosely speaking, coupling enhances predictability. A rigorous upper bound on the predictability of linear stochastic models is derived, which clarifies the connection between predictability at short and long lead times, as well as the choice of norm for measuring error growth. Surprisingly, APT can itself be interpreted as the “total variance” of an alternative stochastic model, which means that generalized stability theory and dynamical systems theory can be used to understand APT. The APT can be decomposed into an uncorrelated set of components that maximize predictability time, analogous to the way principle component analysis decomposes variance. Part II of this paper develops a practical method for performing this decomposition and applies it to meteorological data.

Corresponding author address: Timothy DelSole, Center for Ocean–Land–Atmosphere Studies, 4041 Powder Mill Rd., Suite 302, Calverton, MD 20705. Email: delsole@cola.iges.org

Save
  • Cohen, J. E., 1988: Spectral inequalities for matrix exponentials. Linear Algebra Appl., 111 , 2528.

  • DelSole, T., 2001: Optimally persistent patterns in time-varying fields. J. Atmos. Sci., 58 , 13411356.

  • DelSole, T., 2004: The necessity of instantaneous optimals in stationary turbulence. J. Atmos. Sci., 61 , 10861091.

  • DelSole, T., and M. K. Tippett, 2007: Predictability: Recent insights from information theory. Rev. Geophys., 45 , RG4002. doi:10.1029/2006RG000202.

    • Search Google Scholar
    • Export Citation
  • DelSole, T., and M. K. Tippett, 2008: Predictable components and singular vectors. J. Atmos. Sci., 65 , 16661678.

  • DelSole, T., and M. K. Tippett, 2009: Average predictability time. Part II: Seamless diagnoses of predictability on multiple time scales. J. Atmos. Sci., 66 , 11881204.

    • Search Google Scholar
    • Export Citation
  • Farrell, B. F., and P. J. Ioannou, 1996: Generalized stability theory. Part I: Autonomous operators. J. Atmos. Sci., 53 , 20252040.

  • Fukunaga, K., 1990: Introduction to Statistical Pattern Recognition. 2nd ed. Academic Press, 591 pp.

  • Gelb, A., Ed.,. 1974: Applied Optimal Estimation. MIT Press, 382 pp.

  • Horn, R. A., and C. R. Johnson, 1999: Topics in Matrix Analysis. Cambridge University Press, 607 pp.

  • Ioannou, P. J., 1995: Nonnormality increases variance. J. Atmos. Sci., 52 , 11551158.

  • Julian, P. R., and R. M. Chervin, 1978: A study of the Southern Oscillation and Walker Circulation phenomenon. Mon. Wea. Rev., 106 , 14331451.

    • Search Google Scholar
    • Export Citation
  • Kleeman, R., 2002: Measuring dynamical prediction utility using relative entropy. J. Atmos. Sci., 59 , 20572072.

  • Kwon, W. H., Y. S. Moon, and S. C. Ahn, 1996: Bounds in algebraic Riccati and Lyapunov equations: A survey and some new results. Int. J. Control, 64 , 377389.

    • Search Google Scholar
    • Export Citation
  • Lancaster, P., and M. Tismenetsky, 1985: The Theory of Matrices: With Applications. Academic Press, 570 pp.

  • Leung, L-Y., and G. R. North, 1990: Information theory and climate prediction. J. Climate, 3 , 514.

  • Lorenz, E. N., 1969: The predictability of a flow which possesses many scales of motion. Tellus, 21 , 289307.

  • Majda, A., R. Kleeman, and D. Cai, 2002: A mathematical framework for quantifying predictability through relative entropy. Methods Appl. Anal., 9 , 425444.

    • Search Google Scholar
    • Export Citation
  • Priestley, M. B., 1981: Spectral Analysis and Time Series. Academic Press, 890 pp.

  • Schneider, T., and S. Griffies, 1999: A conceptual framework for predictability studies. J. Climate, 12 , 31333155.

  • Tippett, M. K., and D. Marchesin, 1999: Upper bounds for the solution of the discrete algebraic Lyapunov equation. Automatica, 35 , 14851489.

    • Search Google Scholar
    • Export Citation
  • Tippett, M. K., and P. Chang, 2003: Some theoretical considerations on predictability of linear stochastic dynamics. Tellus, 55 , 148157.

    • Search Google Scholar
    • Export Citation
  • Weiss, J. B., 2003: Coordinate invariance in stochastic dynamical systems. Tellus, 55A , 208218.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 693 216 16
PDF Downloads 576 171 9