Nonstationarity in Multifactor Models of Discrete Jump Processes, Memory, and Application to Cloud Modeling

Illia Horenko Universita della Svizzera Italiana, Lugano, Switzerland

Search for other papers by Illia Horenko in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

Because of the mathematical and numerical limitations, standard statistical methods known from the literature are not applicable to inferring jump processes under exogenous influence. Such processes can be considered, for example, in the atmosphere (transitions between different cloud types) and in the ocean (phase transitions between water and ice). Reasons for these intrinsic limitations of standard methods are investigated and a method for the inference of discrete microscopic jump models based on macroscopic ensemble observations is presented. It significantly extends the recently developed methods of nonstationary Markov model parameterization (which are constrained to a single exogenous factor and to direct individual observations of the jump process realizations). The main advantage of the new method is the possibility of inference from indirect ensemble observations with multiple exogenous factors. Moreover, this method allows for a new possibility to test whether the available time series is best described via stationary or nonstationary and Markovian (with memory) or independent (without memory) processes. It also allows estimation of the relative significance of the exogenous factors and their impact on the jump probabilities. The new framework provides a unified toolkit for data analysis of jump processes with the same level of detail now possible for standard continuous state space tools. The resulting numerical algorithm is applied to analysis of the total relative cloud cover data in the midlatitudes and in the tropics under the influence of some meteorologically relevant local and global exogenous factors.

Corresponding author address: Illia Horenko, Faculty of Informatics, Institute of Computational Science, Universita della Svizzera Italiana, Via Giuseppe Buffi 13, 6900-Lugano, Switzerland. E-mail: horenkoi@usi.ch

Abstract

Because of the mathematical and numerical limitations, standard statistical methods known from the literature are not applicable to inferring jump processes under exogenous influence. Such processes can be considered, for example, in the atmosphere (transitions between different cloud types) and in the ocean (phase transitions between water and ice). Reasons for these intrinsic limitations of standard methods are investigated and a method for the inference of discrete microscopic jump models based on macroscopic ensemble observations is presented. It significantly extends the recently developed methods of nonstationary Markov model parameterization (which are constrained to a single exogenous factor and to direct individual observations of the jump process realizations). The main advantage of the new method is the possibility of inference from indirect ensemble observations with multiple exogenous factors. Moreover, this method allows for a new possibility to test whether the available time series is best described via stationary or nonstationary and Markovian (with memory) or independent (without memory) processes. It also allows estimation of the relative significance of the exogenous factors and their impact on the jump probabilities. The new framework provides a unified toolkit for data analysis of jump processes with the same level of detail now possible for standard continuous state space tools. The resulting numerical algorithm is applied to analysis of the total relative cloud cover data in the midlatitudes and in the tropics under the influence of some meteorologically relevant local and global exogenous factors.

Corresponding author address: Illia Horenko, Faculty of Informatics, Institute of Computational Science, Universita della Svizzera Italiana, Via Giuseppe Buffi 13, 6900-Lugano, Switzerland. E-mail: horenkoi@usi.ch
Save
  • Akaike, H., 1974: A new look at the statistical model identification. IEEE Trans. Autom. Control, 19, 716–723.

  • Barber, C., D. Dobkin, and H. Huhdanpaa, 1996: The Quickhull algorithm for convex hulls. ACM Trans. Math. Softw., 22, 469–483.

  • Bezdek, J., 1981: Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press, 272 pp.

  • Box, G., and G. Jenkins, 1976: Time Series Analysis, Forecasting, and Control. Holden–Day, 592 pp.

  • Brockwell, P., and R. Davis, 2002: Introduction to Time Series and Forecasting. Springer, Berlin, 456 pp.

  • Christiansen, B., 2007: Atmospheric circulation regimes: Can cluster analysis provide the number? J. Climate, 20, 2229–2250.

  • Crommelin, D., and E. Vanden-Eijnden, 2006: Fitting time series by continuous-time Markov chains: A quadratic programming approach. J. Comput. Phys., 217, 782–805.

    • Search Google Scholar
    • Export Citation
  • Crommelin, D., and E. Vanden-Eijnden, 2009: Data-based inference of generators for Markov jump processes using convex optimization. SIAM Multiscale Model Simul., 7, 1751–1778.

    • Search Google Scholar
    • Export Citation
  • Deuflhard, P., 2004: Newton Methods for Nonlinear Problems: Affine Invariance and Adaptive Algorithms. Computational Mathematics Series, Vol. 35, Springer, 430 pp.

    • Search Google Scholar
    • Export Citation
  • Feller, W., 1974: An Introduction to Probability Theory and Its Applications. Vol. II. Wiley, 669 pp.

  • Franzke, C., I. Horenko, A. Majda, and R. Klein, 2009: Systematic metastable atmospheric regime identification in an AGCM. J. Atmos. Sci., 66, 1997–2012.

    • Search Google Scholar
    • Export Citation
  • Gardiner, H., 2004: Handbook of Stochastical Methods. Springer, 442 pp.

  • Höppner, F., F. Klawonn, R. Kruse, and T. Runkler, 1999: Fuzzy Cluster Analysis. John Wiley and Sons, 300 pp.

  • Horenko, I., 2009: On robust estimation of low-frequency variability trends in discrete Markovian sequences of atmospheric circulation patterns. J. Atmos. Sci., 66, 2059–2072.

    • Search Google Scholar
    • Export Citation
  • Horenko, I., 2010a: Finite element approach to clustering of multidimensional time series. SIAM J. Sci. Comput., 32, 62–83.

  • Horenko, I., 2010b: On identification of nonstationary factor models and its application to atmospheric data analysis. J. Atmos. Sci., 67, 1559–1574.

    • Search Google Scholar
    • Export Citation
  • Horenko, I., S. Dolaptchiev, A. Eliseev, I. Mokhov, and R. Klein, 2008a: Metastable decomposition of high-dimensional meteorological data with gaps. J. Atmos. Sci., 65, 3479–3496.

    • Search Google Scholar
    • Export Citation
  • Horenko, I., R. Klein, S. Dolaptchiev, and C. Schuette, 2008b: Automated generation of reduced stochastic weather models. I: Simultaneous dimension and model reduction for time series analysis. SIAM Multiscale Model. Simul., 6, 1125–1145.

    • Search Google Scholar
    • Export Citation
  • Khouider, B., A. Majda, and M. Katsoulakis, 2003: Coarse-grained stochastic models for tropical convection and climate. Proc. Natl. Acad. Sci. USA, 100, 11 941–11 946.

    • Search Google Scholar
    • Export Citation
  • Khouider, B., J. Biello, and A. Majda, 2010: A stochastic multicloud model for tropical convection. Commun. Math. Sci., 8, 187–216.

    • Search Google Scholar
    • Export Citation
  • Majda, A., C. Franzke, A. Fischer, and D. Crommelin, 2006: Distinct metastable atmospheric regimes despite nearly Gaussian statistics: A paradigm model. Proc. Natl. Acad. Sci. USA, 103, 8309–8314.

    • Search Google Scholar
    • Export Citation
  • Markov, A., 1912: Wahrscheinlichkeitsrechnung. B. G. Teubner, 334 pp.

  • Nocedal, J., and S. Wright, 2000: Numerical Optimization. Springer, 656 pp.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 311 70 6
PDF Downloads 82 32 2