Rotation of EOFs by the Independent Component Analysis: Toward a Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

Filipe Aires NASA Goddard Institute for Space Studies, Department of Applied Physics, Columbia University, New York, New York

Search for other papers by Filipe Aires in
Current site
Google Scholar
PubMed
Close
,
William B. Rossow NASA Goddard Institute for Space Studies, New York, New York

Search for other papers by William B. Rossow in
Current site
Google Scholar
PubMed
Close
, and
Alain Chédin CNRS Laboratoire de Météorologie Dynamique, Palaiseau, France

Search for other papers by Alain Chédin in
Current site
Google Scholar
PubMed
Close
Restricted access

Abstract

The Independent Component Analysis (ICA) is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components—a stronger constraint that uses higher-order statistics—instead of the classical decorrelation (in the sense of “no correlation”), which is a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e., exploratory approach). The authors demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis (PCA), the ICA performs a rotation of the classical PCA (or EOF) solution. This experiment is conducted using a synthetic dataset, where the correct answer is known, to more clearly illustrate and understand the behavior of the more familiar PCA and less familiar ICA. This rotation uses no localization criterion like other rotation techniques; only the generalization of decorrelation into full statistical independence is used. This rotation of the PCA solution seems to be able to avoid the tendency of PCA to mix several components, even when the signal is just their linear sum.

Corresponding author address: Dr. Filipe Aires, NASA Goddard Institute for Space Studies, Columbia University, 2880 Broadway and 112th Street, New York, NY 10025. Email: faires@giss.nasa.gov

Abstract

The Independent Component Analysis (ICA) is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components—a stronger constraint that uses higher-order statistics—instead of the classical decorrelation (in the sense of “no correlation”), which is a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e., exploratory approach). The authors demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis (PCA), the ICA performs a rotation of the classical PCA (or EOF) solution. This experiment is conducted using a synthetic dataset, where the correct answer is known, to more clearly illustrate and understand the behavior of the more familiar PCA and less familiar ICA. This rotation uses no localization criterion like other rotation techniques; only the generalization of decorrelation into full statistical independence is used. This rotation of the PCA solution seems to be able to avoid the tendency of PCA to mix several components, even when the signal is just their linear sum.

Corresponding author address: Dr. Filipe Aires, NASA Goddard Institute for Space Studies, Columbia University, 2880 Broadway and 112th Street, New York, NY 10025. Email: faires@giss.nasa.gov

Save
  • Aires, F., A. Chédin, and J-P. Nadal, 2000: Independent component analysis of multivariate times series: Application to the tropical SST variability. J. Geophys. Res, 105 , (D13),. 1743717455.

    • Search Google Scholar
    • Export Citation
  • Atick, J. J., 1992: Could information theory provide an ecological theory of sensory processing? Network Comput. Neural Syst, 3 , 213251.

    • Search Google Scholar
    • Export Citation
  • Bell, A. J., and T. J. Sejnowski, 1995: An information-maximization approach to blind separation and blind deconvolution. Neural Comput, 7 , 10041034.

    • Search Google Scholar
    • Export Citation
  • Broomhead, D., and G. King, 1986: Extracting qualitative dynamics from experimental data. Physica D, 20 , 217236.

  • Buell, C. E., 1975: The topography of empirical orthogonal functions. Preprints, Fourth Conf. on Probability and Statistics in Atmospheric Science, Tallahassee, FL, Amer. Meteor. Soc., 188–193.

    • Search Google Scholar
    • Export Citation
  • Burel, G., 1992: Blind source separation of sources: A nonlinear algorithm. Neural Networks, 5 , 937947.

  • Burgers, G., and D. B. Stephenson, 1999: The “Normality” of El Ninõ. Geophys. Res. Lett, 26 , 10271030.

  • Cardoso, J. F., C. Jutten, and P. Loubaton, Eds.,. . 1999: Preprints, First Int. Workshop on Independent Component Analysis and Signal Separation,. Aussois, France, ICA, 506 pp.

    • Search Google Scholar
    • Export Citation
  • Chung, C., and S. Nugam, 1999: Weighting of geophysical data in Principal Component Analysis. J. Geophys. Res, 104 , 1692516928.

  • Comon, P., 1994: Independent Component Analysis: A new concept? Signal Process, 36 , 287314.

  • Dacunha-Castelle, D., and M. Duflo, 1982: Probabilités et Statistiques, Tome 1: Problèmes à Temps Fixe. Masson, France.

  • Duflo, M., 1996: Algorithmes Stochastiques: Mathématiques et Applications. Springer Verlag, 319 pp.

  • Horel, J., 1981: A rotated principal component analysis of the interannual variability of the northern hemisphere 500-mb height field. Mon. Wea. Rev, 109 , 20802092.

    • Search Google Scholar
    • Export Citation
  • Hyvärinen, A., and E. Oja, 2000: Independent component analysis: Algorithms and applications. Neural Networks, 13 , 411430.

  • Jolliffe, I. T., 1986: Principal Component Analysis. Springer Verlag, 271 pp.

  • Jutten, C., and J. Herault, 1991: Blind separation of sources, Part I: An adaptive algorithm based on neuromimetic architecture. Signal Process, 24 , 110.

    • Search Google Scholar
    • Export Citation
  • Karl, T. R., A. J. Koscielny, and H. F. Diaz, 1982: Potential errors in the application of principal component (eigenvector) analysis to geophysical data. J. Appl. Meteor, 21 , 11831186.

    • Search Google Scholar
    • Export Citation
  • Kim, K-Y., and Q. Wu, 1999: A comparison study of EOF techniques: Analysis of nonstationary data with periodic statistics. J. Climate, 12 , 185199.

    • Search Google Scholar
    • Export Citation
  • Korres, G., N. Pinardi, and A. Lascaratos, 2000: The ocean response to low-frequency interannual atmospheric variability in the Mediterranean Sea. Part II: Empirical orthogonal functions analysis. J. Climate, 13 , 732745.

    • Search Google Scholar
    • Export Citation
  • Krishnamurthy, V., and B. N. Goswami, 2000: Indian Monsoon–ENSO relationship on interdecadal timescale. J. Climate, 13 , 579595.

  • Lin, B., and W. B. Rossow, 1996: Seasonal variation of liquid and ice water path in nonprecipitating clouds over oceans. J. Climate, 9 , 28902902.

    • Search Google Scholar
    • Export Citation
  • Lorenz, E., 1951: Seasonal and irregular variations of the northern hemisphere sea-level pressure profile. J. Meteor, 8 , 5259.

  • Monahan, A. H., 2000: Nonlinear principal component analysis by neural networks: Theory and application to the Lorenz System. J. Climate, 13 , 821835.

    • Search Google Scholar
    • Export Citation
  • Nadal, J-P., and N. Parga, 1994: Nonlinear neurons in the low-noise limit: A factorial code maximizes information transfer. Comput. Neural Syst, 5 , 565581.

    • Search Google Scholar
    • Export Citation
  • Nadal, J-P., and N. Parga, 1997: Redundancy reduction and independent component analysis: Conditions on cumulants and adaptive approaches. Neural Comp, 9 , 14211456.

    • Search Google Scholar
    • Export Citation
  • Nadal, J-P., E. Korutcheva, and F. Aires, 2000: Blind source separation in the presence of weak sources. Neural Networks, 13 , 589596.

    • Search Google Scholar
    • Export Citation
  • Palmer, T. N., 1999: A nonlinear dynamical perspective on climate prediction. J. Climate, 12 , 575591.

  • Press, W. H. P., S. A. Teukolsky, W. T. Vetterling, and B. P. Flannery, 1992: Numerical Recipes in Fortran. Cambridge University Press, 973 pp.

    • Search Google Scholar
    • Export Citation
  • Richman, M., 1981: Obliquely rotated principal components: An improved meteorological map typing technique? J. Appl. Meteor, 20 , 11451159.

    • Search Google Scholar
    • Export Citation
  • Richman, M., 1986: Rotation of principal components. J. Climatol, 6 , 293335.

  • Rossow, W. B., and R. A. Schiffer, 1991: ISCCP cloud data products. Bull. Amer. Meteor. Soc, 72 , 220.

  • Salby, M., and P. Callaghan, 2000: Connection between the solar cycle and the QBO: The missing link. J. Climate, 13 , 328338.

  • Vautard, R., P. Yiou, and M. Ghil, 1992: Singular-spectrum analysis: A toolkit for short, noisy chaotic signals. Physica D, 58 , 95126.

    • Search Google Scholar
    • Export Citation
  • Vautard, R., C. Pires, and G. Plaut, 1996: Long-range atmospheric predictability using space–time principal components. Mon. Wea. Rev, 124 , 288307.

    • Search Google Scholar
    • Export Citation
  • von Storch, H., and C. Frankignoul, 1998: Empirical modal decomposition in coastal oceanography. K. H. Brink and A. R. Robinson, Eds., The Sea, Vol. 16, Wiley and Sons, 419–455.

    • Search Google Scholar
    • Export Citation
  • Xue, Y., A. Leetmaa, and M. Ji, 2000: ENSO Prediction with Markov Models: The impact of sea level. J. Climate, 13 , 849871.

All Time Past Year Past 30 Days
Abstract Views 0 0 0
Full Text Views 535 149 18
PDF Downloads 245 58 3