Rotation of Eofs by the Independent Component Analysis: Towards a Solution of the Mixing Problem in the Decomposition of Geophysical Time Series

The Independent Component Analysis (ICA) is a recently developed technique for component extraction. This new method requires the statistical independence of the extracted components—a stronger constraint that uses higher-order statistics—instead of the classical decorrelation (in the sense of ‘‘no correlation’’), which is a weaker constraint that uses only second-order statistics. This technique has been used recently for the analysis of geophysical time series with the goal of investigating the causes of variability in observed data (i.e., exploratory approach). The authors demonstrate with a data simulation experiment that, if initialized with a Principal Component Analysis (PCA), the ICA performs a rotation of the classical PCA (or EOF) solution. This experiment is conducted using a synthetic dataset, where the correct answer is known, to more clearly illustrate and understand the behavior of the more familiar PCA and less familiar ICA. This rotation uses no localization criterion like other rotation techniques; only the generalization of decorrelation into full statistical independence is used. This rotation of the PCA solution seems to be able to avoid the tendency of PCA to mix several components, even when the signal is just their linear sum.

[1]  Michael B. Richman,et al.  Obliquely Rotated Principal Components: An Improved Meteorological Map Typing Technique? , 1981 .

[2]  G. P. King,et al.  Extracting qualitative dynamics from experimental data , 1986 .

[3]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[4]  Filipe Aires,et al.  Blind source separation in the presence of weak sources , 2000, Neural Networks.

[5]  J. Nadal,et al.  Nonlinear neurons in the low-noise limit: a factorial code maximizes information transfer Network 5 , 1994 .

[6]  kwang-yul kim,et al.  A Comparison Study of EOF Techniques: Analysis of Nonstationary Data with Periodic Statistics , 1999 .

[7]  Joseph J Atick,et al.  Could information theory provide an ecological theory of sensory processing? , 2011, Network.

[8]  Néstor Parga,et al.  Redundancy Reduction and Independent Component Analysis: Conditions on Cumulants and Adaptive Approaches , 1997, Neural Computation.

[9]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[10]  C. Chung,et al.  Weighting of geophysical data in Principal Component Analysis , 1999 .

[11]  William B. Rossow,et al.  Comparison of ISCCP and Other Cloud Amounts , 1993 .

[12]  John D. Horel,et al.  A Rotated Principal Component Analysis of the Interannual Variability of the Northern Hemisphere 500 mb Height Field , 1981 .

[13]  I. Jolliffe Principal Component Analysis , 2002 .

[14]  kwang-yul kim,et al.  EOF-Based Linear Prediction Algorithm: Examples , 1999 .

[15]  R. Vautard,et al.  Singular-spectrum analysis: a toolkit for short, noisy chaotic signals , 1992 .

[16]  Adam H. Monahan,et al.  Nonlinear Principal Component Analysis by Neural Networks: Theory and Application to the Lorenz System , 2000 .

[17]  Connection between the Solar Cycle and the QBO: The Missing Link , 2000 .

[18]  Filipe Aires,et al.  Independent component analysis of multivariate time series: Application to the tropical SST variability , 2000 .

[19]  G. Burroughs,et al.  THE ROTATION OF PRINCIPAL COMPONENTS , 1961 .

[20]  Tim Palmer,et al.  A Nonlinear Dynamical Perspective on Climate Prediction , 1999 .

[21]  Henry F. Diaz,et al.  Potential Errors in the Application of Principal Component (Eigenvector) Analysis to Geophysical Data , 1982 .

[22]  Robert Vautard,et al.  Long-Range Atmospheric Predictability Using Space–Time Principal Components , 1996 .

[23]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[24]  G. Korres,et al.  The Ocean Response to Low-Frequency Interannual Atmospheric Variability in the Mediterranean Sea. Part II: Empirical Orthogonal Functions Analysis , 2000 .

[25]  B. Goswami,et al.  Indian Monsoon–ENSO Relationship on Interdecadal Timescale , 2000 .

[26]  W. Rossow,et al.  ISCCP Cloud Data Products , 1991 .

[27]  E. Lorenz SEASONAL AND IRREGULAR VARIATIONS OF THE NORTHERN HEMISPHERE SEA-LEVEL PRESSURE PROFILE , 1951 .

[28]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[29]  Bing Lin,et al.  Seasonal Variation of Liquid and Ice Water Path in Nonprecipitating Clouds over Oceans , 1996 .

[30]  Ming Ji,et al.  ENSO Prediction with Markov Models: The Impact of Sea Level , 2000 .

[31]  William H. Press,et al.  Numerical Recipes: FORTRAN , 1988 .

[32]  Gilles Burel,et al.  Blind separation of sources: A nonlinear neural algorithm , 1992, Neural Networks.

[33]  David B. Stephenson,et al.  The “normality” of El Niño , 1999 .