Consistent independent component analysis and prewhitening

We study the statistical merits of two techniques used in the literature of independent component analysis (ICA). First, we analyze the characteristic-function based ICA method (CHFICA) and study its statistical properties such as consistency, /spl radic/n-consistency, and robustness against small additive noise. Second, we study the validity of prewhitening: a preprocessing technique used by many ICA algorithms, as applied to the CHFICA method. In particular, we establish the surprising effectiveness of this technique even when some components have heavy tails and others do not. A fast new algorithm implementing the prewhitened CHFICA method is also provided.

[1]  H. Widom.  Asymptotic behavior of the eigenvalues of certain integral equations , 1963 .

[2]  J. Ord,et al.  Characterization Problems in Mathematical Statistics , 1975 .

[3]  P. Bickel,et al.  An Analysis of Transformations Revisited , 1981 .

[4]  Gene H. Golub,et al.  Matrix computations , 1983 .

[5]  P. Bickel.  Efficient and Adaptive Estimation for Semiparametric Models , 1993 .

[6]  E. Giné,et al.  Limit Theorems for $U$-Processes , 1993 .

[7]  J. Cardoso.  On the Performance of Orthogonal Source Separation Algorithms , 1994 .

[8]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[9]  K. Do,et al.  Efficient and Adaptive Estimation for Semiparametric Models. , 1994 .

[10]  R. Mathias.  A Bound for the Matrix Square Root with Application to Eigenvector Perturbation , 1997, SIAM J. Matrix Anal. Appl..

[11]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[12]  Alan Edelman,et al.  The Geometry of Algorithms with Orthogonality Constraints , 1998, SIAM J. Matrix Anal. Appl..

[13]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[14]  T. Ens,et al.  Blind signal separation : statistical principles , 1998 .

[15]  Stephen J. Wright.  Modified Cholesky Factorizations in Interior-Point Algorithms for Linear Programming , 1999, SIAM J. Optim..

[16]  A. J. Bell,et al.  A Unifying Information-Theoretic Framework for Independent Component Analysis , 2000 .

[17]  Terrence J. Sejnowski,et al.  Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources , 1999, Neural Computation.

[18]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[19]  Jean-Franois Cardoso.  High-Order Contrasts for Independent Component Analysis , 1999, Neural Computation.

[20]  M. Girolami,et al.  Advances in Independent Component Analysis , 2000, Perspectives in Neural Computing.

[21]  Arie Yeredor,et al.  Super-efficiency in blind signal separation of symmetric heavy-tailed sources , 2001, Proceedings of the 11th IEEE Signal Processing Workshop on Statistical Signal Processing (Cat. No.01TH8563).

[22]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[23]  T. Sejnowski,et al.  Dynamic Brain Sources of Visual Evoked Responses , 2002, Science.

[24]  Robert Tibshirani,et al.  Independent Components Analysis through Product Density Estimation , 2002, NIPS.

[25]  Shun-ichi Amari.  Independent Component Analysis (ICA) and Method of Estimating Functions , 2002 .

[26]  Michael I. Jordan,et al.  Kernel independent component analysis , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[27]  William S. Rayens,et al.  Independent Component Analysis: Principles and Practice , 2003, Technometrics.

[28]  Visa Koivunen,et al.  Characteristic-function-based independent component analysis , 2003, Signal Process..

[29]  Visa Koivunen,et al.  Identifiability, separability, and uniqueness of linear ICA models , 2004, IEEE Signal Processing Letters.

[30]  Vwani P. Roychowdhury,et al.  Independent component analysis based on nonparametric density estimation , 2004, IEEE Transactions on Neural Networks.

[31]  P. Bickel,et al.  Efficient independent component analysis , 2006, 0705.4230.

[32]  P. Bickel,et al.  EFFICIENT INDEPENDENT COMPONENT ANALYSIS ( II ) , 2022 .