An extension of slow feature analysis for nonlinear blind source separation

We present and test an extension of slow feature analysis as a novel approach to nonlinear blind source separation. The algorithm relies on temporal correlations and iteratively reconstructs a set of statistically independent sources from arbitrary nonlinear instantaneous mixtures. Simulations show that it is able to invert a complicated nonlinear mixture of two audio signals with a high reliability. The algorithm is based on a mathematical analysis of slow feature analysis for the case of input data that are generated from statistically independent sources.

[1]  Niko Wilbert,et al.  Modular Toolkit for Data Processing (MDP): A Python Data Processing Framework , 2008, Frontiers Neuroinformatics.

[2]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[3]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[4]  Laurenz Wiskott,et al.  What Is the Relation Between Slow Feature Analysis and Independent Component Analysis? , 2006, Neural Computation.

[5]  Laurenz Wiskott,et al.  Slowness and Sparseness Lead to Place, Head-Direction, and Spatial-View Cells , 2007, PLoS Comput. Biol..

[6]  E. Oja,et al.  Independent Component Analysis , 2013 .

[7]  Laurenz Wiskott,et al.  Slow Feature Analysis: A Theoretical Analysis of Optimal Free Responses , 2003, Neural Computation.

[8]  Ondřej Klobušník,et al.  ArXiv.org e-print archive , 2004 .

[9]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .

[10]  Luís B. Almeida,et al.  Linear and nonlinear ICA based on mutual information - the MISEP method , 2004, Signal Process..

[11]  Laurenz Wiskott.  Estimating Driving Forces of Nonstationary Time Series with Slow Feature Analysis Laurenz Wiskott Institute for Theoretical Biology , 2003 .

[12]  Motoaki Kawanabe,et al.  Kernel-Based Nonlinear Blind Source Separation , 2003, Neural Computation.

[13]  Schuster,et al.  Separation of a mixture of independent signals using time delayed correlations. , 1994, Physical review letters.

[14]  Luís B. Almeida,et al.  Separating a Real-Life Nonlinear Image Mixture , 2005, J. Mach. Learn. Res..

[15]  Laurenz Wiskott,et al.  Learning invariance manifolds , 1998, Neurocomputing.

[16]  Klaus Obermayer,et al.  Generating feature spaces for linear algorithms with regularized sparse kernel slow feature analysis , 2012, Machine Learning.

[17]  Lai-Wan Chan,et al.  Minimal Nonlinear Distortion Principle for Nonlinear Independent Component Analysis , 2008 .

[18]  Laurenz Wiskott,et al.  CuBICA: independent component analysis by simultaneous third- and fourth-order cumulant diagonalization , 2004, IEEE Transactions on Signal Processing.

[19]  R. Courant,et al.  Methods of Mathematical Physics , 1962 .

[20]  Seungjin Choi.  Differential learning algorithms for decorrelation and independent component analysis , 2006, Neural Networks.

[21]  Henning Sprekeler,et al.  On the Relation of Slow Feature Analysis and Laplacian Eigenmaps , 2011, Neural Computation.

[22]  Laurenz Wiskott,et al.  Slow feature analysis yields a rich repertoire of complex cell properties. , 2005, Journal of vision.

[23]  Luís B. Almeida,et al.  MISEP -- Linear and Nonlinear ICA Based on Mutual Information , 2003, J. Mach. Learn. Res..

[24]  Laurenz Wiskott,et al.  Independent Slow Feature Analysis and Nonlinear Blind Source Separation , 2004, Neural Computation.

[25]  Amit Singer,et al.  Detecting intrinsic slow variables in stochastic dynamical systems by anisotropic diffusion maps , 2009, Proceedings of the National Academy of Sciences.

[26]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[27]  Andreas Ziehe,et al.  TDSEP { an e(cid:14)cient algorithm for blind separation using time structure , 1998 .

[28]  Laurenz Wiskott,et al.  Multivariate Slow Feature Analysis and Decorrelation Filtering for Blind Source Separation , 2013, IEEE Transactions on Image Processing.

[29]  R. Coifman,et al.  Non-linear independent component analysis with diffusion maps , 2008 .

[30]  Terrence J. Sejnowski,et al.  Slow Feature Analysis: Unsupervised Learning of Invariances , 2002, Neural Computation.

[31]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.