Using State Space Differential Geometry for Nonlinear Blind Source Separation

Given a time series of multicomponent measurements of an evolving stimulus, nonlinear blind source separation (BSS) usually seeks to find a "source" time series, comprised of statistically independent combinations of the measured components. In this paper, we seek a source time series that has a phase-space density function equal to the product of density functions of individual components. In an earlier paper, it was shown that the phase space density function induces a Riemannian geometry on the system's state space, with the metric equal to the local velocity correlation matrix of the data. From this geometric perspective, the vanishing of the curvature tensor is a necessary condition for BSS. Therefore, if this data-derived quantity is non-vanishing, the observations are not separable. However, if the curvature tensor is zero, there is only one possible set of source variables (up to transformations that do not affect separability), and it is possible to compute these explicitly and determine if they do separate the phase space density function. A longer version of this paper describes a more general method that performs nonlinear multidimensional BSS or independent subspace separation.

[1]  David N. Levin.  Channel-Independent and Sensor-Independent Stimulus Representations , 2004, ArXiv.

[2]  Aapo Hyvärinen,et al.  A Fast Fixed-Point Algorithm for Independent Component Analysis of Complex Valued Signals , 2000, Int. J. Neural Syst..

[3]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .

[4]  Francis W. Sears,et al.  An Introduction to Thermodynamics, the Kinetic Theory of Gases, and Statistical Mechanics , 1953 .

[5]  Jean-François Cardoso,et al.  Multidimensional independent component analysis , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[6]  Alex Acero,et al.  Spoken Language Processing , 2001 .

[7]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[8]  Juha Karhunen,et al.  Advances in blind source separation (BSS) and independent component analysis (ICA) for nonlinear mixtures , 2004, Int. J. Neural Syst..

[9]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[10]  E. Oja,et al.  Independent Component Analysis , 2013 .

[11]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[12]  Shun-ichi Amari,et al.  Natural Gradient Works Efficiently in Learning , 1998, Neural Computation.

[13]  R. Wagoner,et al.  Gravitation and Cosmology: Principles and Applications of the General Theory of Relativity , 1973 .

[14]  Andrzej Cichocki,et al.  Information-theoretic approach to blind separation of sources in non-linear mixture , 1998, Signal Process..

[15]  Mark D. Plumbley,et al.  Proceedings of the 7th international conference on Independent component analysis and signal separation , 2007 .

[16]  Sebastien Lagrange,et al.  Analytical Solution of the Blind Source Separation Problem Using Derivatives , 2004, ICA.

[17]  Mark D. Plumbley,et al.  Riemannian Optimization Method on the Flag Manifold for Independent Subspace Analysis , 2006, ICA.