A High Order Cumulants Based Multivariate Nonlinear Blind Source Separation Method

This article addresses the problem of identifying multiple linear and nonlinear patterns from multivariate noisy data represented by an additive model. Following the proposed nonlinear model, the blind source separation (BSS) criterion, as a function of high-order cumulants, is shown to produce a block-structured joint cumulant matrix by an orthogonal rotation. An intuitive interpretation of this criterion is to rotate the elements of whitened principal component analysis (PCA) scores such that they are as independent as possible. The resulting optimal joint cumulant matrix contains diagonal “blocks” that correspond to the linear and nonlinear patterns caused by independent sources, from which linear patterns are recognized as in linear BSS. The nonlinear patterns are identified by extracting their lower-dimensional manifolds via the principal curves method and then transforming back to the original data space. As illustrated in the experimental study, the estimated linear and nonlinear patterns will provide more accurate diagnosing of the root causes that contribute to the observed variability in multivariate manufacturing.

[1]  Juha Karhunen,et al.  An Unsupervised Ensemble Learning Method for Nonlinear Dynamic State-Space Models , 2002, Neural Computation.

[2]  Andrzej Cichocki,et al.  Information-theoretic approach to blind separation of sources in non-linear mixture , 1998, Signal Process..

[3]  M. Wax,et al.  A least-squares approach to joint diagonalization , 1997, IEEE Signal Processing Letters.

[4]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[5]  Christian Jutten,et al.  Source separation in post-nonlinear mixtures , 1999, IEEE Trans. Signal Process..

[6]  Gilles Burel,et al.  Blind separation of sources: A nonlinear neural algorithm , 1992, Neural Networks.

[7]  E. Oja,et al.  Nonlinear Blind Source Separation by Variational Bayesian Learning , 2003, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[8]  Alper T. Erdogan,et al.  A blind separation approach for magnitude bounded sources , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[9]  Juha Karhunen,et al.  A Maximum Likelihood Approach to Nonlinear Blind Source Separation , 1997, ICANN.

[10]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[11]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[12]  T. Hastie,et al.  Principal Curves , 2007 .

[13]  Gustavo Deco,et al.  Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures , 1995, Neural Networks.

[14]  Joydeep Ghosh,et al.  Principal curves for nonlinear feature extraction and classification , 1998, Electronic Imaging.

[15]  Anisse Taleb,et al.  A generic framework for blind source separation in structured nonlinear models , 2002, IEEE Trans. Signal Process..

[16]  Aapo Hyvärinen,et al.  Nonlinear independent component analysis: Existence and uniqueness results , 1999, Neural Networks.

[17]  E. Oja,et al.  Independent Component Analysis , 2013 .

[18]  Daniel W. Apley,et al.  Identifying Spatial Variation Patterns in Multivariate Manufacturing Processes , 2003, Technometrics.

[19]  Te-Won Lee,et al.  Blind source separation of nonlinear mixing models , 1997, Neural Networks for Signal Processing VII. Proceedings of the 1997 IEEE Signal Processing Society Workshop.

[20]  J. Karhunen,et al.  Advances in Nonlinear Blind Source Separation , 2003 .