Projection-Pursuit-Based Method for Blind Separation of Nonnegative Sources

This paper presents a projection pursuit (PP) based method for blind separation of nonnegative sources. First, the available observation matrix is mapped to construct a new mixing model, in which the inaccessible source matrix is normalized to be column-sum-to-1. Then, the PP method is proposed to solve this new model, where the mixing matrix is estimated column by column through tracing the projections to the mapped observations in specified directions, which leads to the recovery of the sources. The proposed method is much faster than Chan's method, which has similar assumptions to ours, due to the usage of optimal projection. It is also more advantageous in separating cross-correlated sources than the independence- and uncorrelation-based methods, as it does not employ any statistical information of the sources. Furthermore, the new method does not require the mixing matrix to be nonnegative. Simulation results demonstrate the superior performance of our method.

[1]  Shengli Xie,et al.  Online Blind Source Separation Using Incremental Nonnegative Matrix Factorization With Volume Constraint , 2011, IEEE Transactions on Neural Networks.

[2]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[3]  J. Boardman,et al.  Mapping target signatures via partial unmixing of AVIRIS data: in Summaries , 1995 .

[4]  S. Amari,et al.  Nonnegative Matrix and Tensor Factorization [Lecture Notes] , 2008, IEEE Signal Processing Magazine.

[5]  Antonio J. Plaza,et al.  Sparse Unmixing of Hyperspectral Data , 2011, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Sanjay Mehrotra,et al.  On the Implementation of a Primal-Dual Interior Point Method , 1992, SIAM J. Optim..

[7]  V. G. Reju,et al.  An algorithm for mixing matrix estimation in instantaneous blind source separation , 2009, Signal Process..

[8]  Chong-Yung Chi,et al.  A Convex Analysis Framework for Blind Separation of Non-Negative Sources , 2008, IEEE Transactions on Signal Processing.

[9]  Dezhong Peng,et al.  Underdetermined blind separation of non-sparse sources using spatial time-frequency distributions , 2010, Digit. Signal Process..

[10]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[11]  John W. Tukey,et al.  A Projection Pursuit Algorithm for Exploratory Data Analysis , 1974, IEEE Transactions on Computers.

[12]  Valero Laparra,et al.  Iterative Gaussianization: From ICA to Random Rotations , 2011, IEEE Transactions on Neural Networks.

[13]  Yingbo Hua,et al.  Group decorrelation enhanced subspace method for identifying FIR MIMO channels driven by unknown uncorrelated colored sources , 2005, IEEE Transactions on Signal Processing.

[14]  Zhaoshui He,et al.  Minimum-Volume-Constrained Nonnegative Matrix Factorization: Enhanced Ability of Learning Parts , 2011, IEEE Transactions on Neural Networks.

[15]  A. Laptev.  Analysis and applications , 2010 .

[16]  Mark D. Plumbley.  Conditions for nonnegative independent component analysis , 2002, IEEE Signal Processing Letters.

[17]  Ivica Kopriva,et al.  Wavelet packets approach to blind separation of statistically dependent sources , 2008, Neurocomputing.

[18]  Xiaojun Chen,et al.  Smoothing Neural Network for Constrained Non-Lipschitz Optimization With Applications , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Andrzej Cichocki,et al.  Nonnegative Matrix and Tensor Factorization T , 2007 .

[20]  Tülay Adali,et al.  Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Signal Processing.

[21]  Alper T. Erdogan,et al.  A simple geometric blind source separation method for bounded magnitude sources , 2006, IEEE Transactions on Signal Processing.

[22]  Van Khanh Nguyen,et al.  Blind Separation of Mutually Correlated Sources Using Precoders , 2010, IEEE Transactions on Neural Networks.

[23]  Fa Yu Wang,et al.  Blind Separation of Positive Dependent Sources by Non-Negative Least-Correlated Component Analysis , 2006, 2006 16th IEEE Signal Processing Society Workshop on Machine Learning for Signal Processing.

[24]  Clemens Brunner,et al.  Nonstationary Brain Source Separation for Multiclass Motor Imagery , 2010, IEEE Transactions on Biomedical Engineering.

[25]  Pierre Comon,et al.  Robust Independent Component Analysis by Iterative Maximization of the Kurtosis Contrast With Algebraic Optimal Step Size , 2010, IEEE Transactions on Neural Networks.

[26]  Yuanqing Li,et al.  Analysis of Sparse Representation and Blind Source Separation , 2004, Neural Computation.

[27]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[28]  Stéphane Azou,et al.  On the Blind Estimation of Chip Time of Time-Hopping Signals Through Minimization of a Multimodal Cost Function , 2011, IEEE Transactions on Signal Processing.

[29]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[30]  Antonio J. Plaza,et al.  A fast iterative algorithm for implementation of pixel purity index , 2006, IEEE Geoscience and Remote Sensing Letters.

[31]  Tülay Adali,et al.  Complex Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Circuits and Systems I: Regular Papers.

[32]  Zbynek Koldovský,et al.  Optimal pairing of signal components separated by blind techniques , 2004, IEEE Signal Processing Letters.

[33]  Tsung-Han Chan,et al.  Convex analysis for separation of functional patterns in DCE-MRI: A longitudinal study to antiangiogenic therapy , 2008, 2008 IEEE Workshop on Machine Learning for Signal Processing.

[34]  Kannan Ramchandran,et al.  Distributed compression in a dense microsensor network , 2002, IEEE Signal Process. Mag..

[35]  Erkki Oja,et al.  Blind Separation of Positive Sources by Globally Convergent Gradient Search , 2004, Neural Computation.

[36]  Fabian J. Theis,et al.  Sparse component analysis and blind source separation of underdetermined mixtures , 2005, IEEE Transactions on Neural Networks.

[37]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[38]  Daniel Pérez Palomar,et al.  Quaternion ICA From Second-Order Statistics , 2011, IEEE Transactions on Signal Processing.

[39]  Robin Sibson,et al.  What is projection pursuit , 1987 .

[40]  Roy E. Marsten,et al.  Feature Article - Interior Point Methods for Linear Programming: Computational State of the Art , 1994, INFORMS J. Comput..

[41]  Chong-Yung Chi,et al.  Nonnegative Least-Correlated Component Analysis for Separation of Dependent Sources by Volume Maximization , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[43]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[44]  Zhaoshui He,et al.  Symmetric Nonnegative Matrix Factorization: Algorithms and Applications to Probabilistic Clustering , 2011, IEEE Transactions on Neural Networks.

[45]  Erkki Oja,et al.  A "nonnegative PCA" algorithm for independent component analysis , 2004, IEEE Transactions on Neural Networks.

[46]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[47]  Shengli Xie,et al.  Blind Spectral Unmixing Based on Sparse Nonnegative Matrix Factorization , 2011, IEEE Transactions on Image Processing.

[48]  Karim Abed-Meraim,et al.  Blind source-separation using second-order cyclostationary statistics , 2001, IEEE Trans. Signal Process..

[49]  Shengli Xie,et al.  Blind Source Separation by Fully Nonnegative Constrained Iterative Volume Maximization , 2010, IEEE Signal Processing Letters.

[50]  Yong Xiang,et al.  Nonnegative Blind Source Separation by Sparse Component Analysis Based on Determinant Measure , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[51]  Yong Xiang,et al.  Time-Frequency Approach to Underdetermined Blind Source Separation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[52]  Chein-I Chang,et al.  Automatic spectral target recognition in hyperspectral imagery , 2003 .

[53]  Chang Dong Yoo,et al.  Underdetermined Blind Source Separation Based on Subspace Representation , 2009, IEEE Transactions on Signal Processing.