Constrained Null Space Component Analysis for Semiblind Source Separation Problem

The blind source separation (BSS) problem extracts unknown sources from observations of their unknown mixtures. A current trend in BSS is the semiblind approach, which incorporates prior information on sources or how the sources are mixed. The constrained independent component analysis (ICA) approach has been studied to impose constraints on the famous ICA framework. We introduced an alternative approach based on the null space component (NCA) framework and referred to the approach as the c-NCA approach. We also presented the c-NCA algorithm that uses signal-dependent semidefinite operators, which is a bilinear mapping, as signatures for operator design in the c-NCA approach. Theoretically, we showed that the source estimation of the c-NCA algorithm converges with a convergence rate dependent on the decay of the sequence, obtained by applying the estimated operators on corresponding sources. The c-NCA can be formulated as a deterministic constrained optimization method, and thus, it can take advantage of solvers developed in optimization society for solving the BSS problem. As examples, we demonstrated electroencephalogram interference rejection problems can be solved by the c-NCA with proximal splitting algorithms by incorporating a sparsity-enforcing separation model and considering the case when reference signals are available.

[1]  Christian Jutten,et al.  Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture , 1991, Signal Process..

[2]  S. Easter Selvan,et al.  Nonsmooth ICA Contrast Minimization Using a Riemannian Nelder–Mead Method , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Yannick Deville,et al.  Temporal and time-frequency correlation-based blind source separation methods. Part I: Determined and underdetermined linear instantaneous mixtures , 2007, Signal Process..

[4]  Wen-Liang Hwang,et al.  Null space component analysis for noisy blind source separation , 2015, Signal Process..

[5]  Sunho Park,et al.  Gaussian processes for source separation , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Barak A. Pearlmutter,et al.  Blind source separation by sparse decomposition , 2000, SPIE Defense + Commercial Sensing.

[7]  Lucas C. Parra,et al.  Blind Source Separation via Generalized Eigenvalue Decomposition , 2003, J. Mach. Learn. Res..

[8]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[9]  Michael I. Jordan,et al.  Blind One-microphone Speech Separation: A Spectral Learning Approach , 2004, NIPS.

[10]  Chin-Teng Lin,et al.  EEG-Based Learning System for Online Motion Sickness Level Estimation in a Dynamic Vehicle Environment , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Simon J. Godsill,et al.  A Bayesian Approach for Blind Separation of Sparse Sources , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[12]  D. Chakrabarti,et al.  A fast fixed - point algorithm for independent component analysis , 1997 .

[13]  T. Sejnowski,et al.  Removing electroencephalographic artifacts by blind source separation. , 2000, Psychophysiology.

[14]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[15]  Pierre Comon,et al.  Independent component analysis, A new concept? , 1994, Signal Process..

[16]  W. Dement,et al.  Cyclic variations in EEG during sleep and their relation to eye movements, body motility, and dreaming. , 1957, Electroencephalography and clinical neurophysiology.

[17]  Harri Valpola,et al.  Denoising Source Separation , 2005, J. Mach. Learn. Res..

[18]  J. Cardoso,et al.  Blind beamforming for non-gaussian signals , 1993 .

[19]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[20]  Jean-Luc Starck,et al.  Sparsity and Adaptivity for the Blind Separation of Partially Correlated Sources , 2014, IEEE Transactions on Signal Processing.

[21]  Lieven De Lathauwer,et al.  Fourth-Order Cumulant-Based Blind Identification of Underdetermined Mixtures , 2007, IEEE Transactions on Signal Processing.

[22]  Sabine Van Huffel,et al.  Spatially constrained ICA algorithm with an application in EEG processing , 2011, Signal Process..

[23]  Tülay Adali,et al.  General Non-Orthogonal Constrained ICA , 2014, IEEE Transactions on Signal Processing.

[24]  Nadège Thirion-Moreau,et al.  Source Separation and Localization Using Time-Frequency Distributions: An Overview , 2013, IEEE Signal Processing Magazine.

[25]  Aapo Hyvärinen,et al.  Fast and robust fixed-point algorithms for independent component analysis , 1999, IEEE Trans. Neural Networks.

[26]  Patrick L. Combettes,et al.  Proximal Splitting Methods in Signal Processing , 2009, Fixed-Point Algorithms for Inverse Problems in Science and Engineering.

[27]  Wei Lu,et al.  Approach and applications of constrained ICA , 2005, IEEE Transactions on Neural Networks.

[28]  G. Moruzzi,et al.  Brain stem reticular formation and activation of the EEG. , 1949, Electroencephalography and clinical neurophysiology.

[29]  Daniel W. C. Ho,et al.  Underdetermined blind source separation based on sparse representation , 2006, IEEE Transactions on Signal Processing.

[30]  Yuanqing Li,et al.  Analysis of Sparse Representation and Blind Source Separation , 2004, Neural Computation.

[31]  Christopher J. James,et al.  On Semi-Blind Source Separation Using Spatial Constraints With Applications in EEG Analysis , 2006, IEEE Transactions on Biomedical Engineering.

[32]  Yuanqing Li,et al.  Blind estimation of channel parameters and source components for EEG signals: a sparse factorization approach , 2006, IEEE Transactions on Neural Networks.

[33]  Jean-Francois Cardoso,et al.  Blind signal separation: statistical principles , 1998, Proc. IEEE.

[34]  Pierre Comon,et al.  Improved contrast dedicated to blind separation in communications , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[35]  Eric Moulines,et al.  A blind source separation technique using second-order statistics , 1997, IEEE Trans. Signal Process..

[36]  Mohamed-Jalal Fadili,et al.  Sparsity and Morphological Diversity in Blind Source Separation , 2007, IEEE Transactions on Image Processing.

[37]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[38]  Bob L. Sturm,et al.  Comparison of orthogonal matching pursuit implementations , 2012, 2012 Proceedings of the 20th European Signal Processing Conference (EUSIPCO).

[39]  Antoine Liutkus,et al.  Gaussian Processes for Underdetermined Source Separation , 2011, IEEE Transactions on Signal Processing.

[40]  Scott Rickard,et al.  Blind separation of speech mixtures via time-frequency masking , 2004, IEEE Transactions on Signal Processing.

[41]  Pierre Comon,et al.  A Contrast for Independent Component Analysis With Priors on the Source Kurtosis Signs , 2008, IEEE Signal Processing Letters.

[42]  Derong Liu,et al.  A Neural Network Method for Detection of Obstructive Sleep Apnea and Narcolepsy Based on Pupil Size and EEG , 2008, IEEE Transactions on Neural Networks.

[43]  Kevin H. Knuth,et al.  Informed source separation: A Bayesian tutorial , 2013, 2005 13th European Signal Processing Conference.

[44]  Ying Nian Wu,et al.  A null space method for over-complete blind source separation , 2007, Comput. Stat. Data Anal..

[45]  Yuanqing Li,et al.  Probability estimation for recoverability analysis of blind source separation based on sparse representation , 2006, IEEE Transactions on Information Theory.