Recovery of Independent Sparse Sources From Linear Mixtures Using Sparse Bayesian Learning

Classical algorithms for the multiple measurement vector (MMV) problem assume either independent columns for the solution matrix or certain models of correlation among the columns. The correlation structure in the previous MMV formulation does not capture the signals well for some applications like photoplethysmography (PPG) signal extraction where the signals are independent and linearly mixed in a certain manner. In practice, the mixtures of these signals are observed through different channels. In order to capture this structure, we decompose the solution matrix into multiplication of a sparse matrix composed of independent components, and a linear mixing matrix. We derive a new condition that guarantees a unique solution for this linear mixing MMV problem. The condition can be much less restrictive than the conditions for the typical MMV problem in previous works. We also propose two novel sparse Bayesian learning (SBL) algorithms, independent component analysis sparse Bayesian learning, (ICASBL), and fast independent component sparse Bayesian learning, which capture the linear mixture structure. Analysis of the global and local minima of the ICASBL cost function is also provided, and similar to the typical SBL cost function it is shown that the local minima are sparse and that the global minima have maximum sparsity. Experimental results show that the proposed algorithms outperform traditional approaches and can recover the signal with fewer number of measurements in the linear mixing MMV setting.

[1]  Jianchu Yao,et al.  A Short Study to Assess the Potential of Independent Component Analysis for Motion Artifact Separation in Wearable Pulse Oximeter Signals , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[2]  Bhaskar D. Rao,et al.  Recovery of block sparse signals using the framework of block sparse Bayesian learning , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Michael Elad,et al.  Morphological diversity and source separation , 2006, IEEE Signal Processing Letters.

[4]  J. Cardoso Infomax and maximum likelihood for blind source separation , 1997, IEEE Signal Processing Letters.

[5]  Yonina C. Eldar,et al.  Average Case Analysis of Multichannel Sparse Recovery Using Convex Relaxation , 2009, IEEE Transactions on Information Theory.

[6]  Andrzej Cichocki,et al.  Robust learning algorithm for blind separation of signals , 1994 .

[7]  Bhaskar D. Rao,et al.  Bootstrapped sparse Bayesian learning for sparse signal recovery , 2014, 2014 48th Asilomar Conference on Signals, Systems and Computers.

[8]  Mohamed-Jalal Fadili,et al.  Sparsity and Morphological Diversity in Blind Source Separation , 2007, IEEE Transactions on Image Processing.

[9]  Sun K. Yoo,et al.  Motion artifact reduction in photoplethysmography using independent component analysis , 2006, IEEE Transactions on Biomedical Engineering.

[10]  Weidong Wang,et al.  Motion artifact removal from photoplethysmographic signals by combining temporally constrained independent component analysis and adaptive filter , 2014, Biomedical engineering online.

[11]  Aggelos K. Katsaggelos,et al.  Bayesian Compressive Sensing Using Laplace Priors , 2010, IEEE Transactions on Image Processing.

[12]  Bhaskar D. Rao,et al.  Latent Variable Bayesian Models for Promoting Sparsity , 2011, IEEE Transactions on Information Theory.

[13]  Seyyed Hamed Fouladi,et al.  Extracting remote photoplethysmogram signal from endoscopy videos for vessel and capillary density recognition , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Seyyed Hamed Fouladi,et al.  Accurate heart rate estimation from camera recording via MUSIC algorithm , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Lawrence Carin,et al.  Bayesian Compressive Sensing , 2008, IEEE Transactions on Signal Processing.

[16]  Selin Aviyente,et al.  Compressed Sensing Framework for EEG Compression , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[17]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[18]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[19]  Bhaskar D. Rao,et al.  Sparse solutions to linear inverse problems with multiple measurement vectors , 2005, IEEE Transactions on Signal Processing.

[20]  D. Donoho For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solution , 2006 .

[21]  Andrzej Cichocki,et al.  A New Learning Algorithm for Blind Signal Separation , 1995, NIPS.

[22]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[23]  Andrzej Cichocki,et al.  Robust neural networks with on-line learning for blind identification and blind separation of sources , 1996 .

[24]  Zhilin Zhang,et al.  Photoplethysmography-Based Heart Rate Monitoring in Physical Activities via Joint Sparse Spectrum Reconstruction , 2015, IEEE Transactions on Biomedical Engineering.

[25]  J. Haupt,et al.  Compressive wireless sensing , 2006, 2006 5th International Conference on Information Processing in Sensor Networks.

[26]  Zhilin Zhang,et al.  TROIKA: A General Framework for Heart Rate Monitoring Using Wrist-Type Photoplethysmographic Signals During Intensive Physical Exercise , 2014, IEEE Transactions on Biomedical Engineering.

[27]  H. Asada,et al.  Utility of the Photoplethysmogram in Circulatory Monitoring , 2008, Anesthesiology.

[28]  Daniel McDuff,et al.  Advancements in Noncontact, Multiparameter Physiological Measurements Using a Webcam , 2011, IEEE Transactions on Biomedical Engineering.

[29]  Jérôme Bobin,et al.  Robust Sparse Blind Source Separation , 2015, IEEE Signal Processing Letters.

[30]  Jong Chul Ye,et al.  Compressive MUSIC: Revisiting the Link Between Compressive Sensing and Array Signal Processing , 2012, IEEE Transactions on Information Theory.

[31]  Seungjin Choi,et al.  Independent Component Analysis , 2009, Handbook of Natural Computing.

[32]  T. Blumensath,et al.  Theory and Applications , 2011 .

[33]  Yonina C. Eldar,et al.  Robust Recovery of Signals From a Structured Union of Subspaces , 2008, IEEE Transactions on Information Theory.

[34]  Bhaskar D. Rao,et al.  Sparse Bayesian learning for basis selection , 2004, IEEE Transactions on Signal Processing.

[35]  Michael Elad,et al.  Stable recovery of sparse overcomplete representations in the presence of noise , 2006, IEEE Transactions on Information Theory.

[36]  Pierre Comon,et al.  Handbook of Blind Source Separation: Independent Component Analysis and Applications , 2010 .

[37]  Andrzej Cichocki,et al.  Modified Herault-Jutten Algorithms for Blind Separation of Sources , 1997, Digit. Signal Process..

[38]  Sung-En Chiu,et al.  Correlation learning on joint support recovery for more sources than measurements , 2016, 2016 IEEE Sensor Array and Multichannel Signal Processing Workshop (SAM).

[39]  Jean-Luc Starck,et al.  Blind Source Separation: the Sparsity Revolution , 2008 .

[40]  Bhaskar D. Rao,et al.  Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation , 2012, IEEE Transactions on Signal Processing.

[41]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Philip Schniter,et al.  An Empirical-Bayes Approach to Recovering Linearly Constrained Non-Negative Sparse Signals , 2013, IEEE Transactions on Signal Processing.

[43]  Thomas Strohmer,et al.  Compressed sensing for MIMO radar - algorithms and performance , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[44]  A. Cichocki Blind Signal Processing Methods for Analyzing Multichannel Brain Signals , 2004 .

[45]  George Eastman House,et al.  Sparse Bayesian Learning and the Relevan e Ve tor Ma hine , 2001 .

[46]  Aleksandar Dogandzic,et al.  Variance-Component Based Sparse Signal Reconstruction and Model Selection , 2010, IEEE Transactions on Signal Processing.

[47]  Bhaskar D. Rao,et al.  Sparse signal recovery in the presence of correlated multiple measurement vectors , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[48]  Bhaskar D. Rao,et al.  Sparse Signal Recovery With Temporally Correlated Source Vectors Using Sparse Bayesian Learning , 2011, IEEE Journal of Selected Topics in Signal Processing.

[49]  Michael E. Tipping,et al.  Analysis of Sparse Bayesian Learning , 2001, NIPS.

[50]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[51]  Matthieu Kowalski,et al.  An unified approach for blind source separation using sparsity and decorrelation , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[52]  Mohamed-Jalal Fadili,et al.  Image Decomposition and Separation Using Sparse Representations: An Overview , 2010, Proceedings of the IEEE.

[53]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[54]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[55]  Joel A. Tropp,et al.  Simultaneous sparse approximation via greedy pursuit , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[56]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[57]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[58]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[59]  Sergio Cruces,et al.  Thin QR and SVD factorizations for simultaneous blind signal extraction , 2004, 2004 12th European Signal Processing Conference.

[60]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[61]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[62]  Tzyy-Ping Jung,et al.  Compressed Sensing of EEG for Wireless Telemonitoring With Low Energy Consumption and Inexpensive Hardware , 2012, IEEE Transactions on Biomedical Engineering.

[63]  Angshul Majumdar,et al.  Row-sparse blind compressed sensing for reconstructing multi-channel EEG signals , 2015, Biomed. Signal Process. Control..

[64]  Sandeep Gogineni,et al.  Target Estimation Using Sparse Modeling for Distributed MIMO Radar , 2011, IEEE Transactions on Signal Processing.

[65]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[66]  H. Vincent Poor,et al.  MIMO Radar Using Compressive Sampling , 2009, IEEE Journal of Selected Topics in Signal Processing.

[67]  Zhilin Zhang Heart rate monitoring from wrist-type photoplethysmographic (PPG) signals during intensive physical exercise , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[68]  J. Romberg,et al.  Imaging via Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[69]  Tülay Adali,et al.  Independent Component Analysis by Entropy Bound Minimization , 2010, IEEE Transactions on Signal Processing.

[70]  G. Haan,et al.  Improved motion robustness of remote-PPG by using the blood volume pulse signature , 2014, Physiological measurement.

[71]  Lei Xu,et al.  Dual multivariate auto-regressive modeling in state space for temporal signal separation , 2003, IEEE Trans. Syst. Man Cybern. Part B.