Projection Design for Compressive Source Separation Using Mean Errors and Cross-Validation

This paper addresses the task of projection design for source separation in the compressive domain, where one observes a compressed linear mixture of two source signals with known priors. By positioning that both the sources follow a Gaussian mixture, we formulate an objective that tightly approximates the minimum mean squared error and solve the optimization problem using a gradient-based approach. In the blind setting, where the mixing ratio unknown, we propose a cross-validation approach to independently estimate the mixing ratio. We also provide a number of numerical results on synthetic and real image data that validate our findings. To the best of our knowledge, this is the first effort in projection design for prior-based source separation.

[1]  Barak A. Pearlmutter,et al.  Survey of sparse and non‐sparse methods in source separation , 2005, Int. J. Imaging Syst. Technol..

[2]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[3]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[4]  A. Robert Calderbank,et al.  Information-Theoretic Compressive Measurement Design , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  C. Yau,et al.  Bayesian non‐parametric hidden Markov models with applications in genomics , 2011 .

[7]  Stanislaw Gorlow,et al.  Informed separation of spatial images of stereo music recordings using second-order statistics , 2013, 2013 IEEE International Workshop on Machine Learning for Signal Processing (MLSP).

[8]  Laurent Girin,et al.  A Watermarking-Based Method for Informed Source Separation of Audio Signals With a Single Sensor , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Ujwalla Gawande,et al.  Bimodal biometric system: feature level fusion of iris and fingerprint , 2013 .

[10]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[11]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[12]  Guillermo Sapiro,et al.  Statistical Compressed Sensing of Gaussian Mixture Models , 2011, IEEE Transactions on Signal Processing.

[13]  Yair Weiss,et al.  From learning models of natural image patches to whole image restoration , 2011, 2011 International Conference on Computer Vision.

[14]  Kimmo Kansanen,et al.  On MMSE Estimation: A Linear Model Under Gaussian Mixture Statistics , 2012, IEEE Transactions on Signal Processing.

[15]  Jarvis D. Haupt,et al.  Compressive measurement designs for estimating structured signals in structured clutter: A Bayesian Experimental Design approach , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[16]  Edward H. Adelson,et al.  Separating reflections and lighting using independent components analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[17]  Karim Abed-Meraim,et al.  Underdetermined Blind Audio Source Separation Using Modal Decomposition , 2007, EURASIP J. Audio Speech Music. Process..

[18]  Guillermo Sapiro,et al.  Video Compressive Sensing Using Gaussian Mixture Models , 2014, IEEE Transactions on Image Processing.

[19]  Michael Elad,et al.  Optimized Projections for Compressed Sensing , 2007, IEEE Transactions on Signal Processing.

[20]  Franz J. Király,et al.  SOURCE SEPARATION IN THE PRESENCE OF SIDE INFORMATION: NECESSARY AND SUFFICIENT CONDITIONS FOR RELIABLE DE-MIXING , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[21]  Richard G. Baraniuk,et al.  Sparse Signal Reconstruction from Noisy Compressive Measurements using Cross Validation , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[22]  Sailes K. Sengijpta Fundamentals of Statistical Signal Processing: Estimation Theory , 1995 .

[23]  Guillermo Sapiro,et al.  Learning to Sense Sparse Signals: Simultaneous Sensing Matrix and Sparsifying Dictionary Optimization , 2009, IEEE Transactions on Image Processing.

[24]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[25]  Rachel Ward,et al.  Compressed Sensing With Cross Validation , 2008, IEEE Transactions on Information Theory.

[26]  A. Robert Calderbank,et al.  Reconstruction of Signals Drawn From a Gaussian Mixture Via Noisy Compressive Measurements , 2013, IEEE Transactions on Signal Processing.

[27]  Barak A. Pearlmutter,et al.  Blind Source Separation by Sparse Decomposition in a Signal Dictionary , 2001, Neural Computation.

[28]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[29]  Ajit Rajwade,et al.  Optimizing Matrices For Compressed Sensing Using Existing Goodness Measures: Negative Results, And An Alternative , 2017, ArXiv.

[30]  A. Robert Calderbank,et al.  Communications-Inspired Projection Design with Application to Compressive Sensing , 2012, SIAM J. Imaging Sci..

[31]  Yuantao Gu,et al.  Cross Validation in Compressive Sensing and its Application of OMP-CV Algorithm , 2016, ArXiv.

[32]  Nan Zhu,et al.  Information optimal scalable compressive imager demonstrator , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[33]  Saeid Sanei,et al.  On optimization of the measurement matrix for compressive sensing , 2010, 2010 18th European Signal Processing Conference.

[34]  Ajit Rajwade,et al.  DESIGNING CONSTRAINED PROJECTIONS FOR COMPRESSED SENSING: MEAN ERRORS AND ANOMALIES WITH COHERENCE , 2018, 2018 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[35]  Saeid Sanei,et al.  Blind Separation of Image Sources via Adaptive Dictionary Learning , 2012, IEEE Transactions on Image Processing.