A framework for learning affine transformations for multimodal sparse reconstruction

We introduce a novel framework to reconstruct highly undersampled signals from their measurements using a correlated signal as an aid. The correlated signal, called side information, need not be close or similar to the signal to reconstruct. Thus, our framework applies to the case in which the signals are multimodal. We use two main ingredients: the theory of l1–l1 minimization, which establishes precise reconstruction guarantees of sparse signals using a similar signal as an aid, and a set of training data consisting of several examples of pairs of the signal to reconstruct and the side information. We adopt a statistical framework where the training and the test data are drawn from the same joint distribution, which is assumed unknown. Our main insight is that a quantity arising in the l1–l1 minimization theory to measure the quality of the side information can be written as the 0-1 loss of a classification problem. Therefore, our problem can be solved with classification methods, such as support vector machines. Furthermore, using statistical learning theory, we provide guarantees for our method. Specifically, the expected value of the side information quality decreases with O(1/√T), where T is the number of training samples. Simulations with synthetic data validate our approach.

[1]  Namrata Vaswani,et al.  Kalman filtered Compressed Sensing , 2008, 2008 15th IEEE International Conference on Image Processing.

[2]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[3]  B. Rosen,et al.  PET and MR Imaging: The Odd Couple or a Match Made in Heaven? , 2013, The Journal of Nuclear Medicine.

[4]  Antonio J. Plaza,et al.  Hyperspectral Unmixing Overview: Geometrical, Statistical, and Sparse Regression-Based Approaches , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[5]  Justin K. Romberg,et al.  Sparsity penalties in dynamical system estimation , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[6]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[7]  Joel A. Tropp,et al.  ALGORITHMS FOR SIMULTANEOUS SPARSE APPROXIMATION , 2006 .

[8]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[10]  Richard G. Baraniuk,et al.  Distributed Compressed Sensing Dror , 2005 .

[11]  Volkan Cevher,et al.  Adaptive-Rate Reconstruction of Time-Varying Signals With Application in Compressive Foreground Extraction , 2016, IEEE Transactions on Signal Processing.

[12]  Ali Mousavi,et al.  Learning to invert: Signal recovery via Deep Convolutional Networks , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[14]  Miguel R. D. Rodrigues,et al.  Compressed Sensing With Prior Information: Strategies, Geometry, and Bounds , 2017, IEEE Transactions on Information Theory.

[15]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[16]  Christopher J. Rozell,et al.  Dynamic Filtering of Time-Varying Sparse Signals via $\ell _1$ Minimization , 2015, IEEE Transactions on Signal Processing.

[17]  Joel A. Tropp,et al.  Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit , 2006, Signal Process..

[18]  Miguel R. D. Rodrigues,et al.  Compressed sensing with side information: Geometrical interpretation and performance bounds , 2014, 2014 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[19]  Sanjeev R. Kulkarni,et al.  An Elementary Introduction to Statistical Learning Theory: Kulkarni/Statistical Learning Theory , 2011 .

[20]  Miguel R. D. Rodrigues,et al.  Coupled dictionary learning for multimodal image super-resolution , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[21]  Miguel R. D. Rodrigues,et al.  Bayesian Compressed Sensing with Heterogeneous Side Information , 2016, 2016 Data Compression Conference (DCC).

[22]  Shai Ben-David,et al.  Understanding Machine Learning: From Theory to Algorithms , 2014 .

[23]  Pierre Vandergheynst,et al.  Learning Multimodal Dictionaries , 2007, IEEE Transactions on Image Processing.

[24]  Claire J. Tomlin,et al.  Exact Reconstruction of Gene Regulatory Networks using Compressive Sensing , 2014 .

[25]  Yonina C. Eldar,et al.  Reference-based MRI. , 2015, Medical physics.

[26]  Miguel R. D. Rodrigues,et al.  Heterogeneous Networked Data Recovery From Compressive Measurements Using a Copula Prior , 2017, IEEE Transactions on Communications.

[27]  P. Vandergheynst,et al.  Compressed sensing imaging techniques for radio interferometry , 2008, 0812.4933.

[28]  Bhaskar D. Rao,et al.  An Empirical Bayesian Strategy for Solving the Simultaneous Sparse Approximation Problem , 2007, IEEE Transactions on Signal Processing.

[29]  Wei Wang,et al.  Learning Coupled Feature Spaces for Cross-Modal Matching , 2013, 2013 IEEE International Conference on Computer Vision.

[30]  Pierre Vandergheynst,et al.  A Compressed Sensing Framework for Magnetic Resonance Fingerprinting , 2013, SIAM J. Imaging Sci..

[31]  David B. Dunson,et al.  Multitask Compressive Sensing , 2009, IEEE Transactions on Signal Processing.

[32]  A. Robert Calderbank,et al.  Classification and Reconstruction of High-Dimensional Signals From Low-Dimensional Features in the Presence of Side Information , 2014, IEEE Transactions on Information Theory.

[33]  Rama Chellappa,et al.  Coupled Projections for Adaptation of Dictionaries , 2015, IEEE Transactions on Image Processing.

[34]  A. Robert Calderbank,et al.  Reconstruction of Signals Drawn From a Gaussian Mixture Via Noisy Compressive Measurements , 2013, IEEE Transactions on Signal Processing.

[35]  Xin Yuan,et al.  Compressive Hyperspectral Imaging With Side Information , 2015, IEEE Journal of Selected Topics in Signal Processing.

[36]  Yann LeCun,et al.  Learning Fast Approximations of Sparse Coding , 2010, ICML.

[37]  Shai Ben-David,et al.  On the difficulty of approximately maximizing agreements , 2000, J. Comput. Syst. Sci..

[38]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[40]  Miguel R. D. Rodrigues,et al.  X-ray image separation via coupled dictionary learning , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[41]  Liangpei Zhang,et al.  An Online Coupled Dictionary Learning Approach for Remote Sensing Image Fusion , 2014, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[42]  Kaihua Zhang,et al.  Spatio-spectral fusion of satellite images based on dictionary-pair learning , 2014, Inf. Fusion.

[43]  Namrata Vaswani,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, ISIT.

[44]  Quan Pan,et al.  Semi-coupled dictionary learning with applications to image super-resolution and photo-sketch synthesis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[45]  David Atkinson,et al.  Joint reconstruction of PET-MRI by exploiting structural similarity , 2014, Inverse Problems.

[46]  Yueting Zhuang,et al.  Supervised Coupled Dictionary Learning with Group Structures for Multi-modal Retrieval , 2013, AAAI.

[47]  R.G. Baraniuk,et al.  Distributed Compressed Sensing of Jointly Sparse Signals , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[48]  C GilbertAnna,et al.  Algorithms for simultaneous sparse approximation. Part II , 2006 .

[49]  Yonina C. Eldar,et al.  Reference-based compressed sensing: A sample complexity approach , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[50]  Miguel R. D. Rodrigues,et al.  Multi-Modal Dictionary Learning for Image Separation With Application in Art Investigation , 2016, IEEE Transactions on Image Processing.

[51]  Thomas S. Huang,et al.  Coupled Dictionary Training for Image Super-Resolution , 2012, IEEE Transactions on Image Processing.

[52]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[53]  Yonina C. Eldar,et al.  Fast reference based MRI , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[54]  Sanjeev R. Kulkarni,et al.  An Elementary Introduction to Statistical Learning Theory , 2011 .

[55]  David B. Dunson,et al.  Multi-task compressive sensing with Dirichlet process priors , 2008, ICML '08.

[56]  D. Townsend Multimodality imaging of structure and function , 2008, Physics in medicine and biology.

[57]  Duc Minh Nguyen,et al.  Deep learning sparse ternary projections for compressed sensing of images , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[58]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[59]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .