Sparse Reconstruction of Compressive Sensing Multi-Spectral Data Using an Inter-Spectral Multi-Layered Conditional Random Field Model

The broadband spectrum contains significantly more information than what the human eye can detect, with different wavelengths providing unique information about the intrinsic properties of an object. Recently, compressive sensing-based strategies for multi-spectral imaging via wavelength filtering at the pixel level on the imaging detector have been proposed for simultaneous acquisition of multi-spectral imaging data greatly reducing the acquisition times. To utilize such compressive sensing strategies for multi-spectral imaging, strong reconstruction algorithms that can reconstruct dense multi-spectral image cubes from the sparse compressively sensed observations are required. This paper proposes a comprehensive inter-spectral multi-layered conditional random field (IS-MCRF) sparse reconstruction framework for multi-spectral compressively sensed data captured using such acquisition strategies. The IS-MCRF framework leverages the information between neighboring spectral bands to better utilize the available information for reconstruction. The proposed framework was evaluated using compressively sensed multi-spectral acquisitions ranging from visible to near infrared spectral bands obtained by a simulated compressive sensing-based multi-spectral imaging system. Results show noticeable improvement over the existing sparse reconstruction techniques for compressive sensing-based multi-spectral imaging systems in preserving spatial and spectral fidelity.

[1]  José M. Bioucas-Dias,et al.  HYCA: A New Technique for Hyperspectral Compressive Sensing , 2015, IEEE Trans. Geosci. Remote. Sens..

[2]  D. R. Fulkerson,et al.  Maximal Flow Through a Network , 1956 .

[3]  Mrityunjay Kumar,et al.  Compressive Framework for Demosaicing of Natural Images , 2013, IEEE Transactions on Image Processing.

[4]  A. Dale,et al.  Simultaneous imaging of total cerebral hemoglobin concentration, oxygenation, and blood flow during functional activation. , 2003, Optics letters.

[5]  Gonzalo R Arce,et al.  Multi-spectral compressive snapshot imaging using RGB image sensors. , 2015, Optics express.

[6]  Hyunsung Park,et al.  Filter-free image sensor pixels comprising silicon nanowires with selective color absorption. , 2014, Nano letters.

[7]  J. Carter,et al.  Comparison of Acousto-Optic and Liquid Crystal Tunable Filters for Laser-Induced Breakdown Spectroscopy , 2001 .

[8]  Hyunsung Park,et al.  Harnessing the Nano-optics of Silicon Nanowires for Multispectral Imaging , 2013 .

[9]  David A. Clausi,et al.  Multispectral Stereoscopic Imaging Device: Simultaneous Multiview Imaging From the Visible to the Near-Infrared , 2014, IEEE Transactions on Instrumentation and Measurement.

[10]  Baoxin Li,et al.  Compressive imaging of color images , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Yang Li,et al.  Large-scale structured sparse image reconstruction with correlated multiple-measurement vectors using Bayesian learning , 2015, 2015 Picture Coding Symposium (PCS).

[12]  Guna Seetharaman,et al.  Multiscale Tikhonov-Total Variation Image Restoration Using Spatially Varying Edge Coherence Exponent , 2015, IEEE Transactions on Image Processing.

[13]  K. T. Block,et al.  Undersampled radial MRI with multiple coils. Iterative image reconstruction using a total variation constraint , 2007, Magnetic resonance in medicine.

[14]  Hyunsung Park,et al.  Multispectral imaging with vertical silicon nanowires , 2013, Scientific Reports.

[15]  David A. Clausi,et al.  Reconstruction of compressive multispectral sensing data using a multilayered conditional random field approach , 2014, Optics & Photonics - Optical Engineering + Applications.

[16]  Baoxin Li,et al.  Joint modeling and reconstruction of a compressively-sensed set of correlated images , 2015, J. Vis. Commun. Image Represent..

[17]  Thomas W. Parks,et al.  Adaptive homogeneity-directed demosaicing algorithm , 2005, IEEE Transactions on Image Processing.

[18]  E.J. Candes Compressive Sampling , 2022 .

[19]  Patrick J. Treado,et al.  Imaging Spectrometers for Fluorescence and Raman Microscopy: Acousto-Optic and Liquid Crystal Tunable Filters , 1994 .

[20]  Hans Brettel,et al.  Multispectral color image capture using a liquid crystal tunable filter , 2002 .

[21]  Yusuf Sinan Akgül,et al.  A Gradient Descent Approximation for Graph Cuts , 2009, DAGM-Symposium.

[22]  Johannes Brauers,et al.  Multispectral Filter-Wheel Cameras: Geometric Distortion Model and Compensation Algorithms , 2008, IEEE Transactions on Image Processing.

[23]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[24]  Antoni Buades,et al.  Self-Similarity and Spectral Correlation Adaptive Algorithm for Color Demosaicking , 2014, IEEE Transactions on Image Processing.

[25]  Xin Li,et al.  Demosaicing by successive approximation , 2005, IEEE Transactions on Image Processing.

[26]  Pascal Frossard,et al.  Distributed Representation of Geometrically Correlated Images With Compressed Linear Measurements , 2012, IEEE Transactions on Image Processing.

[27]  Bryan C. Russell,et al.  Exploiting the sparse derivative prior for super-resolution , 2003 .

[28]  Sabine Süsstrunk,et al.  Linear demosaicing inspired by the human visual system , 2005, IEEE Transactions on Image Processing.

[29]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[30]  Farnoud Kazemzadeh,et al.  Sparse reconstruction of compressed sensing multispectral data using a cross-spectral multilayered conditional random field model , 2015, SPIE Optical Engineering + Applications.

[31]  Liangpei Zhang,et al.  Hyperspectral Image Restoration Using Low-Rank Matrix Recovery , 2014, IEEE Transactions on Geoscience and Remote Sensing.

[32]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[33]  Baoxin Li,et al.  Compressive Sensing Reconstruction of Correlated Images Using Joint Regularization , 2016, IEEE Signal Processing Letters.

[34]  Andrew W. Fitzgibbon,et al.  Joint Demosaicing and Denoising via Learned Nonparametric Random Fields , 2014, IEEE Transactions on Image Processing.

[35]  Bhaskar D. Rao,et al.  Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation , 2012, IEEE Transactions on Signal Processing.

[36]  R. Crippen Calculating the vegetation index faster , 1990 .

[37]  Vladimir Kolmogorov,et al.  An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision , 2004, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Richard G. Baraniuk,et al.  Kronecker Compressive Sensing , 2012, IEEE Transactions on Image Processing.

[39]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[40]  Peng Liu,et al.  Compressive Sensing of Noisy Multispectral Images , 2014, IEEE Geoscience and Remote Sensing Letters.

[41]  Yuk-Hee Chan,et al.  Color Demosaicing Using Variance of Color Differences , 2006, IEEE Transactions on Image Processing.

[42]  Henrique S. Malvar,et al.  High-quality linear interpolation for demosaicing of Bayer-patterned color images , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[43]  Michael Elad,et al.  Multiframe demosaicing and super-resolution of color images , 2006, IEEE Transactions on Image Processing.

[44]  Rabab K. Ward,et al.  Compressed sensing of color images , 2010, Signal Process..

[45]  Chao Wang,et al.  Real-Time Multispectral Imager for Home-Based Health Care , 2011, IEEE Transactions on Biomedical Engineering.

[46]  Guangming Shi,et al.  Compressive Sensing via Nonlocal Low-Rank Regularization , 2014, IEEE Transactions on Image Processing.

[47]  Andy Lambrechts,et al.  A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic , 2014, Photonics West - Micro and Nano Fabricated Electromechanical and Optical Components.

[48]  Alex Chen The inpainting of hyperspectral images: a survey and adaptation to hyperspectral data , 2012, Remote Sensing.

[49]  H. Nyquist,et al.  Certain Topics in Telegraph Transmission Theory , 1928, Transactions of the American Institute of Electrical Engineers.

[50]  Ludovic Macaire,et al.  Multispectral demosaicing using intensity-based spectral correlation , 2015, 2015 International Conference on Image Processing Theory, Tools and Applications (IPTA).

[51]  Masatoshi Okutomi,et al.  Beyond Color Difference: Residual Interpolation for Color Image Demosaicking , 2016, IEEE Transactions on Image Processing.