Demultiplexing Visible and Near-Infrared Information in Single- Sensor Multispectral Imaging

In this paper, we study a single-sensor imaging system that uses a multispectral filter array to spectrally sample the scene. Our system captures information in both visible and near-infrared bands of the electromagnetic spectrum. Due to manufacturing limitations, the visible filters in this system also transmit the NIR radiation. Similarly, visible light is transmitted by the NIR filter, leading to inaccurate mixed spectral measurements. We present an algorithm that resolves this issue by separating NIR and visible information. Our method achieves this goal by exploiting the correlation of multispectral images in both spatial and spectral domains. Simulation results show that the mean square error of the data corrected by our method is less than 1/20 of the error in sensor spectral measurements.

[1]  W. Terry,et al.  Particle Image Velocimetry , 2009 .

[2]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[3]  A. Bruckstein,et al.  K-SVD : An Algorithm for Designing of Overcomplete Dictionaries for Sparse Representation , 2005 .

[4]  Masatoshi Okutomi,et al.  Simultaneous capturing of RGB and additional band images using hybrid color filter array , 2014, Electronic Imaging.

[5]  Pierre Vandergheynst,et al.  Compressive Source Separation: Theory and Methods for Hyperspectral Imaging , 2012, IEEE Transactions on Image Processing.

[6]  Sabine Süsstrunk,et al.  Designing color filter arrays for the joint capture of visible and near-infrared images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[7]  Christian Jutten,et al.  A Fast Approach for Overcomplete Sparse Decomposition Based on Smoothed $\ell ^{0}$ Norm , 2008, IEEE Transactions on Signal Processing.

[8]  Sabine Süsstrunk,et al.  A novel compressive sensing approach to simultaneously acquire color and near-infrared images on a single sensor , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Michael Zibulevsky,et al.  Underdetermined blind source separation using sparse representations , 2001, Signal Process..

[10]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[11]  Hyunsung Park,et al.  Multispectral imaging with vertical silicon nanowires , 2013, Scientific Reports.

[12]  Olivier Lartigue,et al.  Multispectral interference filter arrays with compensation of angular dependence or extended spectral range. , 2015, Optics express.

[13]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[14]  Torbjørn Skauli,et al.  A collection of hyperspectral images for imaging systems research , 2013, Electronic Imaging.

[15]  Michael Elad,et al.  Submitted to Ieee Transactions on Image Processing Image Decomposition via the Combination of Sparse Representations and a Variational Approach , 2022 .

[16]  Richard G. Baraniuk,et al.  Kronecker Compressive Sensing , 2012, IEEE Transactions on Image Processing.

[17]  K. Perez.  Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment , 2014 .

[18]  P. Magnan.  Detection of visible photons in CCD and CMOS: A comparative view , 2003 .