Dual-camera snapshot spectral imaging with a pupil-domain optical diffuser and compressed sensing algorithms.

We propose a snapshot spectral imaging method for the visible spectral range using two digital cameras placed side-by-side: a regular red-green-blue (RGB) camera and a monochromatic camera equipped with a dispersive diffractive diffuser placed at the pupil of the imaging lens. While spectral imaging was shown to be feasible using a single monochromatic camera with a pupil diffuser [Appl. Opt.55, 432 (2016)APOPAI0003-693510.1364/AO.55.000432], adding an RGB camera provides more spatial and spectral information for stable reconstruction of the spectral cube of a scene. Results of optical experiments confirm that the combined data from the two cameras relax the complexity of the underdetermined reconstruction problem and improve the reconstructed image quality obtained using compressed sensing-based algorithms.

[1]  A. Bjerhammar.  Application of calculus of matrices to method of least squares : with special reference to geodetic calculations , 1951 .

[2]  R. Penrose.  A Generalized inverse for matrices , 1955 .

[3]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[4]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[5]  Colin Victor. Greensill,et al.  Sugar “Imaging” of Fruit Using a Low Cost Charge-Coupled Device Camera , 2005 .

[6]  Karen O. Egiazarian,et al.  Image denoising with block-matching and 3D filtering , 2006, Electronic Imaging.

[7]  Matthias F. Carlsohn.  Spectral image processing in real-time , 2006, Journal of Real-Time Image Processing.

[8]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[9]  Javier Hernández-Andrés,et al.  Developing an optimum computer-designed multispectral system comprising a monochrome CCD camera and a liquid-crystal tunable filter. , 2008, Applied optics.

[10]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[11]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[12]  Jian-Feng Cai,et al.  Split Bregman Methods and Frame Based Image Restoration , 2009, Multiscale Model. Simul..

[13]  Liang Gao,et al.  Compact Image Slicing Spectrometer (ISS) for hyperspectral fluorescence microscopy. , 2009, Optics express.

[14]  Zuowei Shen.  Wavelet Frames and Image Restorations , 2011 .

[15]  Stephen Lin,et al.  Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System , 2014, International Journal of Computer Vision.

[16]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[17]  Qionghai Dai,et al.  Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system. , 2014, Optics letters.

[18]  Henry Arguello,et al.  Compressive Coded Aperture Spectral Imaging: An Introduction , 2014, IEEE Signal Processing Magazine.

[19]  Guangming Shi,et al.  High-speed hyperspectral video acquisition with a dual-camera architecture , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Guangming Shi,et al.  Dual-camera design for coded aperture snapshot spectral imaging. , 2015, Applied optics.

[21]  Carolina Blanch,et al.  A tiny VIS-NIR snapshot multispectral camera , 2015, Photonics West - Optoelectronic Materials and Devices.

[22]  Stephen Lin,et al.  Computational Snapshot Multispectral Cameras: Toward dynamic capture of the spectral world , 2016, IEEE Signal Processing Magazine.

[23]  Amir Averbuch,et al.  Compressed sensing snapshot spectral imaging by a regular digital camera with an added optical diffuser. , 2016, Applied optics.

[24]  Guangming Shi,et al.  Compressive hyperspectral imaging with complementary RGB measurements , 2016, 2016 Visual Communications and Image Processing (VCIP).

[25]  Henry Arguello,et al.  Coded aperture design in compressive spectral imaging based on side information. , 2017, Applied optics.

[26]  Single-shot multispectral imaging with a monochromatic camera , 2017 .

[27]  S. Sahoo,et al.  Single-shot multispectral imaging with a monochromatic camera , 2017, 1707.09453.

[28]  Guangming Shi,et al.  Simultaneous Depth and Spectral Imaging With a Cross-Modal Stereo System , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  Rajesh Menon,et al.  Computational multispectral video imaging , 2018 .

[30]  Peng Wang,et al.  Computational multispectral video imaging [Invited]. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Figen S. Oktem,et al.  Compressive spectral imaging with diffractive lenses. , 2019, Optics letters.

[32]  Henry Arguello,et al.  Compressive spectral imaging via deformable mirror and colored-mosaic detector. , 2019, Optics express.

[33]  Amir Averbuch,et al.  High-photon-throughput snapshot colour imaging using a monochromatic digital camera and a pupil-domain diffuser , 2019, Journal of Modern Optics.

[34]  Edgar Salazar,et al.  Spectral Zooming and Resolution Limits of Spatial Spectral Compressive Spectral Imagers , 2019, IEEE Transactions on Computational Imaging.