Mid-Wave Infrared Snapshot Compressive Spectral Imager with Deep Infrared Denoising Prior

Although various infrared imaging spectrometers have been studied, most of them are developed under the Nyquist sampling theorem, which severely burdens 3D data acquisition, storage, transmission, and processing, in terms of both hardware and software. Recently, computational imaging, which avoids direct imaging, has been investigated for its potential in the visible field. However, it has been rarely studied in the infrared domain, as it suffers from inconsistency in spectral response and reconstruction. To address this, we propose a novel mid-wave infrared snapshot compressive spectral imager (MWIR-SCSI). This design scheme provides a high degree of randomness in the measurement projection, which is more conducive to the reconstruction of image information and makes spectral correction implementable. Furthermore, leveraging the explainability of model-based algorithms and the high efficiency of deep learning algorithms, we designed a deep infrared denoising prior plug-in for the optimization algorithm to perform in terms of both imaging quality and reconstruction speed. The system calibration obtains 111 real coded masks, filling the gap between theory and practice. Experimental results on simulation datasets and real infrared scenarios prove the efficacy of the designed deep infrared denoising prior plug-in and the proposed acquisition architecture that acquires mid-infrared spectral images of 640 pixels × 512 pixels × 111 spectral channels at an acquisition frame rate of 50 fps.

[1]  X. Yan,et al.  Deep spatial-spectral prior with an adaptive dual attention network for single-pixel hyperspectral reconstruction. , 2022, Optics express.

[2]  Xinyu Liu,et al.  Residual image recovery method based on the dual-camera design of a compressive hyperspectral imaging system. , 2022, Optics express.

[3]  Xin Yuan,et al.  Spectral Compressive Imaging Reconstruction Using Convolution and Contextual Transformer , 2022, Photonics Research.

[4]  Lianfa Bai,et al.  Dual camera snapshot hyperspectral imaging system via physics-informed learning , 2021, Optics and Lasers in Engineering.

[5]  Qingshan Liu,et al.  Unsupervised Spatial–Spectral Network Learning for Hyperspectral Compressive Snapshot Reconstruction , 2020, IEEE Transactions on Geoscience and Remote Sensing.

[6]  Luc Van Gool,et al.  Plug-and-Play Image Restoration With Deep Denoiser Prior , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  H. Ikoma,et al.  SCCD: Shift-Variant Color-Coded Diffractive Spectral Imaging System , 2021, Optica.

[8]  Tong Yang,et al.  High-resolution fast mid-wave infrared compressive imaging. , 2021, Optics letters.

[9]  Aggelos K. Katsaggelos,et al.  Snapshot Compressive Imaging: Theory, Algorithms, and Applications , 2021, IEEE Signal Processing Magazine.

[10]  Yi Liang,et al.  Mid-Infrared Compressive Hyperspectral Imaging , 2021, Remote. Sens..

[11]  Aswin C. Sankaranarayanan,et al.  SASSI — Super-Pixelated Adaptive Spatio-Spectral Imaging , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Xia Wang,et al.  Non-uniformity correction for medium wave infrared focal plane array-based compressive imaging. , 2020, Optics express.

[13]  Zimu Wu,et al.  Focal plane array-based compressive imaging in medium wave infrared: modeling, implementation, and challenges. , 2019, Applied optics.

[14]  Michael E. Gehm,et al.  Single-shot multispectral imaging through a thin scatterer , 2019, Optica.

[15]  Nicholas Stone,et al.  Video-rate, mid-infrared hyperspectral upconversion imaging , 2019, Optica.

[16]  M. Gröschl,et al.  Broadband near-infrared hyperspectral single pixel imaging for chemical characterization. , 2019, Optics express.

[17]  Christian Pedersen,et al.  Mid-infrared upconversion based hyperspectral imaging. , 2018, Optics express.

[18]  Lei Zhang,et al.  FFDNet: Toward a Fast and Flexible Solution for CNN-Based Image Denoising , 2017, IEEE Transactions on Image Processing.

[19]  R M Sullenberger,et al.  Computational reconfigurable imaging spectrometer. , 2017, Optics express.

[20]  Giljoo Nam,et al.  High-quality hyperspectral reconstruction using a spectral prior , 2017, ACM Trans. Graph..

[21]  Huijie Zhao,et al.  MWIR thermal imaging spectrometer based on the acousto-optic tunable filter. , 2017, Applied optics.

[22]  Thomas Pertsch,et al.  Towards 3D-photonic, multi-telescope beam combiners for mid-infrared astrointerferometry. , 2017, Optics express.

[23]  P. Lasch,et al.  Hyperspectral infrared nanoimaging of organic samples based on Fourier transform infrared nanospectroscopy , 2017, Nature Communications.

[24]  Julia Rentz Dupuis,et al.  Longwave infrared compressive hyperspectral imager , 2015, Commercial + Scientific Sensing and Imaging.

[25]  Xin Yuan,et al.  Compressive Hyperspectral Imaging With Side Information , 2015, IEEE Journal of Selected Topics in Signal Processing.

[26]  Guangming Shi,et al.  Dual-camera design for coded aperture snapshot spectral imaging. , 2015, Applied optics.

[27]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[28]  A. Mahalanobis,et al.  Recent results of medium wave infrared compressive sensing. , 2014, Applied optics.

[29]  Qionghai Dai,et al.  Supplementary Document : Spatial-spectral Encoded Compressive Hyperspectral Imaging , 2014 .

[30]  Henry Arguello,et al.  Colored Coded Aperture Design by Concentration of Measure in Compressive Spectral Imaging , 2014, IEEE Transactions on Image Processing.

[31]  Jeppe Seidelin Dam,et al.  Room-temperature mid-infrared single-photon spectral imaging , 2012, Nature Photonics.

[32]  Thomas A. Russell,et al.  Compressive hyperspectral sensor for LWIR gas detection , 2012, Defense + Commercial Sensing.

[33]  Chris Phillips,et al.  Digistain: a digital staining instrument for histopathology. , 2012, Optics express.

[34]  David J. Brady,et al.  Multiframe image estimation for coded aperture snapshot spectral imagers. , 2010, Applied optics.

[35]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[36]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[37]  José M. Bioucas-Dias,et al.  A New TwIST: Two-Step Iterative Shrinkage/Thresholding Algorithms for Image Restoration , 2007, IEEE Transactions on Image Processing.

[38]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[39]  Ann E Elsner,et al.  Imaging polarimetry in patients with neovascular age-related macular degeneration. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  Uwe Schmidt,et al.  Multispectral high-speed midwave infrared imaging system , 2004, SPIE Defense + Commercial Sensing.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Martin Chamberland,et al.  Performance model of imaging FTS as a standoff chemical agent detection tool , 2004, SPIE Optics East.

[43]  Neelam Gupta,et al.  Progress in AOTF hyperspectral imagers , 2000, SPIE Defense + Commercial Sensing.

[44]  Paul D. Willson,et al.  Video rate visible to LWIR hyperspectral image generation and exploitation , 1999, Optics East.

[45]  Fred A. Kruse,et al.  The Spectral Image Processing System (SIPS) - Interactive visualization and analysis of imaging spectrometer data , 1993 .

[46]  M Sidran,et al.  Broadband reflectance and emissivity of specular and rough water surfaces. , 1981, Applied optics.