Multi-Resolution Coded Apertures Based on Side Information for Single Pixel Spectral Reconstruction

Compressive spectral imaging (CSI) architectures allow to reconstruct spectral images from a lower number of measures than the traditional scanning-based methods. In these architectures, the coded aperture design is critical to obtain high-quality reconstructions. The structure of coded apertures is traditionally designed without information about the scene, but recently side information-based architectures provide prior information of the scene, which enables adaptive coded aperture designs. This work proposes the development of an adaptive coded aperture design for spectral imaging with the single pixel camera, based on a multi-resolution approach. An RGB side image is used to define blocks of similar pixels, such that they can be used to design the coded aperture patterns. This approach improves the reconstruction quality in up to $23\mathbf{dB}$ compared with traditional single pixel camera, and the computation time in up to 99.5% because it does not require an iterative algorithm.

[1]  Henry Arguello,et al.  Spatiotemporal blue noise coded aperture design for multi-shot compressive spectral imaging. , 2016, Journal of the Optical Society of America. A, Optics, image science, and vision.

[2]  Henry Arguello,et al.  Fast lapped block reconstructions in compressive spectral imaging. , 2013, Applied optics.

[3]  Alessandro Piva,et al.  Multispectral imaging of paintings , 2008, IEEE Signal Processing Magazine.

[4]  Mário A. T. Figueiredo,et al.  Gradient Projection for Sparse Reconstruction: Application to Compressed Sensing and Other Inverse Problems , 2007, IEEE Journal of Selected Topics in Signal Processing.

[5]  Rama Chellappa,et al.  Adaptive-Rate Compressive Sensing Using Side Information , 2014, IEEE Transactions on Image Processing.

[6]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[7]  Yi-Chao Yang,et al.  Recent Advances in the Application of Hyperspectral Imaging for Evaluating Fruit Quality , 2015, Food Analytical Methods.

[8]  Qionghai Dai,et al.  Dual-Coded Compressive Hyper-Spectral Imaging , 2014 .

[9]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[10]  Henry Arguello,et al.  Rank Minimization Code Aperture Design for Spectrally Selective Compressive Imaging , 2013, IEEE Transactions on Image Processing.

[11]  Henry Arguello,et al.  Coded aperture design in compressive spectral imaging based on side information. , 2017, Applied optics.

[12]  Cesar Augusto Vargas-Garcia,et al.  Arquitectura óptica de único pixel para el sensado compresivo de imágenes hiperespectrales , 2014 .

[13]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[14]  Qionghai Dai,et al.  Supplementary Document : Spatial-spectral Encoded Compressive Hyperspectral Imaging , 2014 .

[15]  Guolan Lu,et al.  Medical hyperspectral imaging: a review , 2014, Journal of biomedical optics.

[16]  Henry Arguello,et al.  Multi-resolution reconstruction algorithm for compressive single pixel spectral imaging , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[17]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..