High resolution snapshot imaging spectrometer using a fusion algorithm based on grouping principal component analysis.

We reported a high resolution snapshot imaging spectrometer (HR-SIS) and a fusion algorithm based on the properties of the HR-SIS. The system consists of an imaging branch and a spectral branch. The imaging branch captures a high spatial resolution panchromatic image with 680 × 680 pixels, while the spectral branch acquires a low spatial resolution spectral image with spectral resolution of 250 cm-1. By using a fusion algorithm base on grouping principal component analysis, the spectral image is highly improved in spatial resolution. Experimental results demonstrated that the performance of the proposed algorithm is competitive with other state-of-the-art algorithms. The computing time for a single frame is less than 1 min with an Intel Core i5-4200H CPU, which can be further reduced by utilizing a graphics processing unit (GPU).

[1]  Tomasz S. Tkaczyk,et al.  Multimodal snapshot spectral imaging for oral cancer diagnostics: a pilot study , 2013, Biomedical optics express.

[2]  Alexander Toet,et al.  Merging thermal and visual images by a contrast pyramid , 1989 .

[3]  Alex Hegyi,et al.  Hyperspectral imaging with a liquid crystal polarization interferometer. , 2015, Optics express.

[4]  Joan Lasenby,et al.  ChESS - Quick and robust detection of chess-board features , 2013, Comput. Vis. Image Underst..

[5]  Guangming Shi,et al.  Dual-camera design for coded aperture snapshot spectral imaging. , 2015, Applied optics.

[6]  Bruno Aiazzi,et al.  Improving Component Substitution Pansharpening Through Multivariate Regression of MS $+$Pan Data , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  V. K. Shettigara,et al.  A generalized component substitution technique for spatial enhancement of multispectral images using , 1992 .

[8]  Liang Gao,et al.  Snapshot Image Mapping Spectrometer (IMS) with high sampling density for hyperspectral microscopy , 2010, Optics express.

[9]  H. Kaiser.  The varimax criterion for analytic rotation in factor analysis , 1958 .

[10]  Ashwin A. Wagadarikar,et al.  Single disperser design for coded aperture snapshot spectral imaging. , 2008, Applied optics.

[11]  Naoto Yokoya,et al.  Hyperspectral Pansharpening: A Review , 2015, IEEE Geoscience and Remote Sensing Magazine.

[12]  Jocelyn Chanussot,et al.  A Critical Comparison Among Pansharpening Algorithms , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[13]  M. Descour,et al.  Large-image-format computed tomography imaging spectrometer for fluorescence microscopy. , 2001, Optics express.

[14]  Jeremy M Lerner,et al.  Hyperspectral Image Analysis of Live Cells in Various Cell Cycle Stages , 2007, Cell cycle.

[15]  Masahiro Yamaguchi,et al.  Hybrid-resolution spectral video system using low-resolution spectral sensor. , 2014, Optics express.

[16]  J. Mansfield,et al.  Multispectral imaging in biology and medicine: Slices of life , 2006, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[17]  D. Mulla.  Twenty five years of remote sensing in precision agriculture: Key advances and remaining knowledge gaps , 2013 .

[18]  Tsehaie Woldai,et al.  Multi- and hyperspectral geologic remote sensing: A review , 2012, Int. J. Appl. Earth Obs. Geoinformation.

[19]  Hassan Ghassemian,et al.  A review of remote sensing image fusion methods , 2016, Inf. Fusion.

[20]  Jocelyn Chanussot,et al.  Synthesis of Multispectral Images to High Spatial Resolution: A Critical Review of Fusion Methods Based on Remote Sensing Physics , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[21]  L. Wald,et al.  Fusion of satellite images of different spatial resolutions: Assessing the quality of resulting images , 1997 .

[22]  Liang Gao,et al.  A review of snapshot multidimensional optical imaging: measuring photon tags in parallel. , 2016, Physics reports.

[23]  Xavier Otazu,et al.  Introduction of sensor spectral response into image fusion methods. Application to wavelet-based methods , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[24]  Kazuyoshi Itoh,et al.  Application of Measurement multiple-image fourier of fast phenomena transform spectral imaging to measurement of fast phenomena , 1994 .

[25]  Michael W. Kudenov,et al.  Review of snapshot spectral imaging technologies , 2013, Optics and Precision Engineering.

[26]  Luciano Alparone,et al.  MTF-tailored Multiscale Fusion of High-resolution MS and Pan Imagery , 2006 .

[27]  Stephen Lin,et al.  Acquisition of High Spatial and Spectral Resolution Video with a Hybrid Camera System , 2014, International Journal of Computer Vision.

[28]  E. Dereniak,et al.  Compact real-time birefringent imaging spectrometer. , 2012, Optics express.

[29]  Qionghai Dai,et al.  Content-adaptive high-resolution hyperspectral video acquisition with a hybrid camera system. , 2014, Optics letters.

[30]  Alistair Gorman,et al.  Generalization of the Lyot filter and its application to snapshot spectral imaging. , 2010, Optics express.

[31]  Ge Yang,et al.  Bioimage informatics for understanding spatiotemporal dynamics of cellular processes , 2013, Wiley interdisciplinary reviews. Systems biology and medicine.