Experimental Demonstration of an Anti-Shake Hyperspectral Imager of High Spatial Resolution and Low Cost

Environmental and internal factors can degrade the performance of a traditional hyperspectral imager. Here, we combine a self-developed hyperspectral imager with a calibration camera to improve its performance with our algorithm. The calibration camera is utilized to reduce the effect of the camera shake and provide high-definition splicing image in hyperspectral cube. The spectrum in the hyperspectral cube is provided by the hyperspectral imager. It can obtain high-definition images in hand-held or UAV scanning modes. In our experiment, the horizontal resolution of the image with calibration is improved from 9.7 mm to 1 mm, and the vertical spatial resolution is improved from 1 mm to 0.5 mm. Additionally, by using “Structure from Motion with Multi-View Stereo” (SfM-MVS), the system can carry out three-dimensional reconstruction. The images are fused together and transformed into a multi-dimensional image with depth and spectrum. Our experiments show that it can be used in environmental monitoring and face Anti-spoofing. Our system is highly stable and performs well when mounted on a UAV (without any gimbal) for remote sensing. The low complexity and low cost open possibilities for large-scale on-site and distributed hyperspectral imaging.

[1]  B. Pradhan,et al.  Hyperspectral imaging as an effective tool for prediction the moisture content and textural characteristics of roasted pistachio kernels , 2018, Journal of Food Measurement & Characterization.

[2]  Pengcheng Liu,et al.  Multilevel fusing paired visible light and near-infrared spectral images for face anti-spoofing , 2019, Pattern Recognit. Lett..

[3]  Pejhman Ghassemi,et al.  Hyperspectral imaging with near-infrared-enabled mobile phones for tissue oximetry , 2018, BiOS.

[4]  T. Sankey,et al.  UAV hyperspectral and lidar data and their fusion for arid and semi‐arid land vegetation monitoring , 2018 .

[5]  Richard A. Crocombe,et al.  Portable Spectroscopy , 2018, Applied spectroscopy.

[6]  Guangyuan Liu,et al.  Detecting Happiness Using Hyperspectral Imaging Technology , 2019, Comput. Intell. Neurosci..

[7]  Ramesh Raskar,et al.  Ultra-portable, wireless smartphone spectrometer for rapid, non-destructive testing of fruit ripeness , 2016, Scientific Reports.

[8]  Hongbin Pu,et al.  Applications of Imaging Spectrometry in Inland Water Quality Monitoring—a Review of Recent Developments , 2017, Water, Air, & Soil Pollution.

[9]  Jan-Michael Frahm,et al.  Structure-from-Motion Revisited , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  A F Goetz,et al.  Imaging Spectrometry for Earth Remote Sensing , 1985, Science.

[11]  Chen Chen,et al.  Smartphone-based spectrometer with high spectral accuracy for mHealth application , 2018 .

[12]  Baigang Zhang,et al.  Smartphone based optical spectrometer for diffusive reflectance spectroscopic measurement of hemoglobin , 2017, Scientific Reports.

[13]  P. Nath,et al.  Label-free biodetection using a smartphone. , 2013, Lab on a chip.

[14]  Steven S Lumetta,et al.  Multimode smartphone biosensing: the transmission, reflection, and intensity spectral (TRI)-analyzer. , 2017, Lab on a chip.

[15]  Sailing He,et al.  Non-invasive and rapid pH monitoring for meat quality assessment using a low-cost portable hyperspectral scanner. , 2019, Meat science.

[16]  Bodo Bookhagen,et al.  3D hyperspectral point cloud generation: Fusing airborne laser scanning and hyperspectral imaging sensors for improved object-based information extraction , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[17]  Bruce J. Tromberg,et al.  Face Recognition in Hyperspectral Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Junrui Li,et al.  Whole-field thickness strain measurement using multiple camera digital image correlation system , 2017 .

[19]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[20]  Alfio V. Parisi,et al.  Smartphone Spectrometers , 2018, Sensors.

[21]  Luciano F. Almeida,et al.  A handheld smartphone-controlled spectrophotometer based on hue to wavelength conversion for molecular absorption and emission measurements , 2017 .

[22]  Sailing He,et al.  A mobile device-based imaging spectrometer for environmental monitoring by attaching a lightweight small module to a commercial digital camera , 2017, Scientific Reports.

[23]  Lawrence A. Corp,et al.  High spatial resolution spectral unmixing for mapping ash species across a complex urban environment , 2017 .

[24]  Alan C. Bovik,et al.  No-Reference Sharpness Assessment of Camera-Shaken Images by Analysis of Spectral Structure , 2014, IEEE Transactions on Image Processing.

[25]  Fei Wang,et al.  Quantitative Estimation of Soil Salinity Using UAV-Borne Hyperspectral and Satellite Multispectral Images , 2019, Remote. Sens..

[26]  Stephen Marshall,et al.  Near-infrared hyperspectral imaging for non-destructive classification of commercial tea products , 2018, Journal of Food Engineering.

[27]  Jean Ponce,et al.  Accurate, Dense, and Robust Multiview Stereopsis , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Guillermo Sapiro,et al.  Hand-Held Video Deblurring Via Efficient Fourier Aggregation , 2015, IEEE Transactions on Computational Imaging.

[29]  Peng Jiang,et al.  Hyperspectral face recognition based on spatio-spectral fusion and local binary pattern , 2017, Applied Optics and Photonics China.

[30]  Yeong-Ho Ha,et al.  Multi-Spectral Flash Imaging Under Low-Light Conditions Using an Optimization Method , 2014 .

[31]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[32]  Sailing He,et al.  Pencil-like imaging spectrometer for bio-samples sensing. , 2017, Biomedical optics express.

[33]  Jie Chen,et al.  Experimental Demonstration of Remote and Compact Imaging Spectrometer Based on Mobile Devices , 2018, Sensors.