Handheld four-dimensional optical sensor

Abstract Spectral and imaging systems enable retrieval of the molecular and surface profile information of objects of interest. Camera has become an indispensable device in everyday life to capture images for surface profile investigation. However up to now, spectral data are still neglected even though we receive this information most of the time. In this work, we developed a handheld four-dimensional optical sensor by combining a lightweight imaging spectrometer and a binocular camera. Based on this compact system, we can acquire spatial images, depth information and spectral data simultaneously. This technology can be applied to any kind of image capture equipment. It can be used to remotely and quickly collect spectral information and spatial images synchronously and has important value for object classification.

[1]  Anastasios Koulaouzidis,et al.  Use of Hyperspectral/Multispectral Imaging in Gastroenterology. Shedding Some–Different–Light into the Dark , 2019, Journal of clinical medicine.

[2]  Rune Storvold,et al.  Do it yourself hyperspectral imager for handheld to airborne operations. , 2018, Optics express.

[3]  Baigang Zhang,et al.  Smartphone based optical spectrometer for diffusive reflectance spectroscopic measurement of hemoglobin , 2017, Scientific Reports.

[4]  Ralf Kiesslich,et al.  A guide to multimodal endoscopy imaging for gastrointestinal malignancy — an early indicator , 2017, Nature Reviews Gastroenterology &Hepatology.

[5]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[6]  Jian-Jun He,et al.  Static FT imaging spectrometer based on a modified waveguide MZI array. , 2017, Optics letters.

[7]  Sung-Kyu Kim,et al.  Parallax barrier engineering for image quality improvement in an autostereoscopic 3D display. , 2015, Optics express.

[8]  David A. Landgrebe,et al.  Hyperspectral image data analysis , 2002, IEEE Signal Process. Mag..

[9]  Sailing He,et al.  Pencil-like imaging spectrometer for bio-samples sensing. , 2017, Biomedical optics express.

[10]  Jie Chen,et al.  Experimental Demonstration of Remote and Compact Imaging Spectrometer Based on Mobile Devices , 2018, Sensors.

[11]  Edward Jones,et al.  A survey of image processing techniques for plant extraction and segmentation in the field , 2016, Comput. Electron. Agric..

[12]  Liujuan Cao,et al.  Robust depth-based object tracking from a moving binocular camera , 2015, Signal Process..

[13]  Sailing He,et al.  The design and implementation of a low-cost multispectral endoscopy through galvo scanning of a fiber bundle , 2018, Optics Communications.

[14]  Boreom Lee,et al.  Smartphone-based multispectral imaging: system development and potential for mobile skin diagnosis. , 2016, Biomedical optics express.

[15]  Ayman Alfalou,et al.  One lens optical correlation: application to face recognition. , 2018, Applied optics.

[16]  Ramesh Raskar,et al.  Ultra-portable, wireless smartphone spectrometer for rapid, non-destructive testing of fruit ripeness , 2016, Scientific Reports.

[17]  Wei Shi,et al.  On-chip Fourier transform spectrometers by dual-polarized detection , 2019, Optics Letters.

[18]  Sailing He,et al.  Non-invasive and rapid pH monitoring for meat quality assessment using a low-cost portable hyperspectral scanner. , 2019, Meat science.

[19]  Ningbo Yu,et al.  Enhanced Autonomous Exploration and Mapping of an Unknown Environment with the Fusion of Dual RGB-D Sensors , 2019 .

[20]  Zichun Le,et al.  Ultracompact silicon-on-insulator-based reflective arrayed waveguide gratings for spectroscopic applications. , 2016, Applied optics.