Hyperspectral imaging enabled by an unmodified smartphone for analyzing skin morphological features and monitoring hemodynamics.

We propose a novel method and system that utilizes a popular smartphone to realize hyperspectral imaging for analyzing skin morphological features and monitoring hemodynamics. The imaging system works based on a built-in RGB camera and flashlight on the smartphone. We apply Wiener estimation to transform the acquired RGB-mode images into "pseudo"-hyperspectral images with 16 wavebands, covering a visible range from 470nm to 620nm. The processing method uses weighted subtractions between wavebands to extract absorption information caused by specific chromophores within skin tissue, mainly including hemoglobin and melanin. Based on the extracted absorption information of hemoglobin, we conduct real-time monitoring experiments in the skin to measure heart rate and to observe skin activities during a vascular occlusion event. Compared with expensive hyperspectral imaging systems, the smartphone-based system delivers similar results but with very-high imaging resolution. Besides, it is easy to operate, very cost-effective and has a wider customer base. The use of an unmodified smartphone to realize hyperspectral imaging promises a possibility to bring a hyperspectral analysis of skin out from laboratory and clinical wards to daily life, which may also impact on healthcare in low resource settings and rural areas.

[1]  Elena Salomatina,et al.  Optical properties of normal and cancerous human skin in the visible and near-infrared spectral range. , 2006, Journal of biomedical optics.

[2]  Kristen M. Kelly,et al.  Separating melanin from hemodynamics in nevi using multimode hyperspectral dermoscopy and spatial frequency domain spectroscopy , 2016, Journal of Biomedical Optics.

[3]  L. Timares,et al.  MC1R, Eumelanin and Pheomelanin: Their Role in Determining the Susceptibility to Skin Cancer , 2015, Photochemistry and photobiology.

[4]  Janis Spigulis,et al.  Clinical evaluation of melanomas and common nevi by spectral imaging , 2012, Biomedical optics express.

[5]  Hao Li,et al.  Bayer Filter Snapshot Hyperspectral Fundus Camera for Human Retinal Imaging , 2017, Current eye research.

[6]  Ana Rita Matias,et al.  Skin colour, skin redness and melanin biometric measurements: comparison study between Antera® 3D, Mexameter® and Colorimeter® , 2015, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[7]  Hui-Liang Shen,et al.  Improved reflectance reconstruction for multispectral imaging by combining different techniques. , 2007, Optics express.

[8]  F. Linming,et al.  Comparison of two skin imaging analysis instruments: The VISIA® from Canfield vs the ANTERA 3D®CS from Miravex , 2018, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[9]  Giyoung Kim,et al.  Non-Destructive Quality Evaluation of Pepper (Capsicum annuum L.) Seeds Using LED-Induced Hyperspectral Reflectance Imaging , 2014, Sensors.

[10]  Bengisu Tulu,et al.  Smartphone-Based Wound Assessment System for Patients With Diabetes , 2015, IEEE Transactions on Biomedical Engineering.

[11]  Elizabeth Chao,et al.  Smartphone-Based Applications for Skin Monitoring and Melanoma Detection. , 2017, Dermatologic clinics.

[12]  Janis Spigulis,et al.  Multi-spectral mapping of in vivo skin hemoglobin and melanin , 2010, Photonics Europe.

[13]  Carolina Blanch,et al.  A tiny VIS-NIR snapshot multispectral camera , 2015, Photonics West - Optoelectronic Materials and Devices.

[14]  Liang Gao,et al.  Snapshot hyperspectral retinal camera with the Image Mapping Spectrometer (IMS) , 2011, Biomedical optics express.

[15]  P. Séroul,et al.  SpectraCam®: A new polarized hyperspectral imaging system for repeatable and reproducible in vivo skin quantification of melanin, total hemoglobin, and oxygen saturation , 2018, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[16]  Izumi Nishidate,et al.  Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method , 2013, Sensors.

[17]  Hui-Liang Shen,et al.  Spectral characterization of a color scanner based on optimized adaptive estimation. , 2006, Journal of the Optical Society of America. A, Optics, image science, and vision.

[18]  M Ichihashi,et al.  Facial skin photo‐aging and development of hyperpigmented spots from children to middle‐aged Japanese woman , 2017, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[19]  Domenico Alfieri,et al.  Spectral morphological analysis of skin lesions with a polarization multispectral dermoscope. , 2013, Optics express.

[20]  A. Rademaker,et al.  Digital dermoscopy to determine skin melanin index as an objective indicator of skin pigmentation , 2016 .

[21]  Meritxell Vilaseca,et al.  Multispectral imaging system based on light-emitting diodes for the detection of melanomas and basal cell carcinomas: a pilot study , 2017, Journal of biomedical optics.

[22]  Quan Liu,et al.  Modified Wiener estimation of diffuse reflectance spectra from RGB values by the synthesis of new colors for tissue measurements. , 2012, Journal of biomedical optics.

[23]  Efthimios Kaxiras,et al.  Melanin absorption spectroscopy: new method for noninvasive skin investigation and melanoma detection. , 2008, Journal of biomedical optics.

[24]  Zohn Rosen,et al.  Validation of photoplethysmography as a method to detect heart rate during rest and exercise , 2015, Journal of medical engineering & technology.

[25]  Igor Meglinski,et al.  Hyperspectral imaging of human skin aided by artificial neural networks. , 2019, Biomedical optics express.

[26]  Xiaoyu Cui,et al.  Stepwise method based on Wiener estimation for spectral reconstruction in spectroscopic Raman imaging. , 2017, Optics express.

[27]  Qiyin Fang,et al.  Hyperspectral Imaging and Classification for Grading Skin Erythema , 2018, Front. Phys..

[28]  Pierre Gouton,et al.  High Dynamic Range Spectral Imaging Pipeline For Multispectral Filter Array Cameras , 2017, Sensors.

[29]  Janis Spigulis,et al.  Smartphone snapshot mapping of skin chromophores under triple-wavelength laser illumination , 2017, Journal of biomedical optics.

[30]  S. Monstrey,et al.  The foot fillet flap for ischial pressure sore reconstruction: A new indication. , 2018, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[31]  Shengxu Li,et al.  Association between Inflammation and Biological Variation in Hemoglobin A1c in U.S. Nondiabetic Adults. , 2015, The Journal of clinical endocrinology and metabolism.

[32]  Boreom Lee,et al.  Smartphone-based multispectral imaging: system development and potential for mobile skin diagnosis. , 2016, Biomedical optics express.

[33]  Wolfgang Petrich,et al.  Quantum cascade laser–based hyperspectral imaging of biological tissue , 2014, Journal of biomedical optics.

[34]  Dirk Schadendorf,et al.  Metastatic status of sentinel lymph nodes in melanoma determined noninvasively with multispectral optoacoustic imaging , 2015, Science Translational Medicine.

[35]  Daniel W. Wilson,et al.  Snapshot hyperspectral imaging in ophthalmology. , 2007, Journal of biomedical optics.

[36]  F. Silver,et al.  Acute ischemic stroke and abnormal blood hemoglobin concentration , 2016, Acta neurologica Scandinavica.

[37]  Herke Jan Noordmans,et al.  Non-contact tissue perfusion and oxygenation imaging using a LED based multispectral and a thermal imaging system, first results of clinical intervention studies , 2013, Photonics West - Biomedical Optics.