An Evaluation Framework for Spectral Filter Array Cameras to Optimize Skin Diagnosis

Comparing and selecting an adequate spectral filter array (SFA) camera is application-specific and usually requires extensive prior measurements. An evaluation framework for SFA cameras is proposed and three cameras are tested in the context of skin analysis. The proposed framework does not require application-specific measurements and spectral sensitivities together with the number of bands are the main focus. An optical model of skin is used to generate a specialized training set to improve spectral reconstruction. The quantitative comparison of the cameras is based on reconstruction of measured skin spectra, colorimetric accuracy, and oxygenation level estimation differences. Specific spectral sensitivity shapes influence the results directly and a 9-channel camera performed best regarding the spectral reconstruction metrics. Sensitivities at key wavelengths influence the performance of oxygenation level estimation the strongest. The proposed framework allows to compare spectral filter array cameras and can guide their application-specific development.

[1]  Diego Gutierrez,et al.  A Biophysically‐Based Model of the Optical Properties of Skin Aging , 2015, Comput. Graph. Forum.

[2]  Wesley E. Snyder,et al.  Binary Tree-based Generic Demosaicking Algorithm for Multispectral Filter Arrays , 2006, IEEE Transactions on Image Processing.

[3]  Antonis A. Argyros,et al.  A Novel Hyper-Spectral Imaging System : Application on in-vivo Detection and Grading of Cervical Precancers and of Pigmented Skin Lesions , 2001 .

[4]  Jon Y. Hardeberg,et al.  Full-Reference Image Quality Metrics: Classification and Evaluation , 2012, Found. Trends Comput. Graph. Vis..

[5]  Janis Spigulis,et al.  RGB IMAGING DEVICE FOR MAPPING AND MONITORING OF HEMOGLOBIN DISTRIBUTION IN SKIN , 2012 .

[6]  Ela Claridge,et al.  Spectral filter optimization for the recovery of parameters which describe human skin , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Diego Gutierrez,et al.  A practical appearance model for dynamic facial color , 2010, ACM Trans. Graph..

[8]  Pierre Gouton,et al.  High Dynamic Range Spectral Imaging Pipeline For Multispectral Filter Array Cameras , 2017, Sensors.

[9]  Janis Spigulis,et al.  Towards noncontact skin melanoma selection by multispectral imaging analysis. , 2011, Journal of biomedical optics.

[10]  Noriyuki Shimano,et al.  Recovery of spectral reflectances of imaged objects by the use of features of spectral reflectances. , 2010, Journal of the Optical Society of America. A, Optics, image science, and vision.

[11]  M. Hauta-Kasari,et al.  Wiener estimation method in estimating of spectral reflectance from RGB images , 2007, Pattern Recognition and Image Analysis.

[12]  Jon Yngve Hardeberg,et al.  Illuminant estimation in multispectral imaging. , 2017, Journal of the Optical Society of America. A, Optics, image science, and vision.

[13]  Marcus Larsson,et al.  Spatial and temporal skin blood volume and saturation estimation using a multispectral snapshot imaging camera , 2017, BiOS.

[14]  David W Allen,et al.  Reference Data Set of Human Skin Reflectance. , 2017, Journal of research of the National Institute of Standards and Technology.

[15]  John P. Kerekes,et al.  Spectral imaging of skin: experimental observations and analyses , 2006, SPIE Medical Imaging.

[16]  Jiwei Huang.  Multispectral Imaging of Skin Oxygenation , 2012 .

[17]  Janis Spigulis,et al.  RGB imaging system for monitoring of skin vascular malformation's laser therapy , 2012, Photonics Europe.

[18]  J. A. Delgado Atencio,et al.  Monte Carlo Modeling of Light Propagation in Neonatal Skin , 2011 .

[19]  Noriyuki Shimano,et al.  Recovery of spectral reflectances of objects being imaged by multispectral cameras. , 2007, Journal of the Optical Society of America. A, Optics, image science, and vision.

[20]  Norimichi Tsumura,et al.  Mapping Pigmentation in Human Skin by Multi-Visible-Spectral Imaging by Inverse Optical Scattering Technique , 2000, Color Imaging Conference.

[21]  T. Yuasa,et al.  Noninvasive imaging of human skin hemodynamics using a digital red-green-blue camera. , 2011, Journal of biomedical optics.

[22]  Pierre Gouton,et al.  Spectral Characterization of a Prototype SFA Camera for Joint Visible and NIR Acquisition , 2016, Sensors.

[23]  E. Claridge,et al.  A skin imaging method based on a colour formation model and its application to the diagnosis of pigmented skin lesions , 2002 .

[24]  Moon Gi Kang,et al.  Color Restoration of RGBN Multispectral Filter Array Sensor Images Based on Spectral Decomposition , 2016, Sensors.

[25]  Masatoshi Okutomi,et al.  Multispectral demosaicking using adaptive kernel upsampling , 2011, 2011 18th IEEE International Conference on Image Processing.

[26]  Herke Jan Noordmans,et al.  Non-invasive skin oxygenation imaging using a multi-spectral camera system: effectiveness of various concentration algorithms applied on human skin , 2009, BiOS.

[27]  Pierre Gouton,et al.  Multispectral Filter Arrays: Recent Advances and Practical Implementation , 2014, Sensors.

[28]  Lise L. Randeberg,et al.  Hyperspectral imaging of bruised skin , 2006, SPIE BiOS.

[29]  Andrea Murray,et al.  Pilot study to visualise and measure skin tissue oxygenation, erythema, total haemoglobin and melanin content using index maps in healthy controls , 2014, Photonics West - Biomedical Optics.

[30]  Reiner Lenz,et al.  Evaluation and unification of some methods for estimating reflectance spectra from RGB images. , 2008, Journal of the Optical Society of America. A, Optics, image science, and vision.

[31]  Janis Spigulis,et al.  Multi-spectral skin imaging by a consumer photo-camera , 2010, BiOS.

[32]  D. Chandler.  Seven Challenges in Image Quality Assessment: Past, Present, and Future Research , 2013 .

[33]  T. Ward,et al.  A CMOS Camera-Based Pulse Oximetry Imaging System , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[34]  Herke Jan Noordmans,et al.  Towards real-time non contact spatial resolved oxygenation monitoring using a multi spectral filter array camera in various light conditions , 2018, BiOS.

[35]  Dingrong Yi,et al.  Single sensor that outputs narrowband multispectral images. , 2010, Journal of biomedical optics.

[36]  Jon Yngve Hardeberg,et al.  A Spectral Filter Array Camera for Clinical Monitoring and Diagnosis: Proof of Concept for Skin Oxygenation Imaging , 2019, J. Imaging.

[37]  Izumi Nishidate,et al.  Estimation of Melanin and Hemoglobin Using Spectral Reflectance Images Reconstructed from a Digital RGB Image by the Wiener Estimation Method , 2013, Sensors.

[38]  Sander Stuijk,et al.  New principle for measuring arterial blood oxygenation, enabling motion-robust remote monitoring , 2016, Scientific Reports.

[39]  Jon Yngve Hardeberg,et al.  Skin color simulation - Review and analysis of available Monte Carlo-based photon transport simulation models , 2017, CIC 2017.

[40]  Yassine Ruichek,et al.  Energy balance in Spectral Filter Array camera design , 2017, Journal of the European Optical Society-Rapid Publications.

[41]  Jean-Baptiste Thomas,et al.  Illuminant estimation from uncalibrated multispectral images , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[42]  Mina Rafi Nazari.  Denoising and Demosaicking of Color Images , 2017 .

[43]  Atam P. Dhawan,et al.  Multi-spectral optical imaging of skin to diagnose malignant melanoma , 1999, Proceedings of the First Joint BMES/EMBS Conference. 1999 IEEE Engineering in Medicine and Biology 21st Annual Conference and the 1999 Annual Fall Meeting of the Biomedical Engineering Society (Cat. N.

[44]  Lise L. Randeberg,et al.  Optical classification of bruises , 2004, SPIE BiOS.

[45]  Jon Yngve Hardeberg,et al.  Multispectral imaging: narrow or wide band filters? , 2014 .

[46]  Congcong Wang,et al.  A Linear Interpolation Algorithm for Spectral Filter Array Demosaicking , 2014, ICISP.

[47]  Olga M. Conde,et al.  Custom Scanning Hyperspectral Imaging System for Biomedical Applications: Modeling, Benchmarking, and Specifications , 2019, Sensors.

[48]  Janis Spigulis,et al.  Smartphone snapshot mapping of skin chromophores under triple-wavelength laser illumination , 2017, Journal of biomedical optics.

[49]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[50]  Anthony J. Durkin,et al.  Method using in vivo quantitative spectroscopy to guide design and optimization of low-cost, compact clinical imaging devices: emulation and evaluation of multispectral imaging systems , 2018, Journal of biomedical optics.

[51]  Roy S. Berns,et al.  Spectral Estimation Using Trichromatic Digital Cameras , 1999 .

[52]  Jon Yngve Hardeberg,et al.  A Study on the Impact of Spectral Characteristics of Filters on Multispectral Image Acquisition , 2013 .