In vivo measurement of skin microrelief using photometric stereo in the presence of interreflections.

This paper proposes and describes an implementation of a photometric stereo-based technique for in vivo assessment of three-dimensional (3D) skin topography in the presence of interreflections. The proposed method illuminates skin with red, green, and blue colored lights and uses the resulting variation in surface gradients to mitigate the effects of interreflections. Experiments were carried out on Caucasian, Asian, and African American subjects to demonstrate the accuracy of our method and to validate the measurements produced by our system. Our method produced significant improvement in 3D surface reconstruction for all Caucasian, Asian, and African American skin types. The results also illustrate the differences in recovered skin topography due to the nondiffuse bidirectional reflectance distribution function (BRDF) for each color illumination used, which also concur with the existing multispectral BRDF data available for skin.

[1]  Thomas Malzbender,et al.  Surface enhancement using real-time photometric stereo and reflectance transformation , 2006, EGSR '06.

[2]  Melvyn L. Smith,et al.  3D face reconstructions from photometric stereo using near infrared and visible light , 2010, Comput. Vis. Image Underst..

[3]  D Black,et al.  Skin topography measurement by interference fringe projection: a technical validation , 2001, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[4]  JaeGuyn Lim,et al.  Color correction with edge preserving and minimal SNR decrease using multi-layer decomposition , 2012, Electronic Imaging.

[5]  Kristin J. Dana.  BRDF/BTF measurement device , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[6]  J. Lévêque,et al.  Longitudinal study of skin aging: from microrelief to wrinkles , 2011, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[7]  Barker De,et al.  Skin thickness in the human. , 1951 .

[8]  D E BARKER,et al.  SKIN THICKNESS IN THE HUMAN , 1951, Plastic and reconstructive surgery.

[9]  Robert J. Woodham,et al.  Photometric Stereo: A Reflectance Map Technique For Determining Surface Orientation From Image Intensity , 1979, Optics & Photonics.

[10]  Andrew W. Fitzgibbon,et al.  BRDF and geometry capture from extended inhomogeneous samples using flash photography , 2005, Comput. Graph. Forum.

[11]  Y. Lee,et al.  Skin thickness of Korean adults , 2002, Surgical and Radiologic Anatomy.

[12]  Hans-Peter Seidel,et al.  Mesostructure from Specularity , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Junyu Dong,et al.  Estimating parameters of an illumination model for the synthesis of specular surface textures , 2004, The Fourth International Conference onComputer and Information Technology, 2004. CIT '04..

[14]  Melvyn L. Smith,et al.  Dynamic photometric stereo for on line quality control of ceramic tiles , 2005, Comput. Ind..

[15]  Miao Liao,et al.  Interreflection removal for photometric stereo by using spectrum-dependent albedo , 2011, CVPR 2011.

[16]  Gladimir V. G. Baranoski,et al.  A Biophysically‐Based Spectral Model of Light Interaction with Human Skin , 2004, Comput. Graph. Forum.

[17]  Elli Angelopoulou,et al.  The Reflectance Spectrum of Human Skin , 1999 .

[18]  Lyndon Smith,et al.  Reflectance of human skin using colour photometric stereo: with particular application to pigmented lesion analysis , 2008, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[19]  M Setaro,et al.  Irregularity skin index (ISI): a tool to evaluate skin surface texture , 2001, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[20]  H R Chaudhry,et al.  Noninvasive light-reflection technique for measuring soft-tissue stretch. , 1999, Applied optics.

[21]  Hideo Saito,et al.  3D reconstruction of skin surface from photometric stereo images with specular reflection and interreflection , 1999 .

[22]  Peter D. Burns,et al.  ANALYSIS OF IMAGE NOISE IN MULTISPECTRAL COLOR ACQUISITION , 1997 .

[23]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Shree K. Nayar,et al.  Reflectance and texture of real-world surfaces , 1999, TOGS.

[25]  Andrew Zisserman,et al.  Mutual Illumination , 2014, Computer Vision, A Reference Guide.

[26]  Ron Gershon,et al.  Measurement and Analysis of Object Reflectance Spectra , 1994 .

[27]  Takeo Kanade,et al.  Shape from interreflections , 2004, International Journal of Computer Vision.

[28]  Steve Marschner,et al.  Image-Based BRDF Measurement Including Human Skin , 1999, Rendering Techniques.

[29]  A. P. Ivanov,et al.  Absorption spectra and light penetration depth of normal and pathologically altered human skin , 2007 .

[30]  Junyu Dong,et al.  Relations between Surface Gradient Maps in Frequency Domain and Application in Diffuse Component Detection , 2009, 2009 WRI Global Congress on Intelligent Systems.

[31]  R. Anderson,et al.  The optics of human skin. , 1981, The Journal of investigative dermatology.

[32]  Hideo Saito,et al.  3D Reconstruction of Skin Surface from Image Sequence , 1998, MVA.

[33]  Paul M Friedman,et al.  3D In‐Vivo Optical Skin Imaging for Topographical Quantitative Assessment of Non‐Ablative Laser Technology , 2002, Dermatologic surgery : official publication for American Society for Dermatologic Surgery [et al.].

[34]  Daniel Snow,et al.  Determining Generative Models of Objects Under Varying Illumination: Shape and Albedo from Multiple Images Using SVD and Integrability , 1999, International Journal of Computer Vision.

[35]  E. Middelkoop,et al.  An objective device for measuring surface roughness of skin and scars. , 2011, Journal of the American Academy of Dermatology.

[36]  R. Geronemus,et al.  Successful treatment of atrophic postoperative and traumatic scarring with carbon dioxide ablative fractional resurfacing: quantitative volumetric scar improvement. , 2010, Archives of dermatology.

[37]  A. N. Bashkatov,et al.  Optical properties of human skin, subcutaneous and mucous tissues in the wavelength range from 400 to 2000 nm , 2005 .

[38]  Edward H. Adelson,et al.  Microgeometry capture using an elastomeric sensor , 2011, SIGGRAPH 2011.

[39]  David J. Kriegman,et al.  Reflections on the generalized bas-relief ambiguity , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[40]  Sören Jaspers,et al.  Rapid in vivo measurement of the topography of human skin by active image triangulation using a digital micromirror device , 1999 .

[41]  Bradley M. Koch.  A Multispectral Bidirectional Reflectance Distribution Function Study of Human Skin for Improved Dismount Detection , 2012 .

[42]  Yu Zhou,et al.  Combinatorial photometric stereo and its application in 3D modeling of melanoma , 2011, Machine Vision and Applications.

[43]  Melvyn L. Smith,et al.  Dynamic photometric stereo - a new technique for moving surface analysis , 2005, Image Vis. Comput..

[44]  T Fujimura,et al.  Global and systematic demonstration for the practical usage of a direct in vivo measurement system to evaluate wrinkles , 2007, International journal of cosmetic science.

[45]  Fu-Lung Hsueh,et al.  Crosstalk metrics and the characterization of 1 . 1 m-pixel CIS , 2011 .