Evaluating the effect of diffuse light on photometric stereo reconstruction

Photometric stereo surface reconstruction requires each input image to be associated with a particular 3D illumination vector. This signifies that the subject should be illuminated in turn by various directional illumination sources. In real life, this directionality may be reduced by ambient illumination, which is typically present as a diffuse component of the incident light. This work assesses the photometric stereo reconstruction quality for various ratios of ambient to directional illuminance and provides a reference for the robustness of photometric stereo with respect to that illuminance ratio. In our analysis, we focus on the face reconstruction application of photometric stereo, as faces are convex objects with rich surface variation, thus providing a suitable platform for photometric stereo reconstruction quality evaluation. Results demonstrate that photometric stereo renders realistic reconstructions of the given surface for ambient illuminance as high as nine times the illuminance of the directional light component.

[1]  Jules S. Jaffe,et al.  Computer modeling and the design of optimal underwater imaging systems , 1990 .

[2]  Maria Petrou,et al.  Chapter 1 Photometric Stereo: An Overview , 2009 .

[3]  Maria Petrou,et al.  Photometric stereo: an overview , 2008 .

[4]  Maria Petrou,et al.  Recursive photometric stereo when multiple shadows and highlights are present , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Roberto Cipolla,et al.  A Practical Method for Estimation of Point Light-Sources , 2001, BMVC.

[6]  Ravi Ramamoorthi,et al.  A theory of differential photometric stereo for unknown isotropic BRDFs , 2011, CVPR 2011.

[7]  Shree K. Nayar,et al.  Structured light in scattering media , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[8]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Roberto Cipolla,et al.  Overcoming Shadows in 3-Source Photometric Stereo , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Shree K. Nayar,et al.  Contrast Restoration of Weather Degraded Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Steven M. Seitz,et al.  Example-based photometric stereo: shape reconstruction with general, varying BRDFs , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Atsuto Maki,et al.  Difference Sphere: An Approach to Near Light Source Estimation , 2004, CVPR.

[13]  A. Cantor.  Optics of the atmosphere--Scattering by molecules and particles , 1978, IEEE Journal of Quantum Electronics.

[14]  Wei Zhou,et al.  Estimation of Illuminant Direction and Intensity of Multiple Light Sources , 2002, ECCV.

[15]  Nahum Kiryati,et al.  Photometric stereo under perspective projection , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[16]  Roberto Cipolla,et al.  Multiview Photometric Stereo , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Xiaoou Tang,et al.  Single Image Haze Removal Using Dark Channel Prior , 2011 .

[18]  David J. Kriegman,et al.  A Planar Light Probe , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Maria Petrou,et al.  Baseline face recognition using photometric stereo data , 2010, Biometrics Technology.

[20]  Yasuyuki Matsushita,et al.  A hand-held photometric stereo camera for 3-D modeling , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  Mike Brookes,et al.  Multiple light source detection , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Miao Liao,et al.  Interreflection removal for photometric stereo by using spectrum-dependent albedo , 2011, CVPR 2011.

[23]  Li Zhang,et al.  Shape and motion under varying illumination: unifying structure from motion, photometric stereo, and multiview stereo , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[24]  Andrew Blake,et al.  Towards a complete dense geometric and photometric reconstruction under varying pose and illumination , 2004, Image Vis. Comput..

[25]  Robert J. Woodham,et al.  Photometric method for determining surface orientation from multiple images , 1980 .

[26]  Maria Petrou,et al.  Image Processing: The Fundamentals: Petrou/Image Processing: The Fundamentals , 2010 .

[27]  M. Giavalisco,et al.  A Deep Wide-Field, Optical, and Near-Infrared Catalog of a Large Area around the Hubble Deep Field North , 2003, astro-ph/0312635.

[28]  Ronen Basri,et al.  Photometric stereo with general, unknown lighting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[29]  Shree K. Nayar,et al.  Vision and the Atmosphere , 2002, International Journal of Computer Vision.

[30]  Jovan Popović,et al.  Dynamic shape capture using multi-view photometric stereo , 2009, SIGGRAPH 2009.

[31]  David J. Kriegman,et al.  Passive photometric stereo from motion , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[32]  Katsushi Ikeuchi,et al.  Light source position and reflectance estimation from a single view without the distant illumination assumption , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  John P. Oakley,et al.  Improving image quality in poor visibility conditions using a physical model for contrast degradation , 1998, IEEE Trans. Image Process..

[34]  Rama Chellappa,et al.  Appearance Characterization of Linear Lambertian Objects, Generalized Photometric Stereo, and Illumination-Invariant Face Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Paul Debevec.  Rendering synthetic objects into real scenes: bridging traditional and image-based graphics with global illumination and high dynamic range photography , 2008, SIGGRAPH Classes.

[36]  M. S. Sudhakar,et al.  Underwater Image Enhancement and Edge Detection , 2015 .

[37]  Maria Petrou,et al.  The 4-Source Photometric Stereo Technique for Three-Dimensional Surfaces in the Presence of Highlights and Shadows , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Maria Petrou,et al.  Image processing - the fundamentals , 1999 .

[39]  Melvyn L. Smith,et al.  3D face reconstructions from photometric stereo using near infrared and visible light , 2010, Comput. Vis. Image Underst..

[40]  Raanan Fattal,et al.  Single image dehazing , 2008, ACM Trans. Graph..

[41]  Björn Stenger,et al.  Non-rigid Photometric Stereo with Colored Lights , 2007, 2007 IEEE 11th International Conference on Computer Vision.