Shape-from-Shading for Oblique Lighting with Accuracy Enhancement by Light Direction Optimization

We present a shape-from-shading approach for oblique lighting with accuracy enhancement by light direction optimization. Based on an application of the Jacobi iterative method to the consistency between the reflectance map and image, four surface normal approximations are introduced and the resulting four iterative relations are combined as constraints to get an iterative relation. The matrix that converts the shading information to the depth is modified so as to be uniform over the whole image region, making the iteration stable and, as a result, the resulting shape more accurate. Then, to enhance the accuracy, the light direction is optimized for slant angle using two criteria based on the initial boundary value and the rank of the converting matrix. The method is examined using synthetic and real images to show that it is superior to the current state-of-the-art methods and that it is effective for oblique light direction whose slant angle ranges from 55 to 75 degrees.

[1]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[2]  Olivier D. Faugeras,et al.  Shape from shading: a well-posed problem? , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Olivier Faugeras,et al.  A viscosity method for Shape-from-Shading without boundary data , 2004 .

[4]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[5]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[6]  Edwin R. Hancock,et al.  New Constraints on Data-Closeness and Needle Map Consistency for Shape-from-Shading , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Peter H. Tu,et al.  Surface reconstruction via Helmholtz reciprocity with a single image pair , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[8]  Dimitris N. Metaxas,et al.  Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jean-Denis Durou,et al.  A Survey of Numerical Methods for Shape from Shading , 2004 .

[10]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Dimitris N. Metaxas,et al.  Shape and Nonrigid Motion Estimation Through Physics-Based Synthesis , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, CVPR 2004.

[13]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[14]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Olivier D. Faugeras,et al.  Shape from Shading and Viscosity Solutions , 2002, ECCV.

[16]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[18]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.