Using hybrid approaches to solve the challenges of shape from shading

For over thirty years researchers have been trying to solve the shape from shading problem of determining 3D shape from a single image with a single light source. The basic problem of determining shape from shading is made more difficult due to challenges of light orientation, camera type, ambiguity, multiple materials, and specular highlights. This paper shows how some of these challenges can be overcome through the use of other techniques such as image segmentation and stereopsis. We present a new hybrid method of shape from shading that can be used to autonomously capture 3D information from two 2D images of single objects with multiple peaks and multiple materials with specular components.

[1]  J.P. Lavelle,et al.  High speed 3D scanner with real-time 3D processing , 2004, ISA/IEEE Sensors for Industry Conference, 2004. Proceedings the.

[2]  Berthold K. P. Horn.  Height and gradient from shading , 1989, International Journal of Computer Vision.

[3]  J. Oliensis,et al.  Shape from shading as a partially well-constrained problem , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[5]  Nikos Paragios,et al.  Handbook of Mathematical Models in Computer Vision , 2005 .

[6]  Paul E. Debevec.  FACADE: modeling and rendering architecture from photographs and the campanile model , 1997, SIGGRAPH '97.

[7]  Holger Lange,et al.  Advances in the cooperation of shape from shading and stereo vision , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[8]  T. Poggio,et al.  The analysis of stereopsis. , 1984, Annual review of neuroscience.

[9]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[10]  Richard Szeliski,et al.  Impossible Shaded Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[12]  Stefano Soatto,et al.  Fast Marching Method for Generic Shape from Shading , 2005, VLSM.

[13]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[14]  Marc Levoy,et al.  The digital Michelangelo project: 3D scanning of large statues , 2000, SIGGRAPH.

[15]  Jean-Denis Durou,et al.  A Survey of Numerical Methods for Shape from Shading , 2004 .

[16]  Gabriel Oliver,et al.  Shape from shading for multiple albedo images , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[17]  Tetsuo Asano,et al.  Polynomial-time solutions to image segmentation , 1996, SODA '96.

[18]  Song Zhang,et al.  High-Resolution, Real-time 3D Shape Acquisition , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[19]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[20]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[22]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Ryszard Kozera.  An Overview of the shape-from-shading problem , 1998 .

[24]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[25]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[26]  Bui Tuong Phong.  Illuminat~on for computer generated images , 1973 .

[27]  Shiu Yin Yuen,et al.  FAST MARCHING METHOD FOR SHAPE FROM SHADING UNDER PERSPECTIVE PROJECTION , 2002 .

[28]  Olivier D. Faugeras,et al.  "Perspective shape from shading" and viscosity solutions , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[29]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[30]  Hideo Saito,et al.  A divide-and-conquer strategy in shape from shading problem , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Harry Shum,et al.  Interactive shape from shading , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).