Perspective shape-from-shading by fast marching

Shape-from-shading (SfS) is a fundamental problem in computer vision. At its basis lies the image irradiance equation. Recently, the authors proposed to base the image irradiance equation on the assumption of perspective projection rather than the common orthographic one. The current paper presents a greatly-improved reconstruction method based on the perspective formulation. The proposed model is solved efficiently via a modification of the fast marching method of Kimmel and Sethian. We compare the two versions of the fast marching method (orthographic vs. perspective) on medical images. The perspective algorithm outperformed the orthographic one. This shows that the more realistic hypothesis of perspective projection improves reconstruction significantly. The comparison also demonstrates the usability of perspective SfS for real-life applications such as medical endoscopy.

[1]  Dimitris N. Metaxas,et al.  Coupled lighting direction and shape estimation from single images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[2]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[3]  Olivier D. Faugeras,et al.  "Perspective shape from shading" and viscosity solutions , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Mubarak Shah,et al.  Shape from shading using linear approximation , 1994, Image Vis. Comput..

[6]  Hideo Saito,et al.  A divide-and-conquer strategy in shape from shading problem , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Yehezkel Yeshurun,et al.  A new perspective [on] shape-from-shading , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[8]  Antonio Robles-Kelly,et al.  Model Acquisition Using Shape-from-Shading , 2002, AMDO.

[9]  C.-C. Jay Kuo,et al.  Shape from Shading with a Generalized Reflectance Map Model , 1997, Comput. Vis. Image Underst..

[10]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[11]  Michael A. Penna,et al.  A Shape From Shading Analysis for a Single Perspective Image of a Polyhedron , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Aly A. Farag,et al.  Robust 3D reconstruction system for human jaw modeling , 1999, Electronic Imaging.

[14]  Alfred M. Bruckstein,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[15]  Aly A. Farag,et al.  A Robust 3-D Reconstruction System for Human Jaw Modeling , 1999, MICCAI.

[16]  C.-C. Jay Kuo,et al.  Shape from Shading with a Linear Triangular Element Surface Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[18]  Berthold K. P. Horn.  Image Intensity Understanding , 1975 .

[19]  P. Dupuis,et al.  An Optimal Control Formulation and Related Numerical Methods for a Problem in Shape Reconstruction , 1994 .

[20]  Rama Chellappa,et al.  Illumination-insensitive face recognition using symmetric shape-from-shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Alex Pentland,et al.  A simple algorithm for shape from shading , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Berthold K. P. Horn.  Understanding Image Intensities , 1977, Artif. Intell..

[24]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[25]  Olivier D. Faugeras,et al.  Shape from Shading and Viscosity Solutions , 2002, ECCV.

[26]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[27]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..