"Perspective shape from shading" and viscosity solutions

This article proposes a solution of the Lambertian shape from shading (SFS) problem in the case of a pinhole camera model (performing a perspective projection). Our approach is based upon the notion of viscosity solutions of Hamilton-Jacobi equations. This approach allows us to naturally deal with nonsmooth solutions and provides a mathematical framework for proving correctness of our algorithms. Our work extends previous work in the area in three aspects. First, it models the camera as a pinhole whereas most authors assume an orthographic projection, thereby extending the applicability of shape from shading methods to more realistic images. In particular it extends the work of E. Prados et al. (2002) and E. Rouy et al. (1992). Second, by adapting the brightness equation to the perspective problem, we obtain a new partial differential equation (PDE). Results about the existence and uniqueness of its solution are also obtained. Third, it allows us to come up with a new approximation scheme and a new algorithm for computing numerical approximations of the "continuous" solution as well as a proof of their convergence toward that solution.

[1]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[2]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[3]  Richard Szeliski,et al.  Impossible Shaded Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Henri Maître,et al.  On convergence in the methods of Strat and of Smith for Shape from Shading , 1996, International Journal of Computer Vision.

[5]  Michael A. Penna,et al.  A Shape From Shading Analysis for a Single Perspective Image of a Polyhedron , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Wojciech Chojnacki,et al.  Shading without shape , 1992 .

[7]  Maurizio Falcone,et al.  A scheme for the shape-from-shading model with “black shadows” , 2003 .

[8]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[9]  Anna R. Bruss The Eikonal equation: some results applicable to computer vision , 1982 .

[10]  Aly A. Farag,et al.  A system for human jaw modeling using intra-oral images , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[11]  Clésio Luiz Tozzi,et al.  Shape from shading with perspective projection and camera calibration , 1996, Comput. Graph..

[12]  Pierpaolo Soravia Optimal control with discontinuous running cost: Eikonal equation and shape-from-shading , 2000, Proceedings of the 39th IEEE Conference on Decision and Control (Cat. No.00CH37187).

[13]  Daniel N. Ostrov,et al.  Numerical Shape-From-Shading for Discontinuous Photographic Images , 2001, International Journal of Computer Vision.

[14]  P. Lions,et al.  Shape-from-shading, viscosity solutions and edges , 1993 .

[15]  P. Dupuis,et al.  An Optimal Control Formulation and Related Numerical Methods for a Problem in Shape Reconstruction , 1994 .

[16]  P. Lions,et al.  User’s guide to viscosity solutions of second order partial differential equations , 1992, math/9207212.

[17]  Michael A. Penna,et al.  Local and semi-local shape from shading for a single perspective image of a smooth object , 1989, Comput. Vis. Graph. Image Process..

[18]  M. Bardi,et al.  Optimal Control and Viscosity Solutions of Hamilton-Jacobi-Bellman Equations , 1997 .

[19]  P. Lions Generalized Solutions of Hamilton-Jacobi Equations , 1982 .

[20]  Ryszard Kozera An Overview of the shape-from-shading problem , 1998 .

[21]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[22]  Jean-Denis Durou,et al.  Ambiguous Shape from Shading with Critical Points , 2004, Journal of Mathematical Imaging and Vision.

[23]  G. Barles Solutions de viscosité des équations de Hamilton-Jacobi , 1994 .

[24]  Olivier D. Faugeras,et al.  Shape from Shading and Viscosity Solutions , 2002, ECCV.

[25]  Kyoung Mu Lee,et al.  Shape from Shading with Perspective Projection , 1994 .

[26]  Olivier Faugeras,et al.  A mathematical and algorithmic study of the Lambertian SFS problem for orthographic and pinhole cameras , 2003 .

[27]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..