Perspective Shape from Shading: Ambiguity Analysis and Numerical Approximations

In this paper we study a perspective model for shape from shading and its numerical approximation. We show that an ambiguity still persists, although the model with light attenuation factor has previously been shown to be well-posed under appropriate assumptions. Analytical results revealing the ambiguity are complemented by various numerical tests. Moreover, we present convergence results for two iterative approximation schemes. The first is based on a finite difference discretization, whereas the second is based on a semi-Lagrangian discretization. The convergence results are obtained in the general framework of viscosity solutions of the underlying partial differential equation. In addition to these theoretical and numerical results, we propose an algorithm for reconstructing discontinuous surfaces, making it possible to obtain results of reasonable quality even for complex scenes. To this end, we solve the constituting equation on a previously segmented input image, using state constraint boundary conditions at the segment borders.

[1]  G. Barles.  Solutions de viscosité des équations de Hamilton-Jacobi , 1994 .

[2]  Yehezkel Yeshurun,et al.  A new perspective [on] shape-from-shading , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[3]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[4]  Michael Breuß,et al.  The Implicit Upwind Method for 1-D Scalar Conservation Laws with Continuous Fluxes , 2005, SIAM J. Numer. Anal..

[5]  Olivier D. Faugeras,et al.  A Unifying and Rigorous Shape from Shading Method Adapted to Realistic Data and Applications , 2006, Journal of Mathematical Imaging and Vision.

[6]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[7]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[8]  Pierre Gurdjos,et al.  Shape from shading for the digitization of curved documents , 2007, Machine Vision and Applications.

[9]  Jean-Denis Durou,et al.  Ambiguous Shape from Shading with Critical Points , 2004, Journal of Mathematical Imaging and Vision.

[10]  Olivier D. Faugeras,et al.  A Generic and Provably Convergent Shape-from-Shading Method for Orthographic and Pinhole Cameras , 2005, International Journal of Computer Vision.

[11]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Andrew Blake,et al.  Surface descriptions from stereo and shading , 1986, Image Vis. Comput..

[13]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[14]  Michael Breuß,et al.  A Direct Numerical Approach to Perspective Shape-from-Shading , 2007, VMV.

[15]  Anna R. Bruss.  The Eikonal equation: some results applicable to computer vision , 1982 .

[16]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[17]  Olivier D. Faugeras,et al.  Unifying Approaches and Removing Unrealistic Assumptions in Shape from Shading: Mathematics Can Help , 2004, ECCV.

[18]  Lars Grüne,et al.  Numerical Approximation of the Maximal Solutions for a Class of Degenerate Hamilton-Jacobi Equations , 2000, SIAM J. Numer. Anal..

[19]  O. Faugeras,et al.  A VISCOSITY SOLUTION METHOD FOR SHAPE-FROM-SHADING WITHOUT IMAGE BOUNDARY DATA , 2006 .

[20]  Alfred M. Bruckstein,et al.  Shape from shading: Level set propagation and viscosity solutions , 1995, International Journal of Computer Vision.

[21]  Fabio Camilli,et al.  Viscosity Solution , 2014, Computer Vision, A Reference Guide.

[22]  Wojciech Chojnacki,et al.  Circularly symmetric eikonal equations and non-uniqueness in computer vision , 1992 .

[23]  Pierre Gurdjos,et al.  Towards shape from shading under realistic photographic conditions , 2004, ICPR 2004.

[24]  M. Falcone,et al.  Semi-Lagrangian Approximation Schemes for Linear and Hamilton-Jacobi Equations , 2014 .

[25]  Maurizio Falcone,et al.  Some Remarks on Perspective Shape-from-Shading Models , 2007, SSVM.

[26]  John Oliensis,et al.  Uniqueness in shape from shading , 1991, International Journal of Computer Vision.

[27]  Olivier D. Faugeras,et al.  "Perspective shape from shading" and viscosity solutions , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[28]  P. Dupuis,et al.  An Optimal Control Formulation and Related Numerical Methods for a Problem in Shape Reconstruction , 1994 .

[29]  P. Lions,et al.  Shape-from-shading, viscosity solutions and edges , 1993 .

[30]  K. Deguchi,et al.  Shape reconstruction from an endoscope image by shape-from-shading technique for a point light source at the projection center , 1996, Proceedings of the Workshop on Mathematical Methods in Biomedical Image Analysis.

[31]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[32]  Kewei Zhang,et al.  Instability of the eikonal equation and shape from shading , 2000 .

[33]  Michael Breuß,et al.  Fast Shape from Shading for Phong-Type Surfaces , 2009, SSVM.

[34]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[35]  Maurizio Falcone,et al.  An Algorithm for the Global Solution of the Shape-from-Shading Model , 1997, ICIAP.

[36]  Preprint Nr.  Numerical Algorithms for Perspective Shape from Shading , 2009 .

[37]  Arjan Kuijper,et al.  Scale Space and Variational Methods in Computer Vision , 2013, Lecture Notes in Computer Science.

[38]  Olivier D. Faugeras,et al.  Shape from shading: a well-posed problem? , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).