Numerical Shape-From-Shading for Discontinuous Photographic Images

AbstractThe height, u(x, y), of a continuous, Lambertian surface of known albedo (i.e., grayness) is related to u(x, y), information recoverable from a black and white flash photograph of the surface, by the partial differential equation $$\sqrt {u_x^2 + u_y^2 } - n = 0.$$ We review the notion of a unique viscosity solution for this equation when n is continuous and a recent unique extension of the viscosity solution when n is discontinuous. We prove convergence to this extension for a wide class of the numerical algorithms that converge when n is continuous. After discussing the properties of the extension and the order of error in the algorithms simulating the extension, we point out warning signs which, when observed in the numerical solution, usually indicate that the surface is not continuous or that the viscosity solution or its extension does not correspond to the actual surface. Finally, we discuss a method that, in some of these cases, allows us to correct the simulation and recover the actual surface again.

[1]  H. Kushner Numerical Methods for Stochastic Control Problems in Continuous Time , 2000 .

[2]  G. Barles,et al.  Convergence of approximation schemes for fully nonlinear second order equations , 1990, 29th IEEE Conference on Decision and Control.

[3]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  H. Ishii Hamilton-Jacobi Equations with Discontinuous Hamiltonians on Arbitrary Open Sets , 1985 .

[5]  P. Souganidis Approximation schemes for viscosity solutions of Hamilton-Jacobi equations , 1985 .

[6]  Anna R. Bruss The Eikonal equation: some results applicable to computer vision , 1982 .

[7]  P. Dupuis,et al.  Markov Chain Approximations for Deterministic Control Problems with Affine Dynamics and Quadratic Cost in the Control , 1999 .

[8]  M. Eastwood,et al.  Some Remarks on Shape from Shading , 1995 .

[9]  J. Tsitsiklis,et al.  Efficient algorithms for globally optimal trajectories , 1994, Proceedings of 1994 33rd IEEE Conference on Decision and Control.

[10]  Alfred M. Bruckstein,et al.  Shape from shading: Level set propagation and viscosity solutions , 1995, International Journal of Computer Vision.

[11]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[12]  P. Lions,et al.  Some Properties of Viscosity Solutions of Hamilton-Jacobi Equations. , 1984 .

[13]  H. Ishii A simple, direct proof of uniqueness for solutions of the hamilton-jacobi equations of eikonal type , 1987 .

[14]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[15]  Alfred M. Bruckstein,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[16]  P. Lions,et al.  Shape-from-shading, viscosity solutions and edges , 1993 .

[17]  A. Tourin A comparison theorem for a piecewise Lipschitz continuous Hamiltonian and application to Shape-from-Shading problems , 1992 .

[18]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[19]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[20]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[21]  Daniel N. Ostrov Extending viscosity solutions to Eikonal equations with discontinuous spatial dependence , 2000 .

[22]  P. Dupuis,et al.  An Optimal Control Formulation and Related Numerical Methods for a Problem in Shape Reconstruction , 1994 .

[23]  P. Lions Generalized Solutions of Hamilton-Jacobi Equations , 1982 .

[24]  Bror V. H. Saxberg Existence and Uniqueness for Shape From Shading Around Critical Points: Theory and an Algorithm , 1992 .

[25]  P. Dupuis,et al.  Markov chain approximations for deterministic control problems with affine dynamics and quadratic cost in the control , 1997, Proceedings of the 36th IEEE Conference on Decision and Control.