A new perspective [on] shape-from-shading

Shape-from-shading (SFS) is a fundamental problem in computer vision. The vast majority of research in this field have assumed orthography as its projection model. This paper reexamines the basis of SFS, the image irradiance equation, under an assumption of perspective projection. The paper also shows that the perspective image irradiance equation depends merely on the natural logarithm of the depth function (and not on the depth function itself), and as such it is invariant to scale changes of the depth function. We then suggest a simple reconstruction algorithm based on the perspective formula, and compare it to existing orthographic SFS algorithms. This simple algorithm obtained lower error rates than legacy SFS algorithms, and equated with and sometimes surpassed state-of-the-art algorithms. These findings lend support to the assumption that transition to a more realistic set of assumptions improves reconstruction significantly.

[1]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[2]  Alfred M. Bruckstein,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[3]  Aly A. Farag,et al.  A Robust 3-D Reconstruction System for Human Jaw Modeling , 1999, MICCAI.

[4]  Michael J. Brooks,et al.  Shape and Source from Shading , 1985, IJCAI.

[5]  C.-C. Jay Kuo,et al.  Shape from Shading with a Generalized Reflectance Map Model , 1997, Comput. Vis. Image Underst..

[6]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Dimitris N. Metaxas,et al.  Coupled lighting direction and shape estimation from single images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[8]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[10]  Berthold K. P. Horn Image Intensity Understanding , 1975 .

[11]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.

[12]  C.-C. Jay Kuo,et al.  Shape from Shading with a Linear Triangular Element Surface Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Michael A. Penna,et al.  A Shape From Shading Analysis for a Single Perspective Image of a Polyhedron , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Hideo Saito,et al.  A divide-and-conquer strategy in shape from shading problem , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.