Two Simple Yet Effective Strategies for Avoiding Over-Smoothing in SFS Problem

Minimization techniques are widely used for retrieving a 3D surface starting from a single shaded image i.e., for solving the shape from shading problem. Such techniques are based on the assumption that expected surface to be retrieved coincides with the one that minimize a properly developed functional, consisting of several contributions. Among the possible contributes defining the functional, the so called “smoothness constraint” is always used since it guides the convergence of the minimization process towards a more accurate solution. Unfortunately, in areas where actually brightness changes rapidly, it also introduces an undesired over-smoothing effect. The present work proposes two simple yet effective strategies for avoiding the typical over-smoothing effect, with regards to the image regions in which this effect is particularly undesired (e.g., areas where surface details are to be preserved in the reconstruction). Tested against a set of case studies the strategies prove to outperform traditional SFS-based methods.

[1]  T. Rindfleisch Photometric method for lunar topography. , 1966 .

[2]  Berthold K. P. Horn SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[3]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[4]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J. Borwein,et al.  Two-Point Step Size Gradient Methods , 1988 .

[6]  Lingxiao Li,et al.  A line-integration based method for depth recovery from surface normals , 1988, Comput. Vis. Graph. Image Process..

[7]  Rama Chellappa,et al.  Estimation of illuminant direction, albedo, and shape from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  E. Rouy,et al.  A viscosity solutions approach to shape-from-shading , 1992 .

[10]  Atilla Gültekin and Muhittin Gökmen Adaptive Shape From Shading , 1998 .

[11]  Edwin R. Hancock,et al.  Needle map recovery using robust regularizers , 1999, Image Vis. Comput..

[12]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  P. Daniel,et al.  From Deterministic to Stochastic Methods for Shape From Shading , 2000 .

[14]  Berthold K. P. Horn Height and gradient from shading , 1989, International Journal of Computer Vision.

[15]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, CVPR 2004.

[16]  Yehezkel Yeshurun,et al.  Perspective shape-from-shading by fast marching , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[17]  O. Faugeras,et al.  A VISCOSITY SOLUTION METHOD FOR SHAPE-FROM-SHADING WITHOUT IMAGE BOUNDARY DATA , 2006 .

[18]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[19]  Oliver Vogel,et al.  Direct Shape-from-Shading with Adaptive Higher Order Regularisation , 2007, SSVM.

[20]  Jean-Denis Durou,et al.  Numerical methods for shape-from-shading: A new survey with benchmarks , 2008, Comput. Vis. Image Underst..

[21]  Rui Huang,et al.  Structure-Preserving Regularisation Constraints for Shape-from-Shading , 2009, CAIP.

[22]  D. Chen,et al.  Shape from shading using wavelets and weighted smoothness constraints , 2010 .

[23]  Lapo Governi,et al.  Improving surface reconstruction in shape from shading using easy-to-set boundary conditions , 2013, Int. J. Comput. Vis. Robotics.

[24]  Monica Carfagni,et al.  Digital Bas-Relief Design: a Novel Shape from Shading-Based Method , 2014 .

[25]  Michael Breuß,et al.  Variational Perspective Shape from Shading , 2015, SSVM.

[26]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.