Near Field Photometric Stereo with Point Light Sources

Shape recovery of an object based on shading variations resulting from different light sources has recently been reconsidered. Improvements have been made that allow for the photometric stereo approach to serve as a competitive alternative to other shape reconstruction methods. However, most photometric stereo methods tend to ignore factors that are relevant in practical applications. The setup considered in this paper tackles photometric stereo reconstruction in the case of a specific near-field imaging. This means that both the camera and the light sources are close to the imaged object, where close can be loosely considered as a setup having similar distances between lights, camera, and object. The known challenges that characterize the problem involve perspective viewing geometry, point light sources, and images that may include shadowed regions. Here, we pay special attention to the question of how to faithfully model these aspects and at the same time design an efficient and robust numerical solver....

[1]  Ron Kimmel,et al.  Optimal Algorithm for Shape from Shading and Path Planning , 2001, Journal of Mathematical Imaging and Vision.

[2]  Alfred M. Bruckstein,et al.  Integrability disambiguates surface recovery in two-image photometric stereo , 1992, International Journal of Computer Vision.

[3]  Branislav Jaramaz,et al.  A Multi-Image Shape-from-Shading Framework for Near-Lighting Perspective Endoscopes , 2009, International Journal of Computer Vision.

[4]  Jean-Denis Durou,et al.  Integrating the Normal Field of a Surface in the Presence of Discontinuities , 2009, EMMCVPR.

[5]  M. Falcone,et al.  Semi-Lagrangian Approximation Schemes for Linear and Hamilton-Jacobi Equations , 2014 .

[6]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Berthold K. P. Horn Obtaining shape from shading information , 1989 .

[8]  Hanspeter Pfister,et al.  Visibility Subspaces: Uncalibrated Photometric Stereo with Shadows , 2010, ECCV.

[9]  Brian C. Lovell,et al.  Shadow detection: A survey and comparative evaluation of recent methods , 2012, Pattern Recognit..

[10]  Nahum Kiryati,et al.  Depth from gradient fields and control points: bias correction in photometric stereo , 2004, Image Vis. Comput..

[11]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ron Kimmel,et al.  An Algebraic Multigrid Approach for Image Analysis , 2002, SIAM J. Sci. Comput..

[13]  Michael Brady,et al.  Integrating stereo and photometric stereo to monitor the development of glaucoma , 1990, BMVC.

[14]  B. Hapke Theoretical Photometric Function for the Lunar Surface. , 1963 .

[15]  A. Quarteroni,et al.  Numerical Approximation of Partial Differential Equations , 2008 .

[16]  Yehezkel Yeshurun,et al.  Shape-from-Shading Under Perspective Projection , 2005, International Journal of Computer Vision.

[17]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[18]  Olivier D. Faugeras,et al.  Shape from shading: a well-posed problem? , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  G. Stiny Shape , 1999 .

[20]  Alfred M. Bruckstein,et al.  Direct Shape Recovery from Photometric Stereo with Shadows , 2013, 2013 International Conference on 3D Vision.

[21]  Carlos Hernández,et al.  Practical 3D Reconstruction Based on Photometric Stereo , 2010, Computer Vision: Detection, Recognition and Reconstruction.

[22]  Richard Szeliski,et al.  Impossible Shaded Images , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Alfred M. Bruckstein,et al.  A Direct Differential Approach to Photometric Stereo with Perspective Viewing , 2014, SIAM J. Imaging Sci..

[24]  J. Strikwerda Finite Difference Schemes and Partial Differential Equations , 1989 .

[25]  Joachim Hornegger,et al.  Medical Image Computing and Computer-Assisted Intervention – MICCAI 2012 , 2012 .

[26]  Maurizio Falcone,et al.  Uniqueness and Approximation of a Photometric Shape-from-Shading Model , 2013, SIAM J. Imaging Sci..

[27]  Ravi Ramamoorthi,et al.  On Differential Photometric Reconstruction for Unknown, Isotropic BRDFs , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Adrien Bartoli,et al.  3D Reconstruction in Laparoscopy with Close-Range Photometric Stereo , 2012, MICCAI.

[29]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[30]  Alfred M. Bruckstein,et al.  Perspective Photometric Stereo with Shadows , 2013, SSVM.

[31]  William A. Kirk,et al.  A FIXED POINT THEOREM FOR ASYMPTOTICALLY NONEXPANSIVE MAPPINGS , 1972 .

[32]  Michael J. Brooks,et al.  The variational approach to shape from shading , 1986, Comput. Vis. Graph. Image Process..

[33]  Michael Breuß,et al.  Perspective Shape from Shading: Ambiguity Analysis and Numerical Approximations , 2012, SIAM J. Imaging Sci..

[34]  Berthold K. P. Horn Height and gradient from shading , 1989, International Journal of Computer Vision.

[35]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  David J. Kriegman,et al.  ShadowCuts: Photometric Stereo with Shadows , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[37]  Hung-Tat Tsui,et al.  Global Shape from Shading for an Endoscope Image , 1999, MICCAI.

[38]  Rama Chellappa,et al.  What Is the Range of Surface Reconstructions from a Gradient Field? , 2006, ECCV.

[39]  Jitendra Malik,et al.  Shape, Illumination, and Reflectance from Shading , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  O. Faugeras,et al.  A VISCOSITY SOLUTION METHOD FOR SHAPE-FROM-SHADING WITHOUT IMAGE BOUNDARY DATA , 2006 .

[41]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..

[42]  Paolo Favaro,et al.  A New Perspective on Uncalibrated Photometric Stereo , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[43]  Roberto Cipolla,et al.  Shadows in Three-Source Photometric Stereo , 2008, ECCV.

[44]  Clésio Luiz Tozzi,et al.  Shape from shading with perspective projection and camera calibration , 1996, Comput. Graph..