Towards 3D reconstruction of endoscope images using shape from shading

The 3D reconstruction problem from a single endoscope image of a smooth object is studied in the context of the shape from shading methods and considering a single light source at the camera projection center. Based on a curve expansion shape from shading algorithm, a spherical projection model for the endoscope camera and a dichromatic model for the surface reflectance, an approach to solve practical problems, namely the endoscope image distortion and the removal of the image specular reflection component, is presented. Results obtained from application of this approach to synthetic and real images are presented.

[1]  Shoji Tominaga.  Estimation of Reflection Parameters from a Color Image , 1998, ACCV.

[2]  RosenfeldAzriel,et al.  Improved methods of estimating shape from shading using the light source coordinate system , 1985 .

[3]  Shoji Tominaga,et al.  Surface Identification Using the Dichromatic Reflection Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[5]  Alfred M. Bruckstein,et al.  Tracking Level Sets by Level Sets: A Method for Solving the Shape from Shading Problem , 1995, Comput. Vis. Image Underst..

[6]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[7]  Berthold K. P. Horn.  Robot vision , 1986, MIT electrical engineering and computer science series.

[8]  Alfred M. Bruckstein,et al.  Global Shape from Shading , 1996, Comput. Vis. Image Underst..

[9]  Berthold K. P. Horn.  Obtaining shape from shading information , 1989 .

[10]  Radim Sára.  Isophotes: The Key to Tractable Local Shading Analysis , 1995, CAIP.

[11]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Shang-Hong Lai,et al.  Physically Based Adaptive Preconditioning for Early Vision , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[14]  Alex Pentland,et al.  Local Shading Analysis , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Richard Szeliski,et al.  Fast shape from shading , 1990, CVGIP Image Underst..

[16]  Takayuki Okatani,et al.  Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection Center , 1997, Comput. Vis. Image Underst..

[17]  Azriel Rosenfeld,et al.  Improved Methods of Estimating Shape from Shading Using the Light Source Coordinate System , 1985, Artif. Intell..

[18]  Ying-li Tian,et al.  Shape recovery from a color image for non-Lambertian surfaces , 1997 .

[19]  John Oliensis,et al.  Shape from Shading: Provably Convergent Algorithms and Uniqueness Results , 1994, ECCV.