Reconstruction of Archaeological Finds using Shape from Stereo and Shape from Shading

We propose a novel algorithmic framework for the refinement of sparse 3D models using shape from shading. Starting from an initial model obtained by shape from stereo we use a global optimization scheme in order to refine the surface. The constraints we use are based on the shading in the image, the initial 3D points obtained by stereo and the smoothness of the surface. In contrast to many previous approaches that assume that the photometric properties of the scene are known we iteratively update the light source direction and several parameters of the reflectance map. A careful choice of several boundary conditions on the reflectance map, the use of a multigrid scheme, the discretization of the object on a pseudo-hexagonal grid and the frequent switching between different refinement modules allows us to optimize the highly underconstrained problem. We provide results on synthetic data and reconstruction examples of frieze parts from an excavation site in Sagalassos (Turkey).

[1]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  R. Fletcher Practical Methods of Optimization , 1988 .

[3]  Pascal Fua,et al.  Variable albedo surface reconstruction from stereo and shape from shading , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Olivier D. Faugeras,et al.  Shape From Shading , 2006, Handbook of Mathematical Models in Computer Vision.

[5]  Rama Chellappa,et al.  Estimation of Illuminant Direction, Albedo, and Shape from Shading , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Mubarak Shah,et al.  Integration of shape from shading and stereo , 1995, Pattern Recognit..

[7]  Aaron F. Bobick,et al.  The direct computation of height from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  S Scherer,et al.  Integrating Shape from Shading and Shape from Stereo for Variable Reflectance Surface Reconstruction from SEM Images , 2002 .

[9]  Marc Levoy The Digital Michelangelo Project , 1999, Comput. Graph. Forum.

[10]  Narendra Ahuja,et al.  Adaptive polynomial modelling of the reflectance map for shape estimation from stereo and shading , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Li Zhang,et al.  Image-based reconstruction of the Great Buddha of Bamiyan, Afghanistan , 2003, IS&T/SPIE Electronic Imaging.

[12]  Reinhard Koch,et al.  Multi Viewpoint Stereo from Uncalibrated Video Sequences , 1998, ECCV.

[13]  Pascal Fua,et al.  Object-centered surface reconstruction: Combining multi-image stereo and shading , 1995, International Journal of Computer Vision.

[14]  Kyoung Mu Lee,et al.  Shape from Shading with Perspective Projection , 1994 .

[15]  Dimitris N. Metaxas,et al.  Incorporating Illumination Constraints in Deformable Models for Shape from Shading and Light Direction Estimation , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Holger Lange,et al.  Advances in the cooperation of shape from shading and stereo vision , 1999, Second International Conference on 3-D Digital Imaging and Modeling (Cat. No.PR00062).

[17]  Rama Chellappa,et al.  Estimation of illuminant direction, albedo, and shape from shading , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Roger Fletcher,et al.  Practical methods of optimization; (2nd ed.) , 1987 .

[19]  John E. Dennis,et al.  Numerical methods for unconstrained optimization and nonlinear equations , 1983, Prentice Hall series in computational mathematics.

[20]  Ping-Sing Tsai,et al.  Shape from Shading: A Survey , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Luc Van Gool,et al.  Reading between the lines—a method for extracting dynamic 3D with texture , 1997, VRST '97.