Implementation of a shadow carving system for shape capture

We present a new technique for estimating the 3D shape of an object that combines previous ideas from shape from silhouettes and shape from shadows. We begin with a set-up for robustly extracting object silhouettes by casting a shadow of the object with a point light-source onto a translucent panel. A camera on the opposite side of the panel records an image which is readily processed to obtain the object boundary. We use a space carving technique to extract an initial estimate of the object shape. In a second phase, we record a series of images of the object lit by point light sources. We compare the areas of self shadowing in these images to those expected if our estimated shape from the space carving were correct. The shape of the object is refined by a shadow carving step that adjusts the current shape to resolve contradictions between the captured images and the current shape estimate. The result of the space carving and shadow carving is an estimate of shape that can be further refined by methods that work well in local regions, such as photometric stereo. We have implemented our approach in a simple table top system and present the results of scanning a small object with deep concavities.

[1]  Aldo Laurentini,et al.  How Far 3D Shapes Can Be Understood from 2D Silhouettes , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Paolo Cignoni,et al.  A low cost optical 3D scanner , 2001, Comput. Graph. Forum.

[3]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[4]  David J. Kriegman,et al.  What shadows reveal about object structure. , 2001 .

[5]  John R. Kender,et al.  An optimal algorithm for the derivation of shape from shadows , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Jiang Yu Zheng,et al.  Acquiring 3-D Models from Sequences of Contours , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Berthold K. P. Horn,et al.  Shape from shading , 1989 .

[8]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[9]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[10]  Takeo Kanade,et al.  Using shadows in finding surface orientations , 1983, Comput. Vis. Graph. Image Process..

[11]  William Ribarsky,et al.  Toward Spontaneous Interaction with the Perceptive Workbench , 2000, IEEE Computer Graphics and Applications.

[12]  Paolo Cignoni,et al.  A low cost 3D scanner based on structured light , 2001 .

[13]  Murray H. Loew,et al.  The Entry-Exit Method of Shadow Boundary Segmentation , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  J. Kender,et al.  Shape from darkness under error , 1996 .

[15]  Peter K. Allen,et al.  3-D Modeling from Range Imagery: An Incremental Method with a Planning Component , 1999, Image Vis. Comput..

[16]  Jake K. Aggarwal,et al.  TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE , 2008 .

[17]  Gregory Dudek,et al.  On 3-D surface reconstruction using shape from shadows , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[18]  P. Perona,et al.  Shadow carving , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[19]  Kenneth A. Loparo,et al.  Reconstruction of three-dimensional surfaces from two-dimensional binary images , 1989, IEEE Trans. Robotics Autom..

[20]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[21]  Gregory Dudek,et al.  Space occupancy using multiple shadowimages , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[22]  Andrew Blake,et al.  Surface shape from the deformation of apparent contours , 1992, International Journal of Computer Vision.