Building Three-Dimensional Object Models from Image Sequences

We present the results from a working system designed to reconstruct a complete CAD/CAM surface model for objects that have both smooth and sharp surface boundaries. The input is a sequence of images of the object; the output is a 3-D surface mesh that can be manipulated and rendered with standard CAD/CAM tools. It is now well known that complete surface information (second-order differential surface properties) can be recovered at edges generated by the extremal boundary of a 3-D surface, In this paper we present new results in applying this theoretical framework to many views of a real object to build a complete 3-D model. Our experiments place these multiple frames in a common coordinate system using known motion, if available, or by otherwise automatically computing object motion based on our classification of edges in the reconstruction process. Experimental results are shown for bath real and synthetic data.

[1]  J. Koenderink,et al.  Visual perception of rigidity of solid shape , 1976, Journal of mathematical biology.

[2]  D. Marr,et al.  Analysis of occluding contour , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[3]  Harry G. Barrow,et al.  Interpreting Line Drawings as Three-Dimensional Surfaces , 1980, Artif. Intell..

[4]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[5]  Richard S. Weiss,et al.  Reconstruction of Surfaces from Profiles , 1987, ICCV 1987.

[6]  Ronen Basri,et al.  The Alignment Of Objects With Smooth Surfaces , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[7]  Andrew Blake,et al.  The dynamic analysis of apparent contours , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[8]  Olivier D. Faugeras,et al.  Curve-based stereo: figural continuity and curvature , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  David J. Kriegman,et al.  On using CAD models to compute the pose of curved 3D objects , 1992, CVGIP Image Underst..

[10]  Olivier D. Faugeras,et al.  Using Extremal Boundaries for 3-D Object Modeling , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  W. Brent Seales,et al.  Global surface reconstruction from many views of the extremal boundary , 1993, Other Conferences.

[12]  Jiang Yu Zheng,et al.  Acquiring 3-D Models from Sequences of Contours , 1994, IEEE Trans. Pattern Anal. Mach. Intell..