Shape representation and image segmentation using deformable surfaces

Abstract We present a technique for constructing shape representation from images using free-form deformable surfaces. We model an object as a closed surface that is deformed subject to attractive fields generated by input data points and features. Features affect the global shape of the surface or unstructured environments. The algorithm is general in that it makes few assumptions on the type of features, the nature of the data and the type of objects. We present results in a wide range of applications: reconstruction of smooth isolated objects such as human faces, reconstruction of structured objects such as polyhedra, and segmentation of complex scenes with mutually occluding objects. We have successfully tested the algorithm using data from different sensors including grey-coding range finders and video cameras, using one or several images.

[1]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  Demetri Terzopoulos Computing Visible-Surface Representations , 1985 .

[3]  A. Pentland Recognition by Parts , 1987 .

[4]  Katsushi Ikeuchi,et al.  Numerical Shape from Shading and Occluding Boundaries , 1981, Artif. Intell..

[5]  Steven W. Zucker,et al.  The Organization Of Curve Detection: Coarse Tangent Fields And Fine Spline Coverings , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[6]  K. Sato,et al.  Range imaging system utilizing nematic liquid crystal mask , 1987 .

[7]  Robert C. Bolles,et al.  Representation space: an approach to the integration of visual information , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  Hervé Delingette,et al.  A perception and Manipulation System for collecting rock samples , 1991 .

[9]  Charles Fox,et al.  An introduction to the calculus of variations , 1950 .

[10]  Alex Pentland,et al.  Perceptual Organization and the Representation of Natural Form , 1986, Artif. Intell..

[11]  J. Meinguet Multivariate interpolation at arbitrary points made simple , 1979 .

[12]  Baba C. Vemuri,et al.  On Three-Dimensional Surface Reconstruction Methods , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[14]  Katsushi Ikeuchi,et al.  A three-finger gripper for manipulation in unstructured environments , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[15]  Paul J. Besl,et al.  Segmentation through symbolic surface descriptions , 1986 .

[16]  M. Bertero,et al.  Ill-posed problems in early vision , 1988, Proc. IEEE.