Creating generative models from range images

We describe a new approach for creating concise high-level generative models from one or more approximate range images. Using simple acquisition techniques and a user-defined class of models, our method produces a simple and intuitive object description that is relatively insensitive to noise and is easy to manipulate and edit. The algorithm has two inter-related phases -- recognition, which chooses an appropriate model within a given hierarchy, and parameter estimation, which adjusts the model to fit the data. We give a simple method for automatically making tradeoffs between simplicity and accuracy to determine the best model. We also describe general techniques to optimize a specific generative model. In particular, we address the problem of creating a suitable objective function that is sufficiently continuous for use with finite-difference based optimization techniques. Our technique for model recovery and subsequent manipulation and editing is demonstrated on real objects -- a spoon, bowl, ladle, and cup -- using a simple tree of possible generative models. We believe that higher-level model representations are extremely important, and their recovery for actual objects is a fertile area of research towards which this thesis is a step. However, our work is preliminary and there are currently several limitations. The user is required to create a model hierarchy (and supply methods to provide an initial guess for model parameters within this hierarchy); the use of a large pre-defined class of models can help alleviate this problem. Further, we have demonstrated our technique on only a simple tree of generative models. While our approach is fairly general, a real system would require a tree that is significantly larger. Our methods work only where the entire object can be accurately represented as a single generative model; future work could use constructive solid geometry operations on simple generative models to represent more complicated shapes. We believe that many of the above limitations can be addressed in future work, allowing us to easily acquire and process three-dimensional shape in a simple, intuitive and efficient manner.

[1]  Alex P. Pentland,et al.  Toward An Ideal 3-D Cad System , 1987, Photonics West - Lasers and Applications in Science and Engineering.

[2]  TerzopoulosDemetri,et al.  Dynamic 3D Models with Local and Global Deformations , 1991 .

[3]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[4]  Michael F. Cohen,et al.  Interactive spacetime control for animation , 1992, SIGGRAPH.

[5]  Ravi Ramamoorthi,et al.  Fast construction of accurate quaternion splines , 1997, SIGGRAPH.

[6]  Maureen Stone,et al.  Curve-fitting with piecewise parametric cubics , 1983, SIGGRAPH.

[7]  Sven J. Dickinson,et al.  The Role of Model-Based Segmentation in the Recovery of Volumetric Parts From Range Data , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  A.K. Jain,et al.  Obtaining generic parts from range images using a multi-view represen-tation , 1994 .

[9]  Rodney A. Brooks,et al.  Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jitendra Malik,et al.  Modeling and Rendering Architecture from Photographs: A hybrid geometry- and image-based approach , 1996, SIGGRAPH.

[11]  Ruzena Bajcsy,et al.  Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Pietro Perona,et al.  3D photography on your desk , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[13]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[14]  Martin D. Levine,et al.  Recovering parametric geons from multiview range data , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  R. Nevatia Structured descriptions of complex curved objects for recognition and visual memory. , 1975 .

[16]  Tony DeRose,et al.  Surface reconstruction from unorganized points , 1992, SIGGRAPH.

[17]  John M. Snyder,et al.  Generative modeling: a symbolic system for geometric modeling , 1992, SIGGRAPH.

[18]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[19]  Dimitris N. Metaxas,et al.  Shape Evolution With Structural and Topological Changes Using Blending , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Claude Brezinski,et al.  Generative modeling for computer graphics and CAD , 1993 .

[21]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[22]  Frank P. Ferrie,et al.  Darboux Frames, Snakes, and Super-Quadrics: Geometry from the Bottom Up , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Dimitris N. Metaxas,et al.  Blended deformable models , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[24]  P. FerrieF.,et al.  Darboux Frames, Snakes, and Super-Quadrics , 1993 .

[25]  Matthias Eck,et al.  Automatic reconstruction of B-spline surfaces of arbitrary topological type , 1996, SIGGRAPH.

[26]  John M. Snyder,et al.  Generative Modeling for Computer Graphics and Cad: Symbolic Shape Design Using Interval Analysis , 1992 .

[27]  Tony DeRose,et al.  Mesh optimization , 1993, SIGGRAPH.

[28]  R. Brooks Model-Based Three-Dimensional Interpretations of Two-Dimensional Images , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Marc Levoy,et al.  Fitting smooth surfaces to dense polygon meshes , 1996, SIGGRAPH.