Symmetry-seeking models and 3D object reconstruction

We propose models of 3D shape which may be viewed as deformable bodies composed of simulated elastic material. In contrast to traditional, purely geometric models of shape, deformable models are active—their shapes change in response to externally applied forces. We develop a deformable model for 3D shape which has a preference for axial symmetry. Symmetry is represented even though the model does not belong to a parametric shape family such as (generalized) cylinders. Rather, a symmetry-seeking property is designed into internal forces that constrain the deformations of the model. We develop a framework for 3D object reconstruction based on symmetry-seeking models. Instances of these models are formed from monocular image data through the action of external forces derived from the data. The forces proposed in this paper deform the model in space so that the shape of its projection into the image plane is consistent with the 2D silhouette of an object of interest. The effectiveness of our approach is demonstrated using natural images.

[1]  Y. Fung.  Foundations of solid mechanics , 1965 .

[2]  Martin A. Fischler,et al.  The Representation and Matching of Pictorial Structures , 1973, IEEE Transactions on Computers.

[3]  Åke Björck,et al.  Numerical Methods , 1995, Handbook of Marine Craft Hydrodynamics and Motion Control.

[4]  John M. Hollerbach,et al.  Hierarchical Shape Description of Objects by Selection and Modification of Prototypes , 1975 .

[5]  Thomas O. Binford,et al.  Computer Description of Curved Objects , 1973, IEEE Transactions on Computers.

[6]  D. Marr,et al.  Analysis of occluding contour , 1977, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[7]  Ramakant Nevatia,et al.  Description and Recognition of Curved Objects , 1977, Artif. Intell..

[8]  D. Marr,et al.  Representation and recognition of the spatial organization of three-dimensional shapes , 1978, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[9]  Demetri Terzopoulos.  Matching Deformable Models to Images: Direct and Iterative Solutions , 1987, Topical Meeting on Machine Vision.

[10]  Barr,et al.  Superquadrics and Angle-Preserving Transformations , 1981, IEEE Computer Graphics and Applications.

[11]  Takeo Kanade,et al.  Recovery of the Three-Dimensional Shape of an Object from a Single View , 1981, Artif. Intell..

[12]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[13]  M. Brady.  Criteria for Representations of Shape , 1983 .

[14]  Demetri Terzopoulos,et al.  Multilevel computational processes for visual surface reconstruction , 1983, Comput. Vis. Graph. Image Process..

[15]  Alan H. Barr,et al.  Global and local deformations of solid primitives , 1984, SIGGRAPH.

[16]  M. Brady,et al.  Smoothed Local Symmetries and Their Implementation , 1984 .

[17]  Demetri Terzopoulos,et al.  Regularization of Inverse Visual Problems Involving Discontinuities , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Alex Pentland,et al.  Parts: Structured Descriptions of Shape , 1986, AAAI.

[19]  Michael Leyton,et al.  Constraint-Theorems on the Prototypification of Shape , 1986, AAAI.

[20]  Demetri Terzopoulos,et al.  Energy Constraints on Deformable Models: Recovering Shape and Non-Rigid Motion , 1987, AAAI.

[21]  A. Pentland.  Recognition by Parts , 1987 .

[22]  John C. Platt,et al.  Elastically deformable models , 1987, SIGGRAPH.

[23]  Donald D. Hoffman,et al.  Codon constraints on closed 2D shapes , 1985, Computer Vision Graphics and Image Processing.

[24]  Demetri Terzopoulos,et al.  Constraints on Deformable Models: Recovering 3D Shape and Nonrigid Motion , 1988, Artif. Intell..

[25]  Demetri Terzopoulos,et al.  Signal matching through scale space , 1986, International Journal of Computer Vision.

[26]  Powell Hall.  Descriptions from Sparse 3-D Data * , .