Model-Based Recognition of 3D Objects from Single Images

In this work, we treat major problems of object recognition which have received relatively little attention lately. Among them are the loss of depth information in the projection from a 3D object to a single 2D image, and the complexity of finding feature correspondences between images. We use geometric invariants to reduce the complexity of these problems. There are no geometric invariants of a projection from 3D to 2D. However, given certain modeling assumptions about the 3D object, such invariants can be found. The modeling assumptions can be either a particular model or a generic assumption about a class of models. Here, we use such assumptions for single-view recognition. We find algebraic relations between the invariants of a 3D model and those of its 2D image under general projective projection. These relations can be described geometrically as invariant models in a 3D invariant space, illuminated by invariant "light rays," and projected onto an invariant version of the given image. We apply the method to real images.

[1]  Stephen J. Maybank.  Relation between 3D invariants and 2D invariants , 1998, Image Vis. Comput..

[2]  Hanan Samet,et al.  Ranking in Spatial Databases , 1995, SSD.

[3]  Bernd Sturmfels,et al.  Algorithms in invariant theory , 1993, Texts and monographs in symbolic computation.

[4]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Isaac Weiss.  3-D curve reconstruction from uncalibrated cameras , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[6]  G. Sparr.  Projective invariants for affine shapes of point configurations , 1991 .

[7]  Long Quan,et al.  Relative 3D Reconstruction Using Multiple Uncalibrated Images , 1995, Int. J. Robotics Res..

[8]  Daniel P. Huttenlocher,et al.  Affine invariants for model-based recognition , 1992 .

[9]  Rachid Deriche,et al.  Robust Recovery of the Epipolar Geometry for an Uncalibrated Stereo Rig , 1994, ECCV.

[10]  Ramakant Nevatia,et al.  Using Invariance and Quasi-Invariance for the Segmentation and Recovery of Curved Objects , 1993, Applications of Invariance in Computer Vision.

[11]  Ehud Rivlin,et al.  Local Invariants For Recognition , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Hanan Samet,et al.  A population analysis for hierarchical data structures , 1987, SIGMOD '87.

[13]  David J. Kriegman,et al.  Structure and motion of curved 3D objects from monocular silhouettes , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Stefan Carlsson.  Relative Positioning from Model Indexing , 1993, BMVC.

[15]  Isaac Weiss.  Noise-Resistant Invariants of Curves , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Luc Van Gool,et al.  Vision and Lie's approach to invariance , 1995, Image Vis. Comput..

[17]  Ehud Rivlin,et al.  Deformation Invariants in Object Recognition , 1997, Comput. Vis. Image Underst..

[18]  Ronen Basri,et al.  Recognition by Linear Combinations of Models , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  C. E. Springer,et al.  Geometry and Analysis of Projective Spaces , 1967 .

[20]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[21]  Stefan Carlsson.  Relative positioning from model indexing , 1994, Image Vis. Comput..

[22]  Roberto Cipolla,et al.  Affine integral invariants for extracting symmetry axes , 1997, Image Vis. Comput..

[23]  J.B. Burns,et al.  View Variation of Point-Set and Line-Segment Features , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jezekiel Ben-Arie,et al.  Iconic recognition with affine-invariant spectral signatures , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[25]  Daphna Weinshall,et al.  3D object recognition by indexing structural invariants from multiple views , 1993, 1993 (4th) International Conference on Computer Vision.

[26]  David A. Forsyth,et al.  3D Object Recognition Using Invariance , 1995, Artif. Intell..

[27]  Hanan Samet,et al.  The Design and Analysis of Spatial Data Structures , 1989 .

[28]  Peter Meer,et al.  Point/line correspondence under 2D projective transformation , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[29]  Charlie Rothwell.  Object Recognition through Invariant Indexing , 1995 .

[30]  D. Jacobs.  Space Efficient 3D Model Indexing , 1992 .

[31]  Daphna Weinshall.  Model-based invariants for 3D vision , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Nassir Navab,et al.  Relative Affine Structure: Canonical Model for 3D From 2D Geometry and Applications , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Ronen Basri,et al.  3-D to 2-D recognition with regions , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[34]  David W. Jacobs.  Space efficient 3-D model indexing , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[35]  Isaac Weiss,et al.  Projective invariants of shapes , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[36]  Paul A. Beardsley,et al.  3D Model Acquisition from Extended Image Sequences , 1996, ECCV.

[37]  Ehud Rivlin,et al.  Scale space semi-local invariants , 1997, Image Vis. Comput..