3D Shape Matching with 3D Shape Contexts

Content based 3D shape retrieval for broad domains like the World Wide Web has recently gained considerable attention in Computer Graphics community. One of the main challenges in this context is the mapping of 3D objects into compact canonical representations referred to as descriptors or feature vector, which serve as search keys during the retrieval process. The descriptors should have certain desirable properties like invariance under scaling, rotation and translation as well as a descriptive power providing a basis for similarity measure between threedimensional objects which is close to the human notion of resemblance. In this paper we introduce an enhanced 3D approach of the recently introduced 2D Shape Contexts that can be used for measuring 3d shape similarity as fast, intuitive and powerful similarity model for 3D objects. The Shape Context at a point captures the distribution over relative positions of other shape points and thus summarizes global shape in a rich, local descriptor. Shape Contexts greatly simplify recovery of correspondences between points of two given shapes. Moreover, the Shape Context leads to a robust score for measuring shape similarity, once shapes are aligned.

[1]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[2]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[3]  H. Blum Biological shape and visual science (part I) , 1973 .

[4]  M. Teague Image analysis via the general theory of moments , 1980 .

[5]  Antonin Guttman,et al.  R-trees: a dynamic index structure for spatial searching , 1984, SIGMOD '84.

[6]  Christos Faloutsos,et al.  The R+-Tree: A Dynamic Index for Multi-Dimensional Objects , 1987, VLDB.

[7]  I. Biederman Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[8]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[10]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[11]  James Lee Hafner,et al.  Efficient Color Histogram Indexing for Quadratic Form Distance Functions , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Michael Shneier,et al.  Exploiting the JPEG Compression Scheme for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Hans-Peter Kriegel,et al.  The X-tree : An Index Structure for High-Dimensional Data , 2001, VLDB.

[14]  Amarnath Gupta,et al.  Visual information retrieval , 1997, CACM.

[15]  Christian Böhm,et al.  Fast parallel similarity search in multimedia databases , 1997, SIGMOD '97.

[16]  Hans-Peter Kriegel,et al.  3D Similarity Search by Shape Approximation , 1997, SSD.

[17]  Hans-Peter Kriegel,et al.  Efficient User-Adaptable Similarity Search in Large Multimedia Databases , 1997, VLDB.

[18]  Marc Rioux,et al.  A content-based search engine for VRML databases , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  Hans-Peter Kriegel,et al.  Approximation-Based Similarity Search for 3-D Surface Segments , 1998, GeoInformatica.

[20]  Hans-Peter Kriegel,et al.  A Multistep Approach for Shape Similarity Search in Image Databases , 1998, IEEE Trans. Knowl. Data Eng..

[21]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[22]  Hans-Peter Kriegel,et al.  Optimal multi-step k-nearest neighbor search , 1998, SIGMOD '98.

[23]  Hans-Peter Kriegel,et al.  Improving Adaptable Similarity Query Processing by Using Approximations , 1998, VLDB.

[24]  Oliver Günther,et al.  Multidimensional access methods , 1998, CSUR.

[25]  Hans-Peter Kriegel,et al.  3D Shape Histograms for Similarity Search and Classification in Spatial Databases , 1999, SSD.

[26]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Toshikazu Kato,et al.  A similarity retrieval of 3D polygonal models using rotation invariant shape descriptors , 2000, Smc 2000 conference proceedings. 2000 ieee international conference on systems, man and cybernetics. 'cybernetics evolving to systems, humans, organizations, and their complex interactions' (cat. no.0.

[28]  Jitendra Malik,et al.  Shape Context: A New Descriptor for Shape Matching and Object Recognition , 2000, NIPS.

[29]  Jitendra Malik,et al.  Shape contexts enable efficient retrieval of similar shapes , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[30]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[31]  William C. Regli,et al.  Machining feature-based comparisons of mechanical parts , 2001, Proceedings International Conference on Shape Modeling and Applications.

[32]  Benjamin B. Kimia,et al.  The Shock Scaffold for Representing 3D Shape , 2001, IWVF.

[33]  Dietmar Saupe,et al.  Description of 3D-shape using a complex function on the sphere , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[34]  Ryutarou Ohbuchi,et al.  Shape-similarity search of three-dimensional models using parameterized statistics , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[35]  Roddy MacLeod,et al.  Coarse Filters for Shape Matching , 2002, IEEE Computer Graphics and Applications.

[36]  Michael Elad,et al.  Content based retrieval of VRML objects: an iterative and interactive approach , 2002 .

[37]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[38]  Euripides G. M. Petrakis,et al.  Design and evaluation of spatial similarity approaches for image retrieval , 2002, Image Vis. Comput..

[39]  David P. Dobkin,et al.  A search engine for 3D models , 2003, TOGS.

[40]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[41]  Christos Faloutsos,et al.  Efficient and effective Querying by Image Content , 1994, Journal of Intelligent Information Systems.

[42]  A. Volgenant,et al.  A shortest augmenting path algorithm for dense and sparse linear assignment problems , 1987, Computing.