Efficient Shape Matching and Retrieval at Multiple Scales

We propose a novel approach for the recognition, clustering and retrieval of shapes. The heart of our methodology is a shape matching algorithm based on dynamic programming, that operates implicitly at multiple scales, but avoids the heavy computational cost of the explicit curvature scale space representation. Our method provides for clustering, visualization and browsing of a data set, as well as for indexing, achieving up to three orders of magnitude speed-up over sequential scanning. We illustrate the application of our method to real two-dimensional static hand gesture data. We also demonstrate the superiority of our approach over traditional approaches to shape matching and retrieval, such as Fourier descriptors, Geometric and Sequential moments. Our evaluation is based on human relevance judgements following a well established methodology from the information retrieval field.

[1]  Luigi Cinque,et al.  Indexing pictorial documents by their content: a survey of current techniques , 1997, Image Vis. Comput..

[2]  Josef Kittler,et al.  Efficient curvature-based shape representation for similarity retrieval , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[3]  Hemant D. Tagare Deformable 2-D template matching using orthogonal curves , 1997, IEEE Transactions on Medical Imaging.

[4]  E. Mnros,et al.  Shape Matching Using Curvature Processes , 1988 .

[5]  Hans-Peter Kriegel,et al.  The X-tree : An Index Structure for High-Dimensional Data , 2001, VLDB.

[6]  Kaleem Siddiqi,et al.  Parts of Visual Form: Computational Aspects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Eric Saund,et al.  Symbolic Construction of a 2-D Scale-Space Image , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Hans-Peter Kriegel,et al.  Multi-step processing of spatial joins , 1994, SIGMOD '94.

[9]  William I. Grosky,et al.  Shape matching utilizing indexed hypotheses generation and testing , 1989, IEEE Trans. Robotics Autom..

[10]  Peter N. Yianilos,et al.  Data structures and algorithms for nearest neighbor search in general metric spaces , 1993, SODA '93.

[11]  Vijay V. Raghavan,et al.  Modeling and retrieving images by content , 1997, Inf. Process. Manag..

[12]  Charles R. Dyer,et al.  Model-based recognition in robot vision , 1986, CSUR.

[13]  Christos Faloutsos,et al.  Hilbert R-tree: An Improved R-tree using Fractals , 1994, VLDB.

[14]  L. Floreby,et al.  A multiscale algorithm for closed contour matching in image sequence , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[15]  Christos Faloutsos,et al.  FastMap: a fast algorithm for indexing, data-mining and visualization of traditional and multimedia datasets , 1995, SIGMOD '95.

[16]  Edith Schonberg,et al.  Two-Dimensional, Model-Based, Boundary Matching Using Footprints , 1986 .

[17]  Michael Leyton,et al.  A Process-Grammar for Shape , 1988, Artif. Intell..

[18]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[20]  Linda G. Shapiro,et al.  A Structural Model of Shape , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Trevor N. Mudge,et al.  Efficient Recognition of Partially Visible Objects Using a Logarithmic Complexity Matching Technique , 1989, Int. J. Robotics Res..

[22]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Rakesh Mohan,et al.  Multidimensional Indexing for Recognizing Visual Shapes , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Mandyam D. Srinath,et al.  Contour sequence moments for the classification of closed planar shapes , 1987, Pattern Recognit..

[25]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[26]  Antonin Guttman,et al.  R-trees: a dynamic index structure for spatial searching , 1984, SIGMOD '84.

[27]  Nick Roussopoulos,et al.  Direct spatial search on pictorial databases using packed R-trees , 1985, SIGMOD Conference.

[28]  A. Murat Tekalp,et al.  Shape similarity matching for query-by-example , 1998, Pattern Recognit..

[29]  Mohan S. Kankanhalli,et al.  Shape Measures for Content Based Image Retrieval: A Comparison , 1997, Inf. Process. Manag..

[30]  Edward J. Delp,et al.  Partial Shape Recognition: A Landmark-Based Approach , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Baba C. Vemuri,et al.  Constructing Intrinsic Parameters with Active Models for Invariant Surface Reconstruction , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[33]  Ramakrishnan Srikant,et al.  Fast Algorithms for Mining Association Rules in Large Databases , 1994, VLDB.

[34]  Christos Faloutsos,et al.  Fractals for secondary key retrieval , 1989, PODS.

[35]  Owen Robert Mitchell,et al.  Partial Shape Recognition Using Dynamic Programming , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[36]  Shin'ichi Satoh,et al.  The SR-tree: an index structure for high-dimensional nearest neighbor queries , 1997, SIGMOD '97.

[37]  Josef Kittler,et al.  Robust and Efficient Shape Indexing through Curvature Scale Space , 1996, BMVC.

[38]  Edward J. Delp,et al.  Partial shape recognition: a landmark-based approach , 1989, Conference Proceedings., IEEE International Conference on Systems, Man and Cybernetics.

[39]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[40]  P. Wintz,et al.  An efficient three-dimensional aircraft recognition algorithm using normalized fourier descriptors , 1980 .

[41]  Sergey Brin,et al.  Near Neighbor Search in Large Metric Spaces , 1995, VLDB.

[42]  F. Stein,et al.  Efficient two dimensional object recognition , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[43]  Jack A. Orenstein Spatial query processing in an object-oriented database system , 1986, SIGMOD '86.

[44]  Klaus H. Hinrichs,et al.  The Grid File: A Data Structure to Support Proximity Queries on Spatial Objects , 1983, International Workshop on Graph-Theoretic Concepts in Computer Science.

[45]  Hiroshi Murase,et al.  Silhouette-based object recognition through curvature scale space , 1993, 1993 (4th) International Conference on Computer Vision.

[46]  Naonori Ueda,et al.  Learning Visual Models from Shape Contours Using Multiscale Convex/Concave Structure Matching , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Kim L. Boyer,et al.  Robust Contour Decomposition Using a Constant Curvature Criterion , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Nick Roussopoulos,et al.  Nearest neighbor queries , 1995, SIGMOD '95.

[49]  Christos Faloutsos,et al.  The R+-Tree: A Dynamic Index for Multi-Dimensional Objects , 1987, VLDB.

[50]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.