Matching and Retrieval of Distorted and Occluded Shapes Using Dynamic Programming

We propose an approach for matching distorted and possibly occluded shapes using dynamic programming (DP). We distinguish among various cases of matching such as cases where the shapes are scaled with respect to each other and cases where an open shape matches the whole or only a part of another open or closed shape. Our algorithm treats noise and shape distortions by allowing matching of merged sequences of consecutive small segments in a shape with larger segments of another shape, while being invariant to translation, scale, orientation, and starting point selection. We illustrate the effectiveness of our algorithm in retrieval of shapes on two data sets of two-dimensional open and closed shapes of marine life species. We demonstrate the superiority of our approach over traditional approaches to shape matching and retrieval based on Fourier descriptors and moments. We also compare our method with SQUID, a well-known method which is available on the Internet. Our evaluation is based on human relevance judgments following a well-established methodology from the information retrieval field.

[1]  Eric Saund,et al.  Symbolic Construction of a 2-D Scale-Space Image , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Wen-Hsiang Tsai,et al.  Attributed String Matching with Merging for Shape Recognition , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Olivier D. Faugeras,et al.  Shape Matching of Two-Dimensional Objects , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Hiroshi Murase,et al.  Silhouette-based object recognition through curvature scale space , 1993, 1993 (4th) International Conference on Computer Vision.

[5]  Euripides G. M. Petrakis,et al.  Shape retrieval based on dynamic programming , 2000, IEEE Trans. Image Process..

[6]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[7]  Owen Robert Mitchell,et al.  Partial Shape Recognition Using Dynamic Programming , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Richard J. Prokop,et al.  A survey of moment-based techniques for unoccluded object representation and recognition , 1992, CVGIP Graph. Model. Image Process..

[9]  Trevor N. Mudge,et al.  Efficient Recognition of Partially Visible Objects Using a Logarithmic Complexity Matching Technique , 1989, Int. J. Robotics Res..

[10]  Rangasami L. Kashyap,et al.  Matching polygon fragments , 1989, Pattern Recognit. Lett..

[11]  Linda G. Shapiro,et al.  A Structural Model of Shape , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[13]  Josef Kittler,et al.  Efficient and Robust Retrieval by Shape Content through Curvature Scale Space , 1998, Image Databases and Multi-Media Search.

[14]  Michael Leyton,et al.  A Process-Grammar for Shape , 1988, Artif. Intell..

[15]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  William I. Grosky,et al.  Shape matching utilizing indexed hypotheses generation and testing , 1989, IEEE Trans. Robotics Autom..

[17]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  George Papadourakis,et al.  Curvature scale-space-driven object recognition with an indexing scheme based on artificial neural networks , 1999, Pattern Recognit..

[19]  Daphna Weinshall,et al.  Flexible Syntactic Matching of Curves and Its Application to Automatic Hierarchical Classification of Silhouettes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Mohan S. Kankanhalli,et al.  Content-Based Image Retrieval Using a Composite Color-Shape Approach , 1998, Inf. Process. Manag..

[21]  Edith Schonberg,et al.  Two-Dimensional, Model-Based, Boundary Matching Using Footprints , 1986 .

[22]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[23]  P. Wintz,et al.  An efficient three-dimensional aircraft recognition algorithm using normalized fourier descriptors , 1980 .

[24]  Min-Hong Han,et al.  The use of maximum curvature points for the recognition of partially occluded objects , 1990, Pattern Recognit..

[25]  Kim L. Boyer,et al.  Robust Contour Decomposition Using a Constant Curvature Criterion , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Frederic Fol Leymarie,et al.  Tracking Deformable Objects in the Plane Using an Active Contour Model , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Farzin Mokhtarian,et al.  Silhouette-Based Isolated Object Recognition through Curvature Scale Space , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Baba C. Vemuri,et al.  Constructing Intrinsic Parameters with Active Models for Invariant Surface Reconstruction , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Demetri Terzopoulos,et al.  Signal matching through scale space , 1986, International Journal of Computer Vision.

[30]  Evangelos E. Milios Shape matching using curvature processes , 1989, Comput. Vis. Graph. Image Process..

[31]  Hemant D. Tagare Deformable 2-D template matching using orthogonal curves , 1997, IEEE Transactions on Medical Imaging.

[32]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[33]  Pascal Fua,et al.  Computational strategies for object recognition , 1992, CSUR.

[34]  Richard A. Volz,et al.  Recognizing Partially Occluded Parts , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Andrew P. Witkin,et al.  Scale-Space Filtering , 1983, IJCAI.

[36]  Arnold W. M. Smeulders,et al.  PicToSeek: combining color and shape invariant features for image retrieval , 2000, IEEE Trans. Image Process..

[37]  Euripides G. M. Petrakis,et al.  Efficient Shape Matching and Retrieval at Multiple Scales , 1998 .

[38]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[39]  L. Floreby,et al.  A multiscale algorithm for closed contour matching in image sequence , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[40]  Ellen M. Voorhees,et al.  Overview of the seventh text retrieval conference (trec-7) [on-line] , 1999 .

[41]  Mandyam D. Srinath,et al.  Contour sequence moments for the classification of closed planar shapes , 1987, Pattern Recognit..

[42]  Edward J. Delp,et al.  Partial Shape Recognition: A Landmark-Based Approach , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[44]  Kaleem Siddiqi,et al.  Parts of Visual Form: Computational Aspects , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Alok Gupta,et al.  Dynamic Programming for Detecting, Tracking, and Matching Deformable Contours , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Naonori Ueda,et al.  Learning Visual Models from Shape Contours Using Multiscale Convex/Concave Structure Matching , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Andrew P. Witkin,et al.  Scale-space filtering: A new approach to multi-scale description , 1984, ICASSP.

[48]  Ellen M. Voorhees,et al.  Overview of the Seventh Text REtrieval Conference , 1998 .