Adaptive locally affine-invariant shape matching

Matching deformable objects using their shapes are an important problem in computer vision since shape is perhaps the most distinguishable characteristic of an object. The problem is difficult due to many factors such as intra-class variations, local deformations, articulations, viewpoint changes and missed and extraneous contour portions due to errors in shape extraction. While small local deformations have been handled in the literature by allowing some leeway in the matching of individual contour points via methods such as Chamfer distance and Hausdorff distance, handling more severe deformations and articulations has been done by applying local geometric corrections such as similarity or affine. However, determining which portions of the shape should be used for the geometric corrections is very hard, although some methods have been tried. In this paper, we address this problem by an efficient search for the group of contour segments to be clustered together for a geometric correction using dynamic programming by essentially searching for the segmentations of two shapes that lead to the best matching between them. At the same time, we allow portions of the contours to remain unmatched to handle missing and extraneous contour portions. Experiments indicate that our method outperforms other algorithms, especially when the shapes to be matched are more complex.

[1]  Stefano Soatto,et al.  Shape Representation based on Integral Kernels: Application to Image Matching and Segmentation , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Jitendra Malik,et al.  Normalized Cuts and Image Segmentation , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  G. Borgefors Distance transformations in arbitrary dimensions , 1984 .

[4]  Philip N. Klein,et al.  On Aligning Curves , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Subhransu Maji,et al.  Object segmentation by alignment of poselet activations to image contours , 2011, CVPR 2011.

[6]  Anuj Srivastava,et al.  2D Affine and Projective Shape Analysis , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Nikos Paragios,et al.  Shape registration in implicit spaces using information theory and free form deformations , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Naif Alajlan,et al.  Geometry-Based Image Retrieval in Binary Image Databases , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Longin Jan Latecki,et al.  From partial shape matching through local deformation to robust global shape similarity for object detection , 2011, CVPR 2011.

[10]  Benjamin B. Kimia,et al.  Shapes, shocks, and deformations I: The components of two-dimensional shape and the reaction-diffusion space , 1995, International Journal of Computer Vision.

[11]  Mohammad Reza Daliri,et al.  Robust symbolic representation for shape recognition and retrieval , 2008, Pattern Recognit..

[12]  Pepe Siy,et al.  Robust shape similarity retrieval based on contour segmentation polygonal multiresolution and elastic matching , 2005, Pattern Recognit..

[13]  Song Wang,et al.  Two perceptually motivated strategies for shape classification , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Wenyu Liu,et al.  Fan Shape Model for object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Zhuowen Tu,et al.  Shape Matching and Recognition - Using Generative Models and Informative Features , 2004, ECCV.

[17]  Pedro F. Felzenszwalb Representation and detection of deformable shapes , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[18]  Alfred M. Bruckstein,et al.  Analysis of Two-Dimensional Non-Rigid Shapes , 2008, International Journal of Computer Vision.

[19]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[20]  Pushmeet Kohli,et al.  Associative hierarchical CRFs for object class image segmentation , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[21]  N. H. C. Yung,et al.  Curvature scale space corner detector with adaptive threshold and dynamic region of support , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[22]  Nelson H. C. Yung,et al.  Corner detector based on global and local curvature properties , 2008 .

[23]  Andrew Blake,et al.  Multiscale Categorical Object Recognition Using Contour Fragments , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[25]  Wenyu Liu,et al.  A Unified Curvature Definition for Regular, Polygonal, and Digital Planar Curves , 2008, International Journal of Computer Vision.

[26]  Yu Cao,et al.  2D nonrigid partial shape matching using MCMC and contour subdivision , 2011, CVPR 2011.

[27]  Junwei Wang,et al.  Shape matching and classification using height functions , 2012, Pattern Recognit. Lett..

[28]  Jitendra Malik,et al.  Efficient shape matching using shape contexts , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Boaz J. Super Retrieval from Shape Databases Using Chance Probability Functions and Fixed Correspondence , 2006, Int. J. Pattern Recognit. Artif. Intell..

[31]  Wenyu Liu,et al.  Convex shape decomposition , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[32]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[33]  Donald D. Hoffman,et al.  Parts of recognition , 1984, Cognition.

[34]  Wenyu Liu,et al.  Bag of contour fragments for robust shape classification , 2014, Pattern Recognit..

[35]  Boaz J. Super Learning Chance Probability Functions for Shape Retrieval or Classification , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[36]  Longin Jan Latecki,et al.  Shape guided contour grouping with particle filters , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[37]  Joshua D. Schwartz,et al.  Hierarchical Matching of Deformable Shapes , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Farzin Mokhtarian,et al.  Robust Image Corner Detection Through Curvature Scale Space , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[39]  Haibin Ling,et al.  An Efficient Earth Mover's Distance Algorithm for Robust Histogram Comparison , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Longin Jan Latecki,et al.  Locally constrained diffusion process on locally densified distance spaces with applications to shape retrieval , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Xiang Bai,et al.  Shape Vocabulary: A Robust and Efficient Shape Representation for Shape Matching , 2014, IEEE Transactions on Image Processing.

[42]  Longin Jan Latecki,et al.  Shape Similarity Measure Based on Correspondence of Visual Parts , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Wen Gao,et al.  A Shape Reconstructability Measure of Object Part Importance with Applications to Object Detection and Localization , 2014, International Journal of Computer Vision.

[44]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[45]  Ron Kimmel,et al.  On Bending Invariant Signatures for Surfaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Xiaoou Tang,et al.  2D Shape Matching by Contour Flexibility , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Zhuowen Tu,et al.  Learning Context-Sensitive Shape Similarity by Graph Transduction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[48]  Rama Chellappa,et al.  Fast directional chamfer matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Ronen Basri,et al.  Determining the similarity of deformable shapes , 1998, Vision Research.

[50]  Noel E. O'Connor,et al.  A multiscale representation method for nonrigid shapes with a single closed contour , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[51]  Qiang Wang,et al.  An elastic partial shape matching technique , 2007, Pattern Recognit..

[52]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[53]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.

[54]  Anurag Mittal,et al.  Multi-stage Contour Based Detection of Deformable Objects , 2008, ECCV.

[55]  Anurag Mittal,et al.  Part-based deformable object detection with a single sketch , 2015, Comput. Vis. Image Underst..

[56]  Philip N. Klein,et al.  Recognition of shapes by editing their shock graphs , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[57]  Sethu Vijayakumar,et al.  Hierarchical Procrustes Matching for Shape Retrieval , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[58]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Sven J. Dickinson,et al.  Bone graphs: Medial shape parsing and abstraction , 2011, Comput. Vis. Image Underst..

[60]  Ali Shokoufandeh,et al.  Shock Graphs and Shape Matching , 1998, International Journal of Computer Vision.

[61]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[62]  Rama Chellappa,et al.  Articulation-Invariant Representation of Non-planar Shapes , 2010, ECCV.

[63]  Rogério Schmidt Feris,et al.  Efficient partial shape matching using Smith-Waterman algorithm , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[64]  Jean-Michel Morel,et al.  Integral and local affine invariant parameter and application to shape recognition , 1994, Proceedings of 12th International Conference on Pattern Recognition.