Multi-object image retrieval based on shape and topology

We aim at developing a geometry-based retrieval system for multi-object images. We model both shape and topology of image objects including holes using a structured representation called curvature tree (CT); the hierarchy of the CT reflects the inclusion relationships between the objects and holes. To facilitate shape-based matching, triangle-area representation (TAR) of each object and hole is stored at the corresponding node in the CT. The similarity between two multi-object images is measured based on the maximum similarity subtree isomorphism (MSSI) between their CTs. For this purpose, we adapt a continuous optimization approach to solve the MSSI problem and a very effective dynamic programming algorithm to measure the similarity between the attributed nodes. Our matching scheme agrees with many recent findings in psychology about the human perception of multi-object images. Experiments on a database of 1500 logos and the MPEG-7 CE-1 database of 1400 shape images have shown the significance of the proposed method.

[1]  Pascal Monasse,et al.  Fast computation of a contrast-invariant image representation , 2000, IEEE Trans. Image Process..

[2]  Whoi-Yul Kim,et al.  A region-based shape descriptor using Zernike moments , 2000, Signal Process. Image Commun..

[3]  Noel E. O'Connor,et al.  A multiscale representation method for nonrigid shapes with a single closed contour , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[4]  John P. Eakins,et al.  ARTISAN: a shape retrieval system based on boundary family indexing , 1996, Electronic Imaging.

[5]  Immanuel M. Bomze,et al.  Evolution towards the Maximum Clique , 1997, J. Glob. Optim..

[6]  Remco C. Veltkamp,et al.  Content-based image retrieval systems: A survey , 2000 .

[7]  Suzanne L. Holcombe.  United States Patent and Trademark Office , 2008 .

[8]  Naif Alajlan,et al.  Shape retrieval using triangle-area representation and dynamic space warping , 2007, Pattern Recognit..

[9]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.

[10]  John P. Eakins,et al.  Shape Feature Matching for Trademark Image Retrieval , 2003, CIVR.

[11]  Philippe Salembier,et al.  Binary partition tree as an efficient representation for image processing, segmentation, and information retrieval , 2000, IEEE Trans. Image Process..

[12]  Kaleem Siddiqi,et al.  Matching Hierarchical Structures Using Association Graphs , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[14]  Farzin Mokhtarian,et al.  Scale-Based Description and Recognition of Planar Curves and Two-Dimensional Shapes , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using a visually salient feature , 1998, Image Vis. Comput..

[16]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[17]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[18]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[19]  Pascal Monasse,et al.  Scale-Space from a Level Lines Tree , 2000, J. Vis. Commun. Image Represent..

[20]  Hanan Samet,et al.  Using negative shape features for logo similarity matching , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[21]  Remco C. Veltkamp,et al.  State of the Art in Shape Matching , 2001, Principles of Visual Information Retrieval.

[22]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[23]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[24]  Essam A. El-Kwae,et al.  A robust framework for content-based retrieval by spatial similarity in image databases , 1999, TOIS.

[25]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  John P. Eakins,et al.  Towards intelligent image retrieval , 2002, Pattern Recognit..

[27]  Haibin Ling,et al.  Using the inner-distance for classification of articulated shapes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[28]  Euripides G. M. Petrakis,et al.  Matching and Retrieval of Distorted and Occluded Shapes Using Dynamic Programming , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Ulrich Eckhardt,et al.  Shape descriptors for non-rigid shapes with a single closed contour , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[30]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[31]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[32]  Alexander Dekhtyar,et al.  Information Retrieval , 2018, Lecture Notes in Computer Science.

[33]  Sven Loncaric,et al.  A survey of shape analysis techniques , 1998, Pattern Recognit..

[34]  Suh-Yin Lee,et al.  Retrieval of similar pictures on pictorial databases , 1991, Pattern Recognit..

[35]  Shu-Yuan Chen,et al.  Trademark shape recognition using closed contours , 1997, Pattern Recognit. Lett..

[36]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  Guojun Lu,et al.  Review of shape representation and description techniques , 2004, Pattern Recognit..

[38]  Kevin R. Harwell.  United States Patent and Trademark Office , 2002 .

[39]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[40]  Hae-Kwang Kim,et al.  Region-based shape descriptor invariant to rotation, scale and translation , 2000, Signal Process. Image Commun..

[41]  Kristinn R. Thórisson,et al.  Simulated Perceptual Grouping: An Application to Human-Computer Interaction , 2019, Proceedings of the Sixteenth Annual Conference of the Cognitive Science Society.

[42]  D. Gentner,et al.  Structure mapping in the comparison process. , 2000, The American journal of psychology.