ALSBIR: A local-structure-based image retrieval

The general-purpose shape retrieval problem is a challenging task. Particularly, an ideal technique, which can work in clustered environment, meet the requirements of perceptual similarity measure on partial query and overcoming dimensionality curse and adverse environment, is in demand. This paper reports our study on one local structural approach that addresses these issues. Shape representation and indexing are two key points in shape retrieval. The proposed approach combines a novel local-structure-based shape representation and a new histogram indexing structure. The former makes possible partial shape matching of objects without the requirement of segmentation (separation) of objects from complex background, while the latter has an advantage on indexing performance. The search time is linearly proportional to the input complexity. In addition, the method is relatively robust under adverse environments. It is able to infer retrieval results from incomplete information of an input by first extracting consistent and structurally unique local neighborhood information from inputs or models, and then voting on the optimal matches. Thousands of images have been used to test the proposed concepts on sensitivity analysis, similarity-based retrieval, partial query and mixed object query. Very encouraging experimental results with respect to efficiency and effectiveness have been obtained.

[1]  Ramez Elmasri,et al.  Fundamentals of Database Systems , 1989 .

[2]  Linda G. Shapiro,et al.  Efficient image retrieval with multiple distance measures , 1997, Electronic Imaging.

[3]  Rajeev Motwani,et al.  Incremental clustering and dynamic information retrieval , 1997, STOC '97.

[4]  K. Koffka Principles Of Gestalt Psychology , 1936 .

[5]  Whoi-Yul Kim,et al.  Content-based trademark retrieval system using a visually salient feature , 1998, Image Vis. Comput..

[6]  A. Murat Tekalp,et al.  Partial shape recognition by sub-matrix matching for partial matching guided image labeling , 2005, Pattern Recognit..

[7]  S. Sclaroff,et al.  ImageRover: a content-based image browser for the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[8]  Benoit Huet,et al.  Relational object recognition from large structural libraries , 2002, Pattern Recognit..

[9]  Guojun Lu,et al.  Techniques and data structures for efficient multimedia retrieval based on similarity , 2002, IEEE Trans. Multim..

[10]  Stan Z. Li Shape Matching Based on Invariants , 2007 .

[11]  Yanling Chi,et al.  A Local Structure Matching Approach for Large Image Database Retrieval , 2004, ICIAR.

[12]  Robert Kohn,et al.  Representation and Self-Similarity of Shapes , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Akihiro Sugimoto,et al.  Range image registration preserving local structures of object surfaces , 2004, ICPR 2004.

[14]  Sang Uk Lee,et al.  A new shape decomposition scheme for graph-based representation , 2005, Pattern Recognit..

[15]  Ramesh C. Jain,et al.  Similarity indexing: algorithms and performance , 1996, Electronic Imaging.

[16]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[17]  Raj Jain,et al.  Algorithms and strategies for similarity retrieval , 1996 .

[18]  Horace Ho-Shing Ip,et al.  On relevance feedback and similarity measure for image retrieval with synergetic neural nets , 2003, Neurocomputing.

[19]  Mercedes M. Fisher,et al.  Gestalt Theory: A Foundation for Instructional Screen Design , 1999 .

[20]  Joonki Paik,et al.  Wavelet transform-based hierarchical active shape model for object tracking , 2004, Proceedings of 2004 International Symposium on Intelligent Signal Processing and Communication Systems, 2004. ISPACS 2004..

[21]  Theodosios Pavlidis,et al.  Algorithms for Shape Analysis of Contours and Waveforms , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Lucas J. van Vliet,et al.  Curvature of n-dimensional space curves in grey-value images , 2002, IEEE Trans. Image Process..

[23]  Yongsheng Gao,et al.  Face Recognition Using Line Edge Map , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Benoit Huet,et al.  Line Pattern Retrieval Using Relational Histograms , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Alberto Del Bimbo,et al.  Visual Image Retrieval by Elastic Matching of User Sketches , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Jean-Philippe Thiran,et al.  PCA in autocorrelation space , 2002, Object recognition supported by user interaction for service robots.

[27]  Eric Mjolsness,et al.  New Algorithms for 2D and 3D Point Matching: Pose Estimation and Correspondence , 1998, NIPS.

[28]  John P. Eakins,et al.  Shape Feature Matching for Trademark Image Retrieval , 2003, CIVR.

[29]  Hae-Kwang Kim,et al.  Region-based shape descriptor invariant to rotation, scale and translation , 2000, Signal Process. Image Commun..

[30]  Alessandra Lumini,et al.  Eigenspace merging for model updating , 2002, Object recognition supported by user interaction for service robots.

[31]  Rajiv Mehrotra,et al.  Similar-Shape Retrieval in Shape Data Management , 1995, Computer.

[32]  Terry Caelli,et al.  Invariance Signatures: Characterizing Contours by Their Departures from Invariance , 2000, Comput. Vis. Image Underst..

[33]  Mihran Tuceryan,et al.  Relative sensitivity of a family of closest-point graphs in computer vision applications , 1991, Pattern Recognit..

[34]  Jürg Nievergelt,et al.  The Grid File: An Adaptable, Symmetric Multikey File Structure , 1984, TODS.

[35]  Benjamin B. Kimia,et al.  Metric-based shape retrieval in large databases , 2002, Object recognition supported by user interaction for service robots.

[36]  Anil K. Jain,et al.  Shape-Based Retrieval: A Case Study With Trademark Image Databases , 1998, Pattern Recognit..

[37]  Herbert Freeman,et al.  On the Encoding of Arbitrary Geometric Configurations , 1961, IRE Trans. Electron. Comput..

[38]  Yukihiko Yamashita,et al.  Relative Karhunen-Loeve transform method for pattern recognition , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[39]  I. Biederman,et al.  Surface versus edge-based determinants of visual recognition , 1988, Cognitive Psychology.

[40]  Guojun Lu,et al.  Shape-based image retrieval using generic Fourier descriptor , 2002, Signal Process. Image Commun..

[41]  Christos Faloutsos,et al.  The TV-tree: An index structure for high-dimensional data , 1994, The VLDB Journal.

[42]  Bertrand Zavidovique,et al.  Content based image retrieval using optimum Peano scan , 2002, Object recognition supported by user interaction for service robots.

[43]  Miroslaw Bober,et al.  Curvature Scale Space Representation: Theory, Applications, and MPEG-7 Standardization , 2011, Computational Imaging and Vision.

[44]  Alberto Del Bimbo,et al.  Retrieval by Shape Similarity with Perceptual Distance and Effective Indexing , 2000, IEEE Trans. Multim..

[45]  Roland T. Chin,et al.  On Image Analysis by the Methods of Moments , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Laurence S. Dooley,et al.  Gestalt theory in visual screen design: a new look at an old subject , 2002 .

[47]  Benjamin B. Kimia,et al.  On the Intrinsic Reconstruction of Shape from Its Symmetries , 2003, IEEE Trans. Pattern Anal. Mach. Intell..