ABI: analogy-based indexing for content image retrieval

Abstract Morphogeometric-based metrics are not always appropriate to describe high-level contents of images as well as to formulate complex queries. People often find that two pictures as similar because they share relational predicates rather than objects attributes. In particular, images can be related because they are analogous . Scientists, for example, use analogies to trace art influences across different paints. In this paper, we focus on analogous relationships between groups of objects. The model we propose combines primitive properties by mean of a logical reasoning engine to produce a hierarchical image description. Each picture is decomposed into its spatial relations (physical layer), cognitive relations between objects within a group (group layer), and relations between groups (meta-group layer). This new Analogy Based Indexing (ABI for short) for Content Image Retrieval, allows users to express complex queries such as search for functional associations or group membership relations. A proof-of-concept prototype is also discussed to verify the precision and the efficiency of the proposed system. Furthermore, an embedded visual language enables pictorial queries composition and simplifies image annotation. The experimental results show the effectiveness of ABI in terms of precision vs. recall curve diagrams.

[1]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[2]  R. Manmatha,et al.  On computing global similarity in images , 1998, Proceedings Fourth IEEE Workshop on Applications of Computer Vision. WACV'98 (Cat. No.98EX201).

[3]  J. Zhang,et al.  Image retrieval for information systems , 1995, Electronic Imaging.

[4]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Proceedings of International Conference on Image Processing.

[5]  J. Feldman The role of objects in perceptual grouping. , 1999, Acta psychologica.

[6]  John P. Eakins,et al.  Automatic image content retrieval - are we getting anywhere? , 2002 .

[7]  Shih-Fu Chang,et al.  Querying by color regions using VisualSEEk content-based visual query system , 1997 .

[8]  Jacob Feldman,et al.  Regularity‐based Perceptual Grouping , 1997, Comput. Intell..

[9]  Arnold W. M. Smeulders,et al.  PicToSeek: A Color Image Invariant Retrieval System , 1998, Image Databases and Multi-Media Search.

[10]  S Edelman,et al.  A model of visual recognition and categorization. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[12]  Michael Stonebraker,et al.  Chabot: Retrieval from a Relational Database of Images , 1995, Computer.

[13]  Daniel Schlüter,et al.  Combining Contour and Region Information for Perceptual Grouping , 1998, DAGM-Symposium.

[14]  W. Eric L. Grimson,et al.  The Combinatorics Of Object Recognition In Cluttered Environments Using Constrained Search , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[15]  Stan Sclaroff,et al.  Distance to Deformable Prototypes: Encoding Shape Categories for Efficient Search , 1998, Image Databases and Multi-Media Search.

[16]  Stan Sclaroff,et al.  Deformable prototypes for encoding shape categories in image databases , 1995, Pattern Recognit..

[17]  Michele Nappi,et al.  Content-based Access in Image Database by Quantitative Relationships , 2000, J. Vis. Lang. Comput..

[18]  K. Wakimoto,et al.  Efficient and Effective Querying by Image Content , 1994 .

[19]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[20]  Thomas P. Minka,et al.  An image database browser that learns from user interaction , 1996 .

[21]  Peter Stanchev,et al.  Content-Based Image Retrieval Systems , 2001 .

[22]  Takeo Kanade,et al.  Intelligent Access to Digital Video: Informedia Project , 1996, Computer.

[23]  Peter G. B. Enser,et al.  Progress in Documentation Pictorial Information Retrieval , 1995, J. Documentation.

[24]  A. Jacobs,et al.  Localist connectionist approaches to human cognition , 1998 .

[25]  Peter G. B. Enser Pictorial information retrieval , 1995 .

[26]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[27]  Nozha Boujemaa,et al.  Surfimage: a flexible content-based image retrieval system , 1998, MULTIMEDIA '98.

[28]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[29]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[30]  Shimon Edelman,et al.  Similarity, Connectionism, and the Problem of Representation in Vision , 1997, Neural Computation.

[31]  D. Gentner,et al.  Structure mapping in analogy and similarity. , 1997 .

[32]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Other Conferences.

[33]  Douglas R. Hofstadter,et al.  Fluid Concepts and Creative Analogies , 1995 .

[34]  Dragutin Petkovic,et al.  Content-based representation and retrieval of visual media: A state-of-the-art review , 1996, Multimedia Tools and Applications.

[35]  Toshikazu Kato,et al.  Visual Interaction with Electronic Art Gallery , 1990, DEXA.

[36]  J. Eakins Techniques for image retrieval , 1998 .