Indexing pictorial documents by their content: a survey of current techniques

To efficiently solve the image retrieval problem in an image database, many techniques have been devised addressing the requirements of different applications. Present information management systems exploit these techniques to allow querying of pictorial documents archives. To do this, the first step is to extract relevant keys from the image content itself, so that images are not treated as illustrative appendices of textual documents. Even more important, the search process is not restricted to external attributes such as the storing date or the archive number. The kind of characteristics used to build the database index depends on the users' information needs for a given cognitive environment. Currently, the focus is on image color statistics and patterns (textures), on shapes and their spatial relations, or on a combination of these. This paper reviews indexing methods that are significant examples of techniques presently used.

[1]  Shi-Kuo Chang,et al.  Picture information measures for similarity retrieval , 1983, Comput. Vis. Graph. Image Process..

[2]  Chin-Chen Chang,et al.  Application of geometric hashing to iconic database retrieval , 1994, Pattern Recognit. Lett..

[3]  Jason Farradane,et al.  Relational Indexing. Part I , 1979 .

[4]  Marco Padula,et al.  Relational tools to manage pictorial information , 1992, J. Inf. Sci..

[5]  Azriel Rosenfeld,et al.  A geographic information system using quadtrees , 1984, Pattern Recognit..

[6]  Robert M. Haralick,et al.  Structural Descriptions and Inexact Matching , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Alberto Del Bimbo,et al.  Visual image retrieval by elastic deformation of object sketches , 1994, Proceedings of 1994 IEEE Symposium on Visual Languages.

[8]  S.-K. Chang,et al.  Smart image design for large image databases , 1992, J. Vis. Lang. Comput..

[9]  Suh-Yin Lee,et al.  Retrieval of similar pictures on pictorial databases , 1991, Pattern Recognit..

[10]  A. Ravishankar Rao,et al.  Identifying high-level features of texture perception , 1992, Electronic Imaging.

[11]  Bruce Tognazzini,et al.  Tog on Interface , 1992 .

[12]  Linda G. Shapiro,et al.  Relational Indexing , 1996, SSPR.

[13]  Stan Sclaroff,et al.  Object recognition and categorization using modal matching , 1994, Proceedings of 1994 IEEE 2nd CAD-Based Vision Workshop.

[14]  Gennaro Costagliola,et al.  A Remark on NP-Completeness of Picture Matching , 1991, Inf. Process. Lett..

[15]  William I. Grosky,et al.  Iconic Indexing using Gener-alised Pattern Matching Techniques , 1986 .

[16]  Patrick M. Kelly,et al.  CANDID: comparison algorithm for navigating digital image databases , 1994, Seventh International Working Conference on Scientific and Statistical Database Management.

[17]  Debra T. Burhans,et al.  Visual Semantics: Extracting Visual information from Text Accompanying Pictures , 1994, AAAI.

[18]  Shi-Kuo Chang,et al.  Image Information Systems: Where Do We Go From Here? , 1992, IEEE Trans. Knowl. Data Eng..

[19]  Alberto Del Bimbo,et al.  Sequence retrieval by contents through spatio temporal indexing , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[20]  Franjo Pernus,et al.  Two-dimensional object recognition using multiresolution non-information-preserving shape features , 1994, Pattern Recognit. Lett..

[21]  Piero Mussio,et al.  Metareasoning in the determination of image interpretation strategies , 1994, Pattern Recognit. Lett..

[22]  Michael J. O'Donnell,et al.  Geometric Problems with Application to Hashing , 1982, SIAM J. Comput..

[23]  Venkat N. Gudivada,et al.  Content-based image retrieval systems (panel) , 1995, CSC '95.

[24]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[25]  Shi-Kuo Chang,et al.  Iconic Indexing by 2-D Strings , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kenneth I. Laws,et al.  Rapid Texture Identification , 1980, Optics & Photonics.

[27]  Vijay V. Raghavan,et al.  Design and evaluation of algorithms for image retrieval by spatial similarity , 1995, TOIS.

[28]  Alberto Del Bimbo,et al.  3-D visual query language for image databases , 1992, J. Vis. Lang. Comput..

[29]  Suh-Yin Lee,et al.  Picture algebra for spatial reasoning of iconic images represented in 2D C-string , 1991, Pattern Recognit. Lett..

[30]  Allen Kent,et al.  Encyclopedia of Microcomputers , 1987 .

[31]  Rakesh Mohan,et al.  Multidimensional Indexing for Recognizing Visual Shapes , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[33]  Rohini K. Srihari,et al.  Automatic Indexing and Content-Based Retrieval of Captioned Images , 1995, Computer.

[34]  Freddy Fierens,et al.  Interactive outlining: an improved approach using active contours , 1993, Electronic Imaging.

[35]  William I. Grosky,et al.  Industrial part recognition using a component-index , 1990, Image Vis. Comput..

[36]  Fang Liu,et al.  A new Wold ordering for image similarity , 1994, Proceedings of ICASSP '94. IEEE International Conference on Acoustics, Speech and Signal Processing.

[37]  Euripides G. M. Petrakis,et al.  Methodology for the representation, indexing and retrieval of images by content , 1993, Image Vis. Comput..

[38]  Michael Stonebraker,et al.  Chabot: Retrieval from a Relational Database of Images , 1995, Computer.

[39]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[40]  Christos Faloutsos,et al.  Access methods for text , 1985, CSUR.

[41]  Gloria Bordogna,et al.  Iconic queries on pictorial data , 1989, [Proceedings] 1989 IEEE Workshop on Visual Languages.

[42]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[43]  Erland Jungert,et al.  An Algebra for Symbolic Image Manipulation and Transformation , 1989, Visual Database Systems.

[44]  T. W. Anderson,et al.  Statistical analysis of time series , 1972 .

[45]  David Salesin,et al.  Fast multiresolution image querying , 1995, SIGGRAPH.

[46]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[47]  Gennaro Costagliola,et al.  Representing and Retrieving Symbolic Pictures by Spatial Relations , 1991, Visual Database Systems.

[48]  Paul Suetens,et al.  A software environment for image database research , 1992, J. Vis. Lang. Comput..

[49]  Hanan Samet,et al.  The Quadtree and Related Hierarchical Data Structures , 1984, CSUR.

[50]  Suh-Yin Lee,et al.  2D C-string: A new spatial knowledge representation for image database systems , 1990, Pattern Recognit..

[51]  Zohar Manna,et al.  The Temporal Logic of Reactive and Concurrent Systems , 1991, Springer New York.

[52]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[53]  Gloria Bordogna,et al.  Pictorial indexing for an integrated pictorial and textual IR environment , 1990, J. Inf. Sci..

[54]  Gerald Salton,et al.  Automatic text processing , 1988 .

[55]  William I. Grosky,et al.  Index-based object recognition in pictorial data management , 1990, Comput. Vis. Graph. Image Process..

[56]  William I. Grosky,et al.  Hierarchical approach to feature indexing , 1994, Image Vis. Comput..

[57]  Toshikazu Kato,et al.  Query by Visual Example - Content based Image Retrieval , 1992, EDBT.

[58]  David Salesin,et al.  Wavelets for computer graphics: a primer.1 , 1995, IEEE Computer Graphics and Applications.

[59]  Erland Jungert,et al.  Qualitative spatial reasoning for determination of object relations using symbolic interval projections , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.