Visual image retrieval: seeking the alliance of concept-based and content-based paradigms

In the commercial use of picture collections, a heavy dependency continues to be exhibited on a concept-based image retrieval paradigm in which the query is verbalised by the client and resolved as a metadata text-matching operation. The practical and philosophical challenges posed by the indexing aspect of image metadata construction are significant and frequently expressed. Nevertheless, it has taken image digitisation to bring this particular information retrieval problem to prominence in the research agenda. Metamorphosed into a binary data structure, the digital image offers some enticing processing opportunities which content-based image retrieval techniques are exploiting with developing success. Drawing on studies of user need, this paper seeks to explain why a heavy dependency will continue to be placed on concept-based rather than content-based image retrieval techniques within archival image collections. In contrast, the promising nature of content-based techniques from the viewpoint of a growing clientele with less traditional visual information needs will also be considered. The paper concludes by offering the view that, while both concept-based and content-based approaches suffer from operational limitations, the further development of a hybrid image retrieval paradigm which combines the two approaches makes a potentially valuable contribution to the research agenda for visual image retrieval.

[1]  Amarnath Gupta,et al.  Visual information retrieval , 1997, CACM.

[2]  Raya Fidel,et al.  The image retrieval task: implications for the design and evaluation of image databases , 1997, New Rev. Hypermedia Multim..

[3]  Susanne Ornager Image Retrieval: Theoretical Analysis and Empirical User Studies on Accessing Information in Images. , 1997 .

[4]  Anthony E. Cawkell Selected aspects of image processing and management: review and future prospects , 1992, J. Inf. Sci..

[5]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[6]  K. Markey Interindexer consistency tests: a literature review and report of a test of consistency in indexing visual materials , 1984 .

[7]  Samantha Kelly Hastings,et al.  Query Categories in a Study of Intellectual Access to Digitized Art Images. , 1995 .

[8]  Peter G. B. Enser,et al.  Analysis of user need in image archives , 1997, J. Inf. Sci..

[9]  M. Markkula,et al.  Searching for Photos - Journalists' Practices in Pictorial IR , 1998 .

[10]  Hayit Greenspan,et al.  Finding Pictures of Objects in Large Collections of Images , 1996, Object Representation in Computer Vision.

[11]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[12]  J. P Eakins Pictorial information systems — prospects and problems , 1993 .

[13]  David A. Forsyth,et al.  Computer Vision Tools for Finding Images and Video Sequences , 1999, Libr. Trends.

[14]  Elaine Svenonius Access to nonbook materials: the limits of subject indexing for visual and aural languages , 1994 .

[15]  Howard Besser,et al.  Visual Access to Visual Images: The UC Berkeley Image Database Project , 1990 .

[16]  Shih-Fu Chang,et al.  Semantic visual templates: linking visual features to semantics , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[18]  Takeo Kanade,et al.  Intelligent Access to Digital Video: Informedia Project , 1996, Computer.

[19]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[20]  Vijay V. Raghavan,et al.  Content-Based Image Retrieval Systems - Guest Editors' Introduction , 1995, Computer.

[21]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[22]  Simone Santini,et al.  The Graphical Specification of Similarity Queries , 1996, J. Vis. Lang. Comput..

[23]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[24]  Boon-Lock Yeo,et al.  Video query: Research directions , 1998, IBM J. Res. Dev..

[25]  Raya Fidel,et al.  Challenges in Indexing Electronic Text and Images , 1994 .

[26]  Graham W. Horgan,et al.  Towards automatic recognition of plant varieties , 1998 .

[27]  Progress in Visual Information Access and Retrieval , 1999 .

[28]  Sara Shatford,et al.  Analyzing the Subject of a Picture: A Theoretical Approach , 1986 .

[29]  Howard Besser Image Databases: The First Decade, the Present, and the Future , 1996, Data Processing Clinic.

[30]  Peter G. B. Enser Pictorial Information Retrieval (Progress in Documentation) , 1995 .

[31]  E. Panofsky Meaning in the Visual Arts , 1970 .

[32]  Peter Stanchev,et al.  Content-Based Image Retrieval Systems , 2001 .

[33]  John P. Eakins,et al.  Automatic image content retrieval - are we getting anywhere? , 2002 .

[34]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[35]  Peter G. B. Enser,et al.  Progress in Documentation Pictorial Information Retrieval , 1995, J. Documentation.

[36]  Shih-Fu Chang,et al.  Efficient Techniques for Feature-Based Image/Video Access and Manipulation , 1996, Data Processing Clinic.

[37]  Samantha Kelly Hastings,et al.  Evaluation of Image Retrieval Systems: Role of User Feedback , 1999, Libr. Trends.

[38]  Susanne Ornager The newspaper image database: empirical supported analysis of users' typology and word association clusters , 1995, SIGIR '95.

[39]  P. Bryan Heidorn,et al.  Image Retrieval as Linguistic and Nonlinguistic Visual Model Matching , 1999, Libr. Trends.