An integrated content and metadata based retrieval system for art

A new approach to image retrieval is presented in the domain of museum and gallery image collections. Specialist algorithms, developed to address specific retrieval tasks, are combined with more conventional content and metadata retrieval approaches, and implemented within a distributed architecture to provide cross-collection searching and navigation in a seamless way. External systems can access the different collections using interoperability protocols and open standards, which were extended to accommodate content based as well as text based retrieval paradigms. After a brief overview of the complete system, we describe the novel design and evaluation of some of the specialist image analysis algorithms, including a method for image retrieval based on sub-image queries, retrievals based on very low quality images and retrieval using canvas crack patterns. We show how effective retrieval results can be achieved by real end-users consisting of major museums and galleries, accessing the distributed, but integrated, digital collections.

[1]  Shih-Fu Chang,et al.  Querying by color regions using VisualSEEk content-based visual query system , 1997 .

[2]  William Vaughan,et al.  Computers and the History of Art , 1990 .

[3]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Mark Needleman.  ZING—Z39.50 International: Next Generation , 2002 .

[5]  Guoping Qiu.  Color image indexing using BTC , 2003, IEEE Trans. Image Process..

[6]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[7]  Fazly Salleh Abas,et al.  Classification of painting cracks for content-based analysis , 2003, IS&T/SPIE Electronic Imaging.

[8]  Dragutin Petkovic,et al.  The QBIC Project in the Department of Art and Art History at UC Davis , 1997 .

[9]  Paul H. Lewis,et al.  Interoperability between Multimedia Collections for Content and Metadata-Based Searching , 2002, WWW 2002.

[10]  Alberto Del Bimbo,et al.  Visual Querying By Color Perceptive Regions , 1998, Pattern Recognit..

[11]  Kirk Martinez,et al.  VIPS: an image processing system for large images , 1996, Electronic Imaging.

[12]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[13]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[14]  Spike L. Bucklow,et al.  A Stylometric Analysis of Craquelure , 1997, Comput. Humanit..

[15]  Peter G. B. Enser,et al.  Towards a Comprehensive Survey of the Semantic Gap in Visual Image Retrieval , 2003, CIVR.

[16]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Ramin Zabih,et al.  Comparing images using color coherence vectors , 1997, MULTIMEDIA '96.

[18]  Fatos T. Yarman-Vural,et al.  A Compact Shape Descriptor Based on the Beam Anlge Statistics , 2003, CIVR.

[19]  Ioannis Pitas,et al.  Digital restoration of painting cracks , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[20]  Fazly Salleh Abas,et al.  Craquelure analysis for content-based retrieval , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[21]  Robert Tansley,et al.  Automating the linking of content and concept , 2000, ACM Multimedia.

[22]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[23]  Bin Zhu,et al.  Creating a large-scale content-based airphoto image digital library , 2000, IEEE Trans. Image Process..

[24]  Nicu Sebe,et al.  The State of the Art in Image and Video Retrieval , 2003, CIVR.

[25]  Stephen Chi-fai Chan,et al.  Handling Sub-Image Queries In Content-Based Retrieval of High Resolution Art Images , 2001, ICHIM.

[26]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[27]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[28]  Paul H. Lewis,et al.  Texture-based image retrieval using multiscale subimage matching , 2003, IS&T/SPIE Electronic Imaging.

[29]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[30]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[31]  Anna van Raaphorst.  RDF (Resource Description Framework) , 2006 .

[32]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[33]  F. Meyer.  Iterative image transformations for an automatic screening of cervical smears. , 1979, The journal of histochemistry and cytochemistry : official journal of the Histochemistry Society.

[34]  Paul H. Lewis,et al.  Using Colour Pair Patches for Image Retrieval , 2002, CGIV.