An Efficiency Comparison of Two Content-Based Image Retrieval Systems, GIFT and PicSOM

Content-based image retrieval (CBIR) addresses the problem of assisting a user to retrieve images from unannotated databases, based on features that can be automatically derived from the images. Today, there exists several CBIR systems based on different methods. Only few attemps to benchmark these have been made, although the usefulness of benchmarking is undeniable in the development of different algorithms. In this paper we publish our benchmarking results of two CBIR systems with different implementation methods. The CBIR systems in question are GIFT (University of Geneva) and PicSOM (Helsinki University of Technology). The results clearly show that our PicSOM system, which we earlier have not been able to benchmark against other CBIR systems, comes off well in the comparison. Also, the results indicate that tests based on a single ground truth class are not enough for fair system comparisons.

[1]  Erkki Oja,et al.  MPEG-7 Descriptors in Content-Based Image Retrieval with PicSOM System , 2002, VISUAL.

[2]  Thierry Pun,et al.  MRML: an extensible communication protocol for interoperability and benchmarking of multimedia information retrieval systems , 2000, SPIE Optics East.

[3]  Stéphane Marchand-Maillet,et al.  An open framework for distributed multimedia retrieval , 2000, RIAO.

[4]  Erkki Oja,et al.  Implementing Relevance Feedback as Convolutions of Local Neighborhoods on Self-Organizing Maps , 2002, ICANN.

[5]  Erkki Oja,et al.  PicSOM-self-organizing image retrieval with MPEG-7 content descriptors , 2002, IEEE Trans. Neural Networks.

[6]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[7]  Erkki Oja,et al.  Self-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval , 2001, Pattern Analysis & Applications.

[8]  Thierry Pun,et al.  Performance evaluation in content-based image retrieval: overview and proposals , 2001, Pattern Recognit. Lett..

[9]  Thierry Pun,et al.  Efficient access methods for content-based image retrieval with inverted files , 1999, Optics East.

[10]  Pasi Koikkalainen,et al.  Self-organizing hierarchical feature maps , 1990, 1990 IJCNN International Joint Conference on Neural Networks.

[11]  Teuvo Kohonen,et al.  Self-Organizing Maps , 2010 .

[12]  Mika Rummukainen,et al.  Implementing Multimedia Retrieval Markup Language for image retrieval systems' comparison , 2003 .