Semantic kernel learning for interactive image retrieval

Content-based image retrieval systems still have difficulties to bridge the semantic gap between the low-level representation of images and the high level concepts the user is looking for. Relevance feedback methods deal with this problem using labels provided by users, but only during the current retrieval session. In this paper, we introduce a semantic learning method to manage user labels in CBIR applications. Our approach uses a kernel matrix to represent semantic information in a statistical learning framework. The kernel matrix is updated according to labels provided by users after retrieval sessions. Experiments have been carried out on a large generalist database in order to validate our approach.

[1]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[2]  Murat Kunt,et al.  Content-based retrieval from image databases: current solutions and future directions , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[3]  Michael I. Jordan,et al.  Distance Metric Learning with Application to Clustering with Side-Information , 2002, NIPS.

[4]  Matthieu Cord,et al.  Long-term similarity learning in content-based image retrieval , 2002, Proceedings. International Conference on Image Processing.

[5]  Matthieu Cord,et al.  RETIN AL: an active learning strategy for image category retrieval , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[6]  Douglas R. Heisterkamp Building a latent semantic index of an image database from patterns of relevance feedback , 2002, Object recognition supported by user interaction for service robots.

[7]  Thierry Pun,et al.  Long-Term Learning from User Behavior in Content-Based Image Retrieval , 2000 .

[8]  John P. Eakins,et al.  Towards intelligent image retrieval , 2002, Pattern Recognit..

[9]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[10]  Simone Santini,et al.  Emergent Semantics through Interaction in Image Databases , 2001, IEEE Trans. Knowl. Data Eng..