Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback

As the resolution of remote-sensing imagery increases, the full complexity of the scenes becomes increasingly difficult to approach. User-defined classes in large image databases are often composed of several groups of images and span very different scales in the space of low-level visual descriptors. The interactive retrieval of such image classes is then very difficult. To address this challenge, we evaluate here, in the context of satellite image retrieval, two general improvements for relevance feedback using support vector machines (SVMs). First, to optimize the transfer of information between the user and the system, we focus on the criterion employed by the system for selecting the images presented to the user at every feedback round. We put forward an active-learning selection criterion that minimizes redundancy between the candidate images shown to the user. Second, for image classes spanning very different scales in the low-level description space, we find that a high sensitivity of the SVM to the scale of the data brings about a low retrieval performance. We argue that the insensitivity to scale is desirable in this context, and we show how to obtain it by the use of specific kernel functions. Experimental evaluation of both ranking and classification performance on a ground-truth database of satellite images confirms the effectiveness of our approach

[1]  Patrick Haffner,et al.  Support vector machines for histogram-based image classification , 1999, IEEE Trans. Neural Networks.

[2]  Klaus Brinker,et al.  Incorporating Diversity in Active Learning with Support Vector Machines , 2003, ICML.

[3]  Jia Li,et al.  Large-scale Satellite Image Browsing using Automatic Semantic Categorization , 2005, Tenth IEEE International Conference on Computer Vision Workshops (ICCVW'05).

[4]  Edward Y. Chang,et al.  Statistical learning for effective visual information retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[5]  Daphne Koller,et al.  Support Vector Machine Active Learning with Application sto Text Classification , 2000, ICML.

[6]  Mihai Datcu,et al.  Spatial information retrieval from remote-sensing images. I. Information theoretical perspective , 1998, IEEE Trans. Geosci. Remote. Sens..

[7]  Mihai Datcu,et al.  Image information mining: exploration of image content in large archives , 2000, 2000 IEEE Aerospace Conference. Proceedings (Cat. No.00TH8484).

[8]  Colin Campbell,et al.  Bayes Point Machines , 2001, J. Mach. Learn. Res..

[9]  C. Berg,et al.  Harmonic Analysis on Semigroups , 1984 .

[10]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[11]  Vladimir Vapnik,et al.  Estimation of Dependences Based on Empirical Data: Springer Series in Statistics (Springer Series in Statistics) , 1982 .

[12]  Bo Zhang,et al.  Learning in Region-Based Image Retrieval , 2003, CIVR.

[13]  Selim Aksoy,et al.  Automated feature selection through relevance feedback , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[14]  Nozha Boujemaa,et al.  Upgrading Color Distributions for Image Retrieval: Can We Do Better? , 2000, VISUAL.

[15]  V. Vapnik Estimation of Dependences Based on Empirical Data , 2006 .

[16]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[17]  Mihai Datcu,et al.  Interactive learning and probabilistic retrieval in remote sensing image archives , 2000, IEEE Trans. Geosci. Remote. Sens..

[18]  Selim Aksoy,et al.  Learning bayesian classifiers for scene classification with a visual grammar , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[19]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[20]  Ziyou Xiong,et al.  Retrieval of multi- and hyperspectral images using an interactive relevance feedback form of content-based image retrieval , 2001, SPIE Defense + Commercial Sensing.

[21]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[22]  Ingemar J. Cox,et al.  An optimized interaction strategy for Bayesian relevance feedback , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[23]  Bernhard Schölkopf,et al.  Learning with kernels , 2001 .

[24]  Bernhard Schölkopf,et al.  The Kernel Trick for Distances , 2000, NIPS.

[25]  Nello Cristianini,et al.  Query Learning with Large Margin Classi ersColin , 2000 .

[26]  F. Fleuret,et al.  Scale-Invariance of Support Vector Machines based on the Triangular Kernel , 2001 .

[27]  Dominic Mazzoni,et al.  Automated Knowledge Discovery from Simulators , 2006, SDM.