Active sample-selecting and manifold learning-based relevance feedback method for synthetic aperture radar image retrieval

Content-based image retrieval (CBIR) provides an effective way to address the increasing need for intelligent data access to synthetic aperture radar (SAR) image repositories. In CBIR, a critical component is relevance feedback (RF), which is used to bridge the ‘semantic gap’. This study proposes a new RF method with active sample-selecting and manifold learning for CBIR of SAR images. In this method, the authors adopt a modified maximum margin projection with a new neighbourhood estimation criterion to discover both the geometrical structure and discriminant structure of the underlying data manifold. In order to achieve a satisfactory performance with limited feedback samples, the authors also propose an active sample selection strategy with which the diversity of feedback samples can be increased while the redundancy is decreased. The authors test our method on a TerraSAR-X image database and compare it with four other state-of-the-art RF methods. The superiority and validity of the authors’ method is proved by the retrieval results and the computing cost is acceptable for image retrieval applications.

[1]  Wei-Ying Ma,et al.  Learning an image manifold for retrieval , 2004, MULTIMEDIA '04.

[2]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[3]  Qionghai Dai,et al.  Multilabel Neighborhood Propagation for Region-Based Image Retrieval , 2008, IEEE Transactions on Multimedia.

[4]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[5]  Rong Jin,et al.  Batch Mode Active Learning with Applications to Text Categorization and Image Retrieval , 2009, IEEE Transactions on Knowledge and Data Engineering.

[6]  Marin Ferecatu,et al.  Interactive Remote-Sensing Image Retrieval Using Active Relevance Feedback , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[7]  Seiji Yamada,et al.  Semisupervised Query Expansion with Minimal Feedback , 2007, IEEE Transactions on Knowledge and Data Engineering.

[8]  Paul A. Viola,et al.  Boosting Image Retrieval , 2004, International Journal of Computer Vision.

[9]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Thomas S. Huang,et al.  Relevance feedback techniques in interactive content-based image retrieval , 1997, Electronic Imaging.

[11]  Konstantinos N. Plataniotis,et al.  Regularization studies of linear discriminant analysis in small sample size scenarios with application to face recognition , 2005, Pattern Recognit. Lett..

[12]  Juyang Weng,et al.  Using Discriminant Eigenfeatures for Image Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[14]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[15]  Wenyin Liu,et al.  Joint semantics and feature based image retrieval using relevance feedback , 2003, IEEE Trans. Multim..

[16]  Matthieu Cord,et al.  Active Learning Methods for Interactive Image Retrieval , 2008, IEEE Transactions on Image Processing.

[17]  Stan Z. Li,et al.  Extraction of feature subspaces for content-based retrieval using relevance feedback , 2001, MULTIMEDIA '01.

[18]  Konstantinos N. Plataniotis,et al.  Face recognition using LDA-based algorithms , 2003, IEEE Trans. Neural Networks.

[19]  Martti Hallikainen,et al.  Retrieval of biomass in boreal forests from multitemporal ERS-1 and JERS-1 SAR images , 1999, IEEE Trans. Geosci. Remote. Sens..

[20]  Jiawei Han,et al.  Learning a Maximum Margin Subspace for Image Retrieval , 2008, IEEE Transactions on Knowledge and Data Engineering.

[21]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[23]  Helmut Rott,et al.  Retrieval of wet snow by means of multitemporal SAR data , 2000, IEEE Trans. Geosci. Remote. Sens..

[24]  Mikhail Belkin,et al.  Semi-Supervised Learning on Riemannian Manifolds , 2004, Machine Learning.

[25]  David G. Stork,et al.  Pattern Classification , 1973 .

[26]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[27]  Chiou-Ting Hsu,et al.  Image retrieval with relevance feedback based on graph-theoretic region correspondence estimation , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..