Using knowledge of the region of interest (ROI) in automatic image retrieval learning

In this paper, we propose an automatic relevance feedback retrieval system using perceptually important features extracted from regions of interest. The system is implemented via self-learning using a self-organizing tree map (SOTM) neural network. Our proposed method involves the construction of regions of interest from retrieved images using edge flow model, and the grouping of the regions into a single perceptually significant entity. This knowledge is fed into a set of unsupervised relevance feedback learning modules based on the SOTM to guide the adaptation of relevance feedback parameters through a machine learning approach without user interaction. Optimal tradeoff between the user workload in the interactive process and user subjectivity is then be explored by incorporating a semi-automatic retrieval strategy. Experimental results indicate that this system, with automatic and semiautomatic adaptations, can minimize user interaction, optimize precision, as well as reduce performance errors caused user subjectivity.

[1]  Ling Guan,et al.  Characterization of perceptual importance for object-based image segmentation , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[2]  Yasufumi Takama,et al.  Relevance feedback-based image retrieval interface incorporating region and feature saliency patterns as visualizable image similarity criteria , 2003, IEEE Trans. Ind. Electron..

[3]  Ling Guan,et al.  Automatic machine interactions for content-based image retrieval using a self-organizing tree map architecture , 2002, IEEE Trans. Neural Networks.

[4]  Sanjit K. Mitra,et al.  Region-based video coder using edge flow segmentation and hierarchical affine region matching , 1998, Electronic Imaging.

[5]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  Milind R. Naphade,et al.  Audio-visual query and retrieval: A system that uses dynamic programming and relevance feedback , 2001, J. Electronic Imaging.

[7]  Ling Guan,et al.  Image retrieval with embedded sub-class information using Gaussian mixture models , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[8]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Ling Guan,et al.  Content-based image retrieval with automated relevance feedback over distributed peer-to-peer network , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[10]  B. S. Manjunath,et al.  Edge flow: A framework of boundary detection and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.