A genetic programming framework for content-based image retrieval

The effectiveness of content-based image retrieval (CBIR) systems can be improved by combining image features or by weighting image similarities, as computed from multiple feature vectors. However, feature combination do not make sense always and the combined similarity function can be more complex than weight-based functions to better satisfy the users' expectations. We address this problem by presenting a Genetic Programming framework to the design of combined similarity functions. Our method allows nonlinear combination of image similarities and is validated through several experiments, where the images are retrieved based on the shape of their objects. Experimental results demonstrate that the GP framework is suitable for the design of effective combinations functions.

[1]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[2]  Mukund Seshadri,et al.  Comprehensibility, Overfitting and Co-Evolution in Genetic Programming for Technical Trading Rules , 2003 .

[3]  Daniel Howard,et al.  Target detection in SAR imagery by genetic programming , 1999 .

[4]  Carla E. Brodley,et al.  Interactive Content-based Image Retrieval Using Relevance Feedback , 2002 .

[5]  Chiou-Shann Fuh,et al.  Local Ensemble Kernel Learning for Object Category Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Hong Zhao,et al.  Automatic feature weight assignment based on genetic algorithm for image retrieval , 2003, IEEE International Conference on Robotics, Intelligent Systems and Signal Processing, 2003. Proceedings. 2003.

[7]  Harris Wu,et al.  The effects of fitness functions on genetic programming-based ranking discovery forWeb search , 2004, J. Assoc. Inf. Sci. Technol..

[8]  Ricardo da Silva Torres,et al.  Contour salience descriptors for effective image retrieval and analysis , 2007, Image Vis. Comput..

[9]  Michael S. Lew,et al.  Principles of Visual Information Retrieval , 2001, Advances in Pattern Recognition.

[10]  Sharad Mehrotra,et al.  Similarity Search Using Multiple Examples in MARS , 1999, VISUAL.

[11]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[12]  Luciano da Fontoura Costa,et al.  A graph-based approach for multiscale shape analysis , 2004, Pattern Recognit..

[13]  Xuelong Li,et al.  Multitraining Support Vector Machine for Image Retrieval , 2006, IEEE Transactions on Image Processing.

[14]  Fatos T. Yarman-Vural,et al.  BAS: a perceptual shape descriptor based on the beam angle statistics , 2003, Pattern Recognit. Lett..

[15]  Weiguo Fan,et al.  Learning to advertise , 2006, SIGIR.

[16]  Bir Bhanu,et al.  Object detection in multi-modal images using genetic programming , 2004, Appl. Soft Comput..

[17]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[19]  Michael J. Swain,et al.  Color indexing , 1991, International Journal of Computer Vision.

[20]  Weiguo Fan,et al.  Image Retrieval with Relevance Feedback based on Genetic Programming , 2008, SBBD.

[21]  Longin Jan Latecki,et al.  Shape Similarity Measure Based on Correspondence of Visual Parts , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Peter Nordin,et al.  Genetic programming - An Introduction: On the Automatic Evolution of Computer Programs and Its Applications , 1998 .

[23]  Xuelong Li,et al.  Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm , 2006, IEEE Transactions on Multimedia.

[24]  Edward A. Fox,et al.  Intelligent fusion of structural and citation-based evidence for text classification , 2005, SIGIR '05.

[25]  Jitendra Malik,et al.  SVM-KNN: Discriminative Nearest Neighbor Classification for Visual Category Recognition , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  Ricardo da Silva Torres,et al.  Content-Based Image Retrieval: Theory and Applications , 2006, RITA.

[27]  Peter C. Fishburn,et al.  Nonlinear preference and utility theory , 1988 .

[28]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[29]  Luca Lombardi,et al.  Image classification: an evolutionary approach , 2002, Pattern Recognit. Lett..

[30]  John H. Holland,et al.  Adaptation in Natural and Artificial Systems: An Introductory Analysis with Applications to Biology, Control, and Artificial Intelligence , 1992 .

[31]  Xuelong Li,et al.  Which Components are Important for Interactive Image Searching? , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[32]  Theodosios Pavlidis,et al.  Optimal Correspondence of String Subsequences , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Jitendra Malik,et al.  Image Retrieval and Classification Using Local Distance Functions , 2006, NIPS.

[34]  Xuelong Li,et al.  Negative Samples Analysis in Relevance Feedback , 2007, IEEE Transactions on Knowledge and Data Engineering.

[35]  Yasufumi Takama,et al.  Mathematical aggregation operators in image retrieval: effect on retrieval performance and role in relevance feedback , 2005, Signal Process..

[36]  Bir Bhanu,et al.  Genetic algorithm based feature selection for target detection in SAR images , 2003, Image Vis. Comput..

[37]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Harris Wu,et al.  The effects of fitness functions on genetic programming-based ranking discovery for Web search: Research Articles , 2004 .