Learning in content-based image retrieval

In this paper we address several aspects of the learning problem in content-based image retrieval (CBIR). First, we introduce the linear and kernel-based biased discriminant analysis, or BiasMap, to fit the unique nature of relevance feedback as a small sample biased classification problem. Secondly, a WARF (word association via relevance feedback) formula is presented for learning keyword relations during the process of relevance feedback. We also introduce our new user interface for CBIR, ImageGrouper, which is designed to support more sophisticated user feedbacks and annotations. Finally, we use the D-EM (Discriminant-EM) algorithm as a way of exploiting unlabeled data in CBIR and offer some insights as to when unlabeled data will help.

[1]  Thomas S. Huang,et al.  Small sample learning during multimedia retrieval using BiasMap , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Thomas S. Huang,et al.  Unifying Keywords and Visual Contents in Image Retrieval , 2002, IEEE Multim..

[3]  T. S. Huang,et al.  Exploring the nature and variants of relevance feedback , 2001, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001).

[4]  Edward Y. Chang,et al.  Learning image query concepts via intelligent sampling , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[5]  Thomas S. Huang,et al.  Image processing , 1971 .

[6]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[7]  Thomas S. Huang,et al.  Visualization and Layout for Personal Photo Libraries , 2001 .

[8]  Fabio Gagliardi Cozman,et al.  The effect of unlabeled data on generative classifiers, with application to model selection , 2002 .

[9]  D. Angluin.  Queries and Concept Learning , 1988 .

[10]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[11]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[12]  Thomas S. Huang,et al.  ImageGrouper: Search, Annotate and Organize Images by Groups , 2002, VISUAL.

[13]  Gerald Salton,et al.  Automatic text processing , 1988 .

[14]  Fabio Gagliardi Cozman,et al.  Unlabeled Data Can Degrade Classification Performance of Generative Classifiers , 2002, FLAIRS.

[15]  Thomas S. Huang,et al.  Edge-based structural features for content-based image retrieval , 2001, Pattern Recognit. Lett..

[16]  William A. Gale,et al.  A sequential algorithm for training text classifiers , 1994, SIGIR '94.

[17]  Ying Wu,et al.  Towards Self-Exploring Discriminating Features , 2001, MLDM.

[18]  Stan Z. Li,et al.  Extraction of feature subspaces for content-based retrieval using relevance feedback , 2001, MULTIMEDIA '01.

[19]  B. Scholkopf,et al.  Fisher discriminant analysis with kernels , 1999, Neural Networks for Signal Processing IX: Proceedings of the 1999 IEEE Signal Processing Society Workshop (Cat. No.98TH8468).

[20]  Thomas S. Huang,et al.  Optimizing learning in image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[21]  Qi Tian,et al.  Discriminant-EM algorithm with application to image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[22]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[23]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[24]  Ying Wu,et al.  Self-Supervised Learning for Object Recognition based on Kernel Discriminant-EM Algorithm , 2001, ICCV.

[25]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.