An Architecture of a Web-Based Collaborative Image Search Engine

We present a perception-based paradigm for image retrieval. The central component of this paradigm is a query-concept learner, which can learn users' subjective query concepts through an intelligent sampling process. We show that the learner can collect user feedback and use it to perform collaborative image annotation in addition to learning subjective query concepts. On the one hand, the improved annotation can help provide better initial keyword-search results to seed perception-based image retrieval. On the other hand, the more effective image-research results can further refine annotation quality. The users of the system collaboratively help improve search quality through the query-concept learner. Our empirical results show that an image retrieval system powered by this perception-based paradigm performs significantly better than traditional systems in search accuracy, in multimodal integration, and in capability for personalization.

[1]  Amarnath Gupta,et al.  Visual information retrieval , 1997, CACM.

[2]  Giuseppe Riva,et al.  Treating body-image disturbances , 1997, CACM.

[3]  Eddy Mayoraz,et al.  Improved Pairwise Coupling Classification with Correcting Classifiers , 1998, ECML.

[4]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[5]  Edward Y. Chang,et al.  RIME: a replicated image detector for the World Wide Web , 1998, Other Conferences.

[6]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[7]  Andrew McCallum,et al.  Employing EM and Pool-Based Active Learning for Text Classification , 1998, ICML.

[8]  Susan T. Dumais,et al.  Inductive learning algorithms and representations for text categorization , 1998, CIKM '98.

[9]  Shih-Fu Chang,et al.  VisualSEEk: a fully automated content-based image query system , 1997, MULTIMEDIA '96.

[10]  Rafail Ostrovsky,et al.  Efficient search for approximate nearest neighbor in high dimensional spaces , 1998, STOC '98.

[11]  Edward Y. Chang,et al.  PBIR - perception-based image retrieval , 2001, SIGMOD '01.

[12]  Marco Patella,et al.  PAC nearest neighbor queries: Approximate and controlled search in high-dimensional and metric spaces , 2000, Proceedings of 16th International Conference on Data Engineering (Cat. No.00CB37073).

[13]  Kenneth L. Clarkson,et al.  An algorithm for approximate closest-point queries , 1994, SCG '94.

[14]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[15]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[16]  Yoav Freund,et al.  Boosting the margin: A new explanation for the effectiveness of voting methods , 1997, ICML.

[17]  Umesh V. Vazirani,et al.  An Introduction to Computational Learning Theory , 1994 .

[18]  Edward Y. Chang,et al.  SVM binary classifier ensembles for image classification , 2001, CIKM '01.

[19]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[20]  Edward Y. Chang,et al.  PBIR: perception-based image retrieval-a system that can quickly capture subjective image query concepts , 2001, MULTIMEDIA '01.

[21]  Edward Y. Chang,et al.  Indexing Images in High-Dimensional and Dynamic-Weighted Feature Spaces , 2002, VDB.

[22]  David A. Forsyth,et al.  Clustering art , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[24]  L. Breiman.  Arcing classifier (with discussion and a rejoinder by the author) , 1998 .

[25]  Hector Garcia-Molina,et al.  Safeguarding and charging for information on the Internet , 1998, Proceedings 14th International Conference on Data Engineering.

[26]  Kyuseok Shim,et al.  WALRUS: a similarity retrieval algorithm for image databases , 1999, IEEE Transactions on Knowledge and Data Engineering.

[27]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[28]  Thorsten Joachims,et al.  Text Categorization with Support Vector Machines: Learning with Many Relevant Features , 1998, ECML.

[29]  E. Y. Chang,et al.  Toward perception-based image retrieval , 2000, 2000 Proceedings Workshop on Content-based Access of Image and Video Libraries.

[30]  Ingemar J. Cox,et al.  Target testing and the PicHunter Bayesian multimedia retrieval system , 1996, Proceedings of the Third Forum on Research and Technology Advances in Digital Libraries,.

[31]  Piotr Indyk,et al.  Approximate nearest neighbors: towards removing the curse of dimensionality , 1998, STOC '98.

[32]  Christopher J. C. Burges,et al.  A Tutorial on Support Vector Machines for Pattern Recognition , 1998, Data Mining and Knowledge Discovery.

[33]  Leslie G. Valiant,et al.  Learning Boolean formulas , 1994, JACM.

[34]  Shlomo Argamon,et al.  Committee-Based Sampling For Training Probabilistic Classi(cid:12)ers , 1995 .

[35]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.

[36]  Sunil Arya,et al.  An optimal algorithm for approximate nearest neighbor searching fixed dimensions , 1998, JACM.

[37]  Thorsten Joachims,et al.  Text categorization with support vector machines , 1999 .

[38]  M.L. Miller,et al.  Hidden annotation in content based image retrieval , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[39]  Dale Schuurmans,et al.  Boosting in the Limit: Maximizing the Margin of Learned Ensembles , 1998, AAAI/IAAI.

[40]  David A. Forsyth,et al.  Learning the semantics of words and pictures , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[41]  Hector Garcia-Molina,et al.  Copy detection mechanisms for digital documents , 1995, SIGMOD '95.

[42]  Mary Czerwinski,et al.  Semi-Automatic Image Annotation , 2001, INTERACT.

[43]  Jon M. Kleinberg,et al.  Two algorithms for nearest-neighbor search in high dimensions , 1997, STOC '97.

[44]  A. Murat Tekalp,et al.  Region-Based Shape Matching for Automatic Image Annotation and Query-by-Example , 1997, J. Vis. Commun. Image Represent..

[45]  James Ze Wang,et al.  SIMPLIcity: Semantics-Sensitive Integrated Matching for Picture LIbraries , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[47]  Sougata Mukherjea,et al.  AMORE: A World Wide Web image retrieval engine , 1999, World Wide Web.

[48]  James Ze Wang,et al.  IRM: integrated region matching for image retrieval , 2000, ACM Multimedia.