Active Learning for Interactive Multimedia Retrieval Algorithms that employ feedback from users to guide the search process can provide relatively rapid and efficient results from large multimedia data collections.

As the first decade of the 21st century comes to a close, growth in multimedia delivery infrastructure and public demand for applications built on this backbone are converging like never before. The push towards reaching truly interactive multimedia technologies becomes stronger as our media consumption paradigms continue to change. In this paper, we will profile a technology leading the way in this revolution: active learning. Active learning is a strategy that helps alleviate challenges inherent in multimedia information re- trieval through user interaction. We will show how active learning is ideally suited for the multimedia information retrieval problem by giving an overview of the paradigm and component technologies used with special attention given to the application scenarios in which these technologies are useful. Finally, we give insight into the future of this growing field and how it fits into the larger context of multimedia information retrieval.

[1]  John P. Eakins,et al.  Similarity Retrieval of Trademark Images , 1998, IEEE Multim..

[2]  Edward Y. Chang,et al.  Support vector machine active learning for image retrieval , 2001, MULTIMEDIA '01.

[3]  Bir Bhanu,et al.  Active concept learning for image retrieval in dynamic databases , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[4]  Michael Fink,et al.  Social- and Interactive-Television Applications Based on Real-Time Ambient-Audio Identification , 2006 .

[5]  Edward Y. Chang,et al.  Support Vector Machine Concept-Dependent Active Learning for Image Retrieval , 2005 .

[6]  Thomas S. Huang,et al.  Evaluating group-based relevance feedback for content-based image retrieval , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[7]  Thomas S. Huang,et al.  Combining diversity-based active learning with discriminant analysis in image retrieval , 2005, Third International Conference on Information Technology and Applications (ICITA'05).

[8]  ByoungChul Ko,et al.  Probabilistic neural networks supporting multi-class relevance feedback in region-based image retrieval , 2002, Object recognition supported by user interaction for service robots.

[9]  Kriengkrai Porkaew,et al.  Query refinement for multimedia similarity retrieval in MARS , 1999, MULTIMEDIA '99.

[10]  D. Angluin.  Queries and Concept Learning , 1988 .

[11]  Daniel P. W. Ellis,et al.  Song-Level Features and Support Vector Machines for Music Classification , 2005, ISMIR.

[12]  Yee Whye Teh,et al.  Names and faces in the news , 2004, CVPR 2004.

[13]  Thomas S. Huang,et al.  Exploration of Visual Data , 2003, The Springer International Series in Video Computing.

[14]  Jenq-Neng Hwang,et al.  Attentional focus training by boundary region data selection , 1992, [Proceedings 1992] IJCNN International Joint Conference on Neural Networks.

[15]  Yoram Singer,et al.  An Efficient Boosting Algorithm for Combining Preferences by , 2013 .

[16]  J. T. Foote,et al.  "Content-Based Retrieval of Music and Audio," Multimedia Storage and Archiving System II , 1997 .

[17]  Suk I. Yoo,et al.  A Neural Network-Based Image Retrieval Using Nonlinear Combination of Heterogeneous Features , 2001, Int. J. Comput. Intell. Appl..

[18]  Thomas S. Huang,et al.  Utilizing Information Theoretic Diversity for SVM Active Learn , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[19]  Thomas S. Huang,et al.  Small sample learning during multimedia retrieval using BiasMap , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[20]  Thomas S. Huang,et al.  Leveraging Active Learning for Relevance Feedback Using an Information Theoretic Diversity Measure , 2006, CIVR.

[21]  Yanjun Qi,et al.  Automated analysis of nursing home observations , 2004, IEEE Pervasive Computing.

[22]  Paul A. Viola,et al.  Empirical Entropy Manipulation for Real-World Problems , 1995, NIPS.

[23]  Daniel P. W. Ellis,et al.  Support vector machine active learning for music retrieval , 2006, Multimedia Systems.

[24]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[25]  Thomas S. Huang,et al.  A Discussion of Nonlinear Variants of Biased Discriminants for Interactive Image Retrieval , 2004, CIVR.

[26]  Meng Wang,et al.  Semi-automatic video annotation based on active learning with multiple complementary predictors , 2005, MIR '05.

[27]  H. Sebastian Seung,et al.  Selective Sampling Using the Query by Committee Algorithm , 1997, Machine Learning.

[28]  Dan Roth,et al.  Generalization Bounds for the Area Under the ROC Curve , 2005, J. Mach. Learn. Res..

[29]  Tom M. Mitchell,et al.  Generalization as Search , 2002 .

[30]  David A. Forsyth,et al.  Words and Pictures in the News , 2003, HLT-NAACL 2003.

[31]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[32]  Antonio Torralba,et al.  LabelMe: A Database and Web-Based Tool for Image Annotation , 2008, International Journal of Computer Vision.

[33]  Thomas S. Huang,et al.  Relevance Feedback Techniques in Image Retrieval , 2001, Principles of Visual Information Retrieval.

[34]  Arnold W. M. Smeulders,et al.  Everything Gets Better All the Time, Apart from the Amount of Data , 2004, CIVR.

[35]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[36]  W. J. Studden,et al.  Theory Of Optimal Experiments , 1972 .

[37]  Deok-Hwan Kim,et al.  QCluster: relevance feedback using adaptive clustering for content-based image retrieval , 2003, SIGMOD '03.

[38]  Christos Faloutsos,et al.  MindReader: Querying Databases Through Multiple Examples , 1998, VLDB.

[39]  Klaus Brinker,et al.  Active learning of label ranking functions , 2004, ICML.

[40]  H. Sebastian Seung,et al.  Query by committee , 1992, COLT '92.