Interactive Multimedia Search: Systems for Exploration and Collaboration

We have developed an interactive video search system that allows the searcher to rapidly assess query results and easily pivot o those results to form new queries. The system is intended to maximize the use of the discriminative power of the human searcher. The typical video search scenario we consider has a single searcher with the ability to search with text and content-based queries. In this paper, we evaluate a new collaborative modication of our search system. Using our system, two or more users with a common information need search together, simultaneously. The collaborative system provides tools, user interfaces and, most importantly, algorithmically-mediated retrieval to focus, enhance and augment the team’s search and communication activities. In our evaluations, algorithmic mediation improved the collaborative performance of both retrieval (allowing a team of searchers to nd relevant information more eciently and eectively),

[1]  Alan F. Smeaton,et al.  Físchlár-DiamondTouch: collaborative video searching on a table , 2006, Electronic Imaging.

[2]  Sheng Tang,et al.  Interactive Spatio-Temporal Visual Map Model for Web Video Retrieval , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[3]  Susan T. Dumais,et al.  Using Linear Algebra for Intelligent Information Retrieval , 1995, SIAM Rev..

[4]  Rong Yan,et al.  Extreme video retrieval: joint maximization of human and computer performance , 2006, MM '06.

[5]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[7]  Alan F. Smeaton,et al.  A usage study of retrieval modalities for video shot retrieval , 2006, Inf. Process. Manag..

[8]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[9]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[10]  Robert Chen,et al.  FXPAL at TRECVID 2005 , 2005, TRECVID.

[11]  John Adcock,et al.  FXPAL Experiments for TRECVID 2004 , 2004, TRECVID.

[12]  John Adcock,et al.  FXPAL Interactive Search Experiments for TRECVID 2007 , 2007, TRECVID.

[13]  P. Good Permutation, Parametric, and Bootstrap Tests of Hypotheses (Springer Series in Statistics) , 1994 .

[14]  Jiebo Luo,et al.  Large-scale multimodal semantic concept detection for consumer video , 2007, MIR '07.

[15]  Gene Golovchinsky,et al.  What the query told the link: the integration of hypertext and information retrieval , 1997, HYPERTEXT '97.

[16]  Christian Petersohn Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System , 2004, TRECVID.

[17]  Rong Yan,et al.  Merging storyboard strategies and automatic retrieval for improving interactive video search , 2007, CIVR '07.

[18]  John Adcock,et al.  Interactive Video Search Using Multilevel Indexing , 2005, CIVR.

[19]  Marcel Worring,et al.  The challenge problem for automated detection of 101 semantic concepts in multimedia , 2006, MM '06.

[20]  Franciska de Jong,et al.  Annotation of Heterogeneous Multimedia Content Using Automatic Speech Recognition , 2007, SAMT.

[21]  John Adcock,et al.  A Synergistic Approach to Efficient Interactive Video Retrieval , 2005, INTERACT.

[22]  Barry Smyth,et al.  A Live-User Evaluation of Collaborative Web Search , 2005, IJCAI.

[23]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[24]  Paul Over,et al.  TRECVID 2007--Overview , 2007, TRECVID.

[25]  David M. Nichols,et al.  Browsing is a collaborative process , 1997, Inf. Process. Manag..

[26]  John Adcock,et al.  FXPAL at TRECVID 2006 , 2006, TRECVID.

[27]  Javed A. Aslam,et al.  A unified model for metasearch and the efficient evaluation of retrieval systems via the hedge algorithm , 2003, SIGIR '03.

[28]  Yoshua Bengio,et al.  Convergence Properties of the K-Means Algorithms , 1994, NIPS.

[29]  Dong Wang,et al.  Video search in concept subspace: a text-like paradigm , 2007, CIVR '07.

[30]  José A. Pino,et al.  A first step to formally evaluate collaborative work , 1997, GROUP.

[31]  Eric Horvitz,et al.  SearchTogether: an interface for collaborative web search , 2007, UIST.

[32]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.