VideOlympics: Real-Time Evaluation of Multimedia Retrieval Systems

The first VideOlympics brings content-based analysis to the archive and allows for many-to- many communication between video search engines and their audience It was a great Success. The VideOlympics provided the excitement of a competition without the associated stress on the participants. For the first time, the audience was able to compare different multimedia retrieval systems on the same tasks and see how they performed with unrehearsed topics. Many audience members felt they understood the technology's capabilities after seeing it in live action and in several system variations.

[1]  Rong Yan,et al.  IBM multimedia search and retrieval system , 2007, CIVR '07.

[2]  Paul Over,et al.  Evaluation campaigns and TRECVid , 2006, MIR '06.

[3]  José Luis Vicedo González,et al.  TREC: Experiment and evaluation in information retrieval , 2007, J. Assoc. Inf. Sci. Technol..

[4]  Alexander G. Hauptmann,et al.  Successful approaches in the TREC video retrieval evaluations , 2004, MULTIMEDIA '04.

[5]  Christian Petersohn Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System , 2004, TRECVID.

[6]  Michael G. Christel Carnegie Mellon University traditional informedia digital video retrieval system , 2007, CIVR '07.

[7]  Sheng Tang,et al.  Active learning approach to interactive spatio-temporal news video retrieval , 2007, CIVR '07.

[8]  Yiannis Kompatsiaris,et al.  ITI interactive video retrieval system , 2007, CIVR '07.

[9]  John Adcock,et al.  FXPAL MediaMagic video search system , 2007, CIVR '07.

[10]  Marcel Worring,et al.  MediaMill: Semantic Video Browsing using the RotorBrowser , 2007 .

[11]  Duy-Dinh Le,et al.  Video search by multi-modal and clustering analysis , 2007, CIVR '07.

[12]  Shih-Fu Chang,et al.  Columbia University's semantic video search engine , 2007, CIVR '07.

[13]  Tat-Seng Chua Towards the next plateau: innovative multimedia research beyond trecvid , 2007, ACM Multimedia.

[14]  Marcel Worring,et al.  A Learned Lexicon-Driven Paradigm for Interactive Video Retrieval , 2007, IEEE Transactions on Multimedia.

[15]  Dong Wang,et al.  Video retrieval with multi-modal features , 2007, CIVR '07.