Interactive Video Search: Where is the User in the Age of Deep Learning?

In this tutorial we discuss interactive video search tools and methods, review their need in the age of deep learning, and explore video and multimedia search challenges and their role as evaluation benchmarks in the field of multimedia information retrieval. We cover three different campaigns (TRECVID, Video Browser Showdown, and the Lifelog Search Challenge), discuss their goals and rules, and present their achieved findings over the last half-decade. Moreover, we talk about datasets, tasks, evaluation procedures, and examples of interactive video search tools, as well as how they evolved over the years. Participants of this tutorial will be able to gain collective insights from all three challenges and use them for focusing their research efforts on outstanding problems that still remain unsolved in this area.

[1]  George Awad,et al.  On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017 , 2018, IEEE Transactions on Multimedia.

[2]  Klaus Schöffmann,et al.  The ITEC Collaborative Video Search System at the Video Browser Showdown 2018 , 2018, MMM.

[3]  Mohammad Soleymani,et al.  The Benchmarking Initiative for Multimedia Evaluation: MediaEval 2016 , 2017, IEEE Multim..

[4]  Klaus Schöffmann,et al.  LSE2018 Panel - Challenges of Lifelog Search and Access , 2018, LSC@ICMR.

[5]  Klaus Schöffmann,et al.  Video Interaction Tools , 2015, ACM Comput. Surv..

[6]  Jakub Lokoc,et al.  Using an Interactive Video Retrieval Tool for LifeLog Data , 2018, LSC@ICMR.

[7]  Jakub Lokoc,et al.  Revisiting SIRET Video Retrieval Tool , 2018, MMM.

[8]  William Ribarsky,et al.  Multimedia Analysis + Visual Analytics = Multimedia Analytics , 2010, IEEE Computer Graphics and Applications.

[9]  Marcel Worring,et al.  Where Is the User in Multimedia Retrieval? , 2012, IEEE Multim..

[10]  Klaus Schöffmann,et al.  lifeXplore at the Lifelog Search Challenge 2018 , 2018, LSC@ICMR.

[11]  Werner Bailer,et al.  Comparing fact finding tasks and user survey for evaluating a video browsing tool , 2009, ACM Multimedia.

[12]  Luca Rossetto,et al.  Interactive video search tools: a detailed analysis of the video browser showdown 2015 , 2016, Multimedia Tools and Applications.

[13]  Cathal Gurrin,et al.  Virtual Reality Lifelog Explorer: Lifelog Search Challenge at ACM ICMR 2018 , 2018, LSC@ICMR.

[14]  Martha Larson,et al.  User Intent in Multimedia Search , 2016, ACM Comput. Surv..

[15]  Georges Quénot,et al.  TRECVID 2017: Evaluating Ad-hoc and Instance Video Search, Events Detection, Video Captioning and Hyperlinking , 2017, TRECVID.