Interactive Video Retrieval in the Age of Deep Learning

We present a tutorial focusing on video retrieval tasks, where state-of-the-art deep learning approaches still benefit from interactive decisions of users. The tutorial covers general introduction to the interactive video retrieval research area, state-of-the-art video retrieval systems, evaluation campaigns and recently observed results. Moreover, a significant part of the tutorial is dedicated to a practical exercise with three selected state-of-the-art systems in the form of an interactive video retrieval competition. Participants of this tutorial will gain a practical experience and also a general insight of the interactive video retrieval topic, which is a good start to focus their research on unsolved challenges in this area.

[1]  Jakub Lokoc,et al.  VIRET: A Video Retrieval Tool for Interactive Known-item Search , 2019, ICMR.

[2]  Jakub Lokoc,et al.  VIRET Tool Meets NasNet , 2019, MMM.

[3]  Rami Albatal,et al.  A Test Collection for Interactive Lifelog Retrieval , 2019, MMM.

[4]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[5]  Heiko Schuldt,et al.  vitrivr: A Flexible Retrieval Stack Supporting Multiple Query Modes for Searching in Multimedia Collections , 2016, ACM Multimedia.

[6]  Minh-Triet Tran,et al.  [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018) , 2019, ITE Transactions on Media Technology and Applications.

[7]  Klaus Schöffmann,et al.  Autopiloting Feature Maps: The Deep Interactive Video Exploration (diveXplore) System at VBS2019 , 2019, MMM.

[8]  George Awad,et al.  Interactive Video Search: Where is the User in the Age of Deep Learning? , 2018, ACM Multimedia.

[9]  Georges Quénot,et al.  TRECVID 2017: Evaluating Ad-hoc and Instance Video Search, Events Detection, Video Captioning and Hyperlinking , 2017, TRECVID.

[10]  George Awad,et al.  On Influential Trends in Interactive Video Retrieval: Video Browser Showdown 2015–2017 , 2018, IEEE Transactions on Multimedia.

[11]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  George Awad,et al.  V3C - a Research Video Collection , 2018, MMM.

[13]  Ralph Gasser,et al.  Interactive Search or Sequential Browsing? A Detailed Analysis of the Video Browser Showdown 2018 , 2019, ACM Trans. Multim. Comput. Commun. Appl..

[14]  Jakub Lokoc,et al.  Using an Interactive Video Retrieval Tool for LifeLog Data , 2018, LSC@ICMR.

[15]  Heiko Schuldt,et al.  Deep Learning-Based Concept Detection in vitrivr , 2018, MMM.