Smart Video Browsing with Augmented Navigation Bars

While accuracy and speed get a lot of attention in video retrieval research, the investigation of interactive retrieval tools gets less attention and is often regarded as trivial. We want to show that even simple ideas have potential to improve the retrieval performance by giving some automated support to the browsing user. We present a video browsing concept where video segments are clustered in several latent classes of similar content. The navigation bars of our video browser are augmented with different colors indicating where elements of these clusters are located. As humans are able to classify the content of clusters fast, they can benefit from this information when browsing a video. We present a study where we investigated how humans can be supported in different video browsing tasks with a color-based and a motion-based clustering of video content.

[1]  Laszlo Böszörmenyi,et al.  Video Scene Detection Based on Recurring Motion Patterns , 2010, 2010 Second International Conferences on Advances in Multimedia.

[2]  László Böszörményi,et al.  AAU Video Browser: Non-Sequential Hierarchical Video Browsing without Content Analysis , 2012, MMM.

[3]  Mathias Lux,et al.  Visualization of video motion in context of video browsing , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[4]  Wolfgang Hürst,et al.  Interactive video browsing on mobile devices , 2007, ACM Multimedia.

[5]  Marcel Worring,et al.  Query on demand video browsing , 2007, ACM Multimedia.

[6]  Klaus Schöffmann,et al.  The video explorer: a tool for navigation and searching within a single video based on fast content analysis , 2010, MMSys '10.

[7]  Qingming Huang,et al.  A framework for flexible summarization of racquet sports video using multiple modalities , 2009, Comput. Vis. Image Underst..

[8]  Wolfgang Hürst.  Interactive audio-visual video browsing , 2006, MM '06.

[9]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[10]  Wolfgang Hürst,et al.  One-handed mobile video browsing , 2008, UXTV '08.

[11]  Neema Moraveji.  Improving video browsing with an eye-tracking evaluation of feature-based color bars , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[12]  A. Divakaran,et al.  A Video-Browsing-Enhanced Personal Video Recorder , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[13]  Dennis Koelma,et al.  The MediaMill TRECVID 2008 Semantic Video Search Engine , 2008, TRECVID.

[14]  Andreas Nürnberger,et al.  VideoSOM: A SOM-Based Interface for Video Browsing , 2006, CIVR.

[15]  Horst Eidenberger.  A Video Browsing Application based on visual MPEG-7 Descriptors and Self-Organising Maps , 2004 .

[16]  Marco Ceccarelli,et al.  The color browser: a content driven linear video browsing tool , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[17]  Frank Hopfgartner,et al.  Video browsing interfaces and applications: a review , 2010 .

[18]  Alexander G. Hauptmann,et al.  Advances in Multimedia Modeling - 18th International Conference, MMM 2012, Klagenfurt, Austria, January 4-6, 2012. Proceedings , 2012 .

[19]  Regunathan Radhakrishnan,et al.  Video Summarization Using Mpeg-7 Motion Activity and Audio Descriptors , 2003 .

[20]  Clifton Forlines,et al.  Rapid serial visual presentation techniques for consumer digital video devices , 2003, UIST '03.

[21]  Scott R. Klemmer,et al.  Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology , 2011, UIST 2011.

[22]  Gerald Friedland,et al.  Joke-o-mat: browsing sitcoms punchline by punchline , 2009, ACM Multimedia.

[23]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[24]  Rong Yan,et al.  Extreme video retrieval: joint maximization of human and computer performance , 2006, MM '06.

[25]  Xian-Sheng Hua,et al.  Smart video player , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[26]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.

[27]  Steve Benford,et al.  EmoPlayer: A media player for video clips with affective annotations , 2008, Interact. Comput..

[28]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).