The video explorer: a tool for navigation and searching within a single video based on fast content analysis

We propose a video browsing tool supporting new efficient navigation means and content-based search within a single video, allowing for interactive exploration and playback of video content. The user interface provides flexible navigation indices by visualizing low-level features and frame surrogates along one or more timelines, called interactive navigation summaries. By applying simple and fast content analysis, navigation summary computation becomes feasible during browsing, enabling addition, removal, and update of navigation summaries at runtime. Semantically similar video segments will be visualized by similar patterns in certain navigation summaries, which enables users to quickly recognize and navigate to potential similar segments. Moreover, free-shape regions of video frames or video segments within navigation summaries can be selected by the user to launch a fast content-based search to find frames with similar regions or segments with similar navigation summaries.

[1]  Jean Carletta,et al.  Image Analysis and Processing Workshops, 2007. ICIAPW 2007. 14th International Conference on , 2007 .

[2]  Mathias Lux,et al.  Visualization of video motion in context of video browsing , 2009, 2009 IEEE International Conference on Multimedia and Expo.

[3]  Neema Moraveji.  Improving video browsing with an eye-tracking evaluation of feature-based color bars , 2004, Proceedings of the 2004 Joint ACM/IEEE Conference on Digital Libraries, 2004..

[4]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[5]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[6]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[7]  Denis Pellerin,et al.  Interactive Visualization Tool with Graphic Table of Video Contents , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[8]  Willemijn Heeren,et al.  Videotrees: Improving video surrogate presentation using hierarchy , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[9]  Michael G. Christel.  Evaluation and user studies with respect to video summarization and browsing , 2006, Electronic Imaging.

[10]  Marco Ceccarelli,et al.  The color browser: a content driven linear video browsing tool , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[11]  Pinar Duygulu Sahin,et al.  Searching for repeated video sequences , 2007, MIR '07.

[12]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[13]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[14]  Svetha Venkatesh,et al.  Temporal semantic compression for video browsing , 2008, IUI '08.

[15]  Steve Benford,et al.  EmoPlayer: A media player for video clips with affective annotations , 2008, Interact. Comput..

[16]  Werner Bailer,et al.  A Tool Supporting Annotation and Analysis of Videos , 2007 .

[17]  Pierre Dragicevic,et al.  Video browsing by direct manipulation , 2008, CHI.

[18]  Bing-Yu Chen,et al.  SmartPlayer: user-centric video fast-forwarding , 2009, CHI.

[19]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.

[20]  Pierangelo Migliorati,et al.  Interactive visualization of video content and associated description for semantic annotation , 2009, Signal Image Video Process..

[21]  Marcel Worring,et al.  Concept-Based Video Retrieval , 2009, Found. Trends Inf. Retr..

[22]  Klaus Schöffmann,et al.  Video Browsing Using Interactive Navigation Summaries , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[23]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[24]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[25]  A. Divakaran,et al.  A Video-Browsing-Enhanced Personal Video Recorder , 2007, 14th International Conference of Image Analysis and Processing - Workshops (ICIAPW 2007).

[26]  Marcel Worring,et al.  Query on demand video browsing , 2007, ACM Multimedia.