Visualization of video motion in context of video browsing

We present a new approach for video browsing using visualization of motion direction and motion intensity statistics by color and brightness variations. Statistics are collected from motion vectors of H.264/AVC encoded video streams, so full video decoding is not required. By interpreting visualized motion patterns of video segments, users are able to quickly identify scenes similar to a prototype scene or identify potential scenes of interest. We give some examples of motion patterns with different semantic value, including camera zooms, hill jumps of ski-jumpers, and the repeated appearance of a news speaker. In a user study we show that certain scenes of interest can be found significantly faster using our video browsing tool than using a video player with VCR-like controls.

[1]  Robert Villa,et al.  FacetBrowser: a user interface for complex search tasks , 2008, ACM Multimedia.

[2]  Svetha Venkatesh,et al.  Temporal semantic compression for video browsing , 2008, IUI '08.

[3]  Klaus Schöffmann,et al.  Video Browsing Using Interactive Navigation Summaries , 2009, 2009 Seventh International Workshop on Content-Based Multimedia Indexing.

[4]  Riccardo Leonardi,et al.  An Intuitive Graphic Environment for Navigation and Classification of Multimedia Documents , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[5]  SmithAlvy Ray Color gamut transform pairs , 1978 .

[6]  Eric Li,et al.  MPEG Decoding Workload Characterization , 2003 .

[7]  Alvy Ray Smith,et al.  Color gamut transform pairs , 1978, SIGGRAPH.

[8]  Kuo-Chin Fan,et al.  A motion-flow-based fast video retrieval system , 2005, MIR '05.

[9]  Steve Benford,et al.  EmoPlayer: A media player for video clips with affective annotations , 2008, Interact. Comput..

[10]  A R Smith,et al.  Color Gamut Transformation Pairs , 1978 .