An Overview+Detail Surveillance Video Player: Information-Based Adaptive Fast-Forward

In this paper, we propose an adaptive fast playback framework where multi-features are used to support arbitrary frame-rate video playback. We introduce a Jenson noise-based difference (JSND) as a distance measure between adjacent frames for video key frame extraction, and then present an interest learning model to control the playback rate according to the user preference. The proposed “smart-skip” frame schema not only helps users navigate the video content non-uniformly for any variable playback rate, but also preserves video semantic information to avoid the omission of important events. An overview+detail video player offering users an immersive experience is implemented to browse and comprehend the video content. Experimental results show that users can quickly skim the video, understand the content, and navigate into the content of interest.

[1]  Noëlle Carbonell,et al.  Visual search in dynamic 3D visualisations of unstructured picture collections , 2010, Interact. Comput..

[2]  Xiao-Ping Zhang,et al.  A new player-enabled rapid video navigation method using temporal quantization and repeated weighted boosting search , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[3]  Ravin Balakrishnan,et al.  Fluid interaction techniques for the control and annotation of digital video , 2003, UIST '03.

[4]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[5]  Sidney S. Fels,et al.  Visualization of personal history for video navigation , 2014, CHI.

[6]  Xiao-Ping Zhang,et al.  A smart video player with content-based fast-forward playback , 2011, ACM Multimedia.

[7]  Gunther Heidemann,et al.  Information-based adaptive fast-forward for visual surveillance , 2011, Multimedia Tools and Applications.

[8]  Lap-Pui Chau,et al.  Variable frame rate transcoding considering motion information [video transcoding] , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[9]  Mateu Sbert,et al.  Selecting Video Key Frames Based on Relative Entropy and the Extreme Studentized Deviate Test , 2016, Entropy.

[10]  Mateu Sbert,et al.  Browsing and exploration of video sequences: A new scheme for key frame extraction and 3D visualization using entropy based Jensen divergence , 2014, Inf. Sci..

[11]  Chao-Yu Chen,et al.  Arbitrary frame skipping transcoding through spatial-temporal complexity analysis , 2007, TENCON 2007 - 2007 IEEE Region 10 Conference.

[12]  Anthony Vetro,et al.  Video transcoding architectures and techniques: an overview , 2003, IEEE Signal Process. Mag..

[13]  Klaus Schöffmann,et al.  Video Interaction Tools , 2015, ACM Comput. Surv..

[14]  Bing-Yu Chen,et al.  SmartPlayer: user-centric video fast-forwarding , 2009, CHI.

[15]  Nebojsa Jojic,et al.  Adaptive Video Fast Forward , 2005, Multimedia Tools and Applications.