A Hierarchical Keyframe User Interface for Browsing Video over the Internet

We present an interactive content-based video browser allowing fast, non linear and hierarchical navigation of video over the Internet through multiple levels of key-frames that provide a visual summary of video content. Our method is based on an XML framework, dynamically generated parameterized XSL style sheets, and SMIL. The architecture is designed to incorporate additional recognized features (e.g. from audio) in future versions. The last part of this paper describes a user study which indicates that this browsing interface is more comfortable to use and approximately three times faster for locating remembered still images within videos compared to the simple VCR controls built into RealPlayer.

[1]  Michael R. Lyu,et al.  ADVISE: Advanced Digital Video Information Segmentation Engine , 2002 .

[2]  Jean-Marc Odobez,et al.  Spectral Structuring of Home Videos , 2003, CIVR.

[3]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[4]  Ming-Ting Sun,et al.  Finding Structure in Consumer Videos by Probabilistic Hierarchical Clustering , 2002 .

[5]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[6]  John R. Smith,et al.  Video summarization and personalization for pervasive mobile devices , 2001, IS&T/SPIE Electronic Imaging.

[7]  Alexander C. Loui,et al.  Finding structure in home videos by probabilistic hierarchical clustering , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Jean-Marc Odobez,et al.  Algorithms for Video Structuring , 2002 .

[9]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[10]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[11]  P. ed Hoschka,et al.  synchronized Multimedia Integration Language (SMIL) 1.0 Specification , 1998 .

[12]  A. Divakaran,et al.  Content-based browsing system for personal video recorders , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[13]  Steve Mack,et al.  Streaming Media Bible , 2002 .

[14]  Malcolm Slaney,et al.  Multimedia edges: finding hierarchy in all dimensions , 2001, MULTIMEDIA '01.

[15]  Regunathan Radhakrishnan,et al.  Motion activity-based extraction of key-frames from video shots , 2002, Proceedings. International Conference on Image Processing.

[16]  Andreas Girgensohn,et al.  Keyframe-Based User Interfaces for Digital Video , 2001, Computer.