Videotrees: Improving video surrogate presentation using hierarchy

As the amount of available video content increases, so does the need for better ways of browsing all this material. Because the nature of video makes it hard to process, the need arises for adequate surrogates for video that can readily be skimmed and browsed. In this paper, the effects of the use of hierarchy in a pictorial summary of keyframes are explored, and a novel type of video surrogate is presented: the VideoTree. Moreover, a prototype browser was developed and tested in a preliminary usability study. This showed that users performed better using the VideoTrees browser than using a regular storyboard-based browser. They also found it more flexible, but more difficult to use.

[1]  Kent L. Norman,et al.  Development of an instrument measuring user satisfaction of the human-computer interface , 1988, CHI '88.

[2]  Hemalata Iyer,et al.  Prioritization strategies for video storyboard keyframes , 2007, J. Assoc. Inf. Sci. Technol..

[3]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[4]  Fred D. Davis.  Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology , 1989, MIS Q..

[5]  De Xu,et al.  Content-based video retrieval using the shot cluster tree , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[6]  De Xu,et al.  Hierarchical Video Summarization Based on Video Structure and Highlight , 2006, SSPR/SPR.

[7]  Jianping Fan,et al.  ClassView: hierarchical video shot classification, indexing, and accessing , 2004, IEEE Transactions on Multimedia.

[8]  Andreas Dieberger,et al.  Hierarchical brushing in a collection of video data , 2001, Proceedings of the 34th Annual Hawaii International Conference on System Sciences.

[9]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[10]  Christian Petersohn.  Fraunhofer HHI at TRECVID 2004: Shot Boundary Detection System , 2004, TRECVID.

[11]  Jianping Fan,et al.  A hierarchical access control model for video database systems , 2003, TOIS.

[12]  Ramana Rao,et al.  A focus+context technique based on hyperbolic geometry for visualizing large hierarchies , 1995, CHI '95.

[13]  Yelena Yesha,et al.  Keyframe-based video summarization using Delaunay clustering , 2006, International Journal on Digital Libraries.

[14]  Frank R. Abate,et al.  The new Oxford American dictionary , 2001 .

[15]  Dragutin Petkovic,et al.  "What is in that Video Anyway?" In Search of Better Browsing , 1999, ICMCS, Vol. 1.

[16]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[17]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[18]  Gary Marchionini,et al.  Multimodal surrogates for video browsing , 1999, DL '99.

[19]  Boon-Lock Yeo,et al.  Video visualization for compact presentation and fast browsing of pictorial content , 1997, IEEE Trans. Circuits Syst. Video Technol..

[20]  Marcel Worring,et al.  The Mediamill Semantic Video Search Engine , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[21]  Gary Marchionini,et al.  Key frame preview techniques for video browsing , 1998, DL '98.

[22]  Ivan Herman,et al.  Graph Visualization and Navigation in Information Visualization: A Survey , 2000, IEEE Trans. Vis. Comput. Graph..

[23]  Alan F. Smeaton,et al.  Designing the User Interface for the Físchlár Digital Video Library , 2006, J. Digit. Inf..

[24]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[25]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.