Enhancing Comprehension of Events in Video Through Explanation-on-Demand Hypervideo

The objective of this paper is to help users navigate for additional information for more comprehension of events in video through an explanation-on-demand hypervideo system. Given an XML database consisting of MPEG-7 video annotations and ontologies specifying relationships among events in annotations, the system is responsible for dynamically identifying hyperlinks inside a video that users possibly follow to clarify the points they do not understand. Three types of hyperlinks that are helpful in enhancing user comprehension of events are proposed: context, precondition and causal, which are based on an analysis of Fellbaum's verb entailments [4].

[1]  D. Arijon,et al.  Grammar of Film Language , 1976 .

[2]  Katsumi Tanaka,et al.  Towards a Unified Framework for Context-Preserving Video Retrieval and Summarization , 2005, ICADL.

[3]  Robert B. Allen,et al.  Browsing the structure of multimedia stories , 2000, DL '00.

[4]  Frank M. Shipman,et al.  Generation of interactive multi-level video summaries , 2003, ACM Multimedia.

[5]  Marcel Worring,et al.  Multimodal Video Indexing : A Review of the State-ofthe-art , 2001 .

[6]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[7]  Philip Resnik,et al.  Measuring Verb Similarity , 2000 .

[8]  Ted Pedersen,et al.  WordNet::Similarity - Measuring the Relatedness of Concepts , 2004, NAACL.

[9]  Andrew Salway,et al.  Temporal Information in Collateral Texts for Indexing Movies , 2002 .

[10]  Chutiporn Anutariya,et al.  A Data Model for XML Databases , 2001, Journal of Intelligent Information Systems.

[11]  Wendy G. Lehnert.  Plot Units and Narrative Summarization , 1981 .

[12]  G. Miller,et al.  A Semantic Network of English Verbs , 1998 .

[13]  Patrick Pantel,et al.  VerbOcean: Mining the Web for Fine-Grained Semantic Verb Relations , 2004, EMNLP.

[14]  Kenneth B. Haase.  Context for semantic metadata , 2004, MULTIMEDIA '04.

[15]  Yan Xu,et al.  Navigating stories in films , 2005 .

[16]  John R. Smith,et al.  On the detection of semantic concepts at TRECVID , 2004, MULTIMEDIA '04.

[17]  Edward A. Fox.  Digital Libraries: Implementing Strategies and Sharing Experiences, 8th International Conference on Asian Digital Libraries, ICADL 2005, Bangkok, Thailand, December 12-15, 2005, Proceedings , 2005, ICADL.