Accessing News Video Libraries through Dynamic Information Extraction, Summarization, and Visualization

The Informedia Project has developed and evaluated surrogates, summary interfaces, and visualizations for accessing a digital video library containing thousands of documents and terabytes of data. This chapter begins with a review of Informedia surrogates for a single video document, including titles, storyboards, and skims. Incorporating textual elements, considering user context and emphasizing phrases over words have all led to better video surrogates. These lessons have driven the development of direct manipulation interfaces and visualization strategies for exploring news video libraries. Summarization strategies employed in the Informedia Project for sets of broadcast news video documents are discussed, concluding with the research challenges in building visual interfaces from vast quantities of image data and imperfect automatic video processing.

[1]  Yukinobu Taniguchi,et al.  An intuitive and efficient access interface to real-time incoming video based on automatic indexing , 1995, MULTIMEDIA '95.

[2]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[3]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.

[4]  Michael G. Christel,et al.  The effect of text in storyboards for video navigation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[5]  Michael G. Christel.  Visual digests for news video libraries , 1999, MULTIMEDIA '99.

[6]  Stephen G. Eick,et al.  Data visualization sliders , 1994, UIST '94.

[7]  Alain Breuleux,et al.  Multimedia and Comprehension: The Relationship among Text, Animation and Captions , 1995, J. Am. Soc. Inf. Sci..

[8]  Behzad Shahraray,et al.  Multimedia access and retrieval (panel session): the state of the art and future directions , 1999, MULTIMEDIA '99.

[9]  Gary Marchionini,et al.  Multimodal surrogates for video browsing , 1999, DL '99.

[10]  Michael G. Christel,et al.  Information Visualization Within a Digital Video Library , 1998, Journal of Intelligent Information Systems.

[11]  Ben Shneiderman,et al.  The eyes have it: a task by data type taxonomy for information visualizations , 1996, Proceedings 1996 IEEE Symposium on Visual Languages.

[12]  Gwen Nugent,et al.  Deaf Students' Learning From Captioned Instruction: the Relationship Between the Visual and Caption Display , 1983 .

[13]  Boon-Lock Yeo,et al.  Retrieving and visualizing video , 1997, CACM.

[14]  Robert R. Korfhage,et al.  Visualization of a Document Collection: The VIBE System , 1993, Inf. Process. Manag..

[15]  Andreas Girgensohn,et al.  An intelligent media browser using automatic multimodal analysis , 1998, MULTIMEDIA '98.

[16]  Alexander G. Hauptmann,et al.  Adjustable filmstrips and skims as abstractions for a digital video library , 1999, Proceedings IEEE Forum on Research and Technology Advances in Digital Libraries.

[17]  Michael G. Christel,et al.  Evolving video skims into useful multimedia abstractions , 1998, CHI.

[18]  Ben Shneiderman,et al.  Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays , 1994 .

[19]  Behzad Shahraray,et al.  On the applications of multimedia processing to communications , 1998, Proc. IEEE.

[20]  Gregory R. Crane,et al.  Drudgery and deep thought , 2001, CACM.

[21]  Dragutin Petkovic,et al.  Key to effective video retrieval: effective cataloging and browsing , 1998, MULTIMEDIA '98.

[22]  Yihong Gong,et al.  Lessons Learned from Building a Terabyte Digital Video Library , 1999, Computer.

[23]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[24]  Michael G. Christel,et al.  XSLT for tailored access to a digtal video library , 2001, JCDL '01.

[25]  Osamu Hori,et al.  A shot classification method of selecting effective key-frames for video browsing , 1997, MULTIMEDIA '96.

[26]  Wayne H. Wolf,et al.  Key frame selection by motion analysis , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[27]  Michael G. Christel,et al.  Improving Access to a Digital Video Library , 1997, INTERACT.

[28]  Shih-Fu Chang,et al.  Multimedia access and retrieval: the state of the art and future directions (panel session). , 1999, ACM Multimedia.

[29]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[30]  Ralph Weischedel,et al.  Named Entity Extraction from Broadcast News , 1999 .

[31]  Michael G. Christel,et al.  Interactive maps for a digital video library , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[32]  Tobun Dorbin Ng,et al.  Demonstration of hierarchical document clustering of digital library retrieval results , 2001, JCDL '01.