Automatic generation of video summaries for historical films

A video summary is a sequence of video clips extracted from a longer video. Much shorter than the original, the summary preserves its essential messages. In the ECHO (European Chronicles On-line) project, a system was developed to store and manage large collections of historical films for the preservation of cultural heritage. At the University of Mannheim, we have developed the video summarization component of the ECHO system. We discuss the particular challenges the historical film material poses, and how we have designed new video processing algorithms and modified existing ones to cope with noisy black-and-white films.

[1]  Tobun Dorbin Ng,et al.  Collages as dynamic summaries for news video , 2002, MULTIMEDIA '02.

[2]  Tobun Dorbin Ng,et al.  Collages as Dynamic Summaries of Mined Video Content for Intelligent Multimedia Knowledge Management , 2003 .

[3]  Shih-Fu Chang,et al.  A utility framework for the automatic generation of audio-visual skims , 2002, MULTIMEDIA '02.

[4]  John R. Kender,et al.  Video Summaries through Mosaic-Based Shot and Scene Clustering , 2002, ECCV.

[5]  Alexander G. Hauptmann,et al.  Adjustable filmstrips and skims as abstractions for a digital video library , 1999, Proceedings IEEE Forum on Research and Technology Advances in Digital Libraries.

[6]  Howard D. Wactlar,et al.  Informedia - Search and Summarization in the Video Medium , 2000 .

[7]  Rainer Lienhart,et al.  Verfahren zur Inhaltsanalyse, zur Indizierung und zum Vergleich von digitalen Videosequenzen , 1998 .

[8]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[9]  Andrew Zisserman,et al.  Feature Based Methods for Structure and Motion Estimation , 1999, Workshop on Vision Algorithms.

[10]  Anil C. Kokaram,et al.  Simultaneous luminance and position stabilization for film and video , 2003, IS&T/SPIE Electronic Imaging.

[11]  Anoop Gupta,et al.  Time-compression: systems concerns, usage, and benefits , 1999, CHI '99.

[12]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[13]  Boon-Lock Yeo,et al.  Extracting story units from long programs for video browsing and navigation , 1996, Proceedings of the Third IEEE International Conference on Multimedia Computing and Systems.

[14]  Shingo Uchihashi,et al.  An interactive comic book presentation for exploring video , 2000, CHI.

[15]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[16]  Anoop Gupta,et al.  Browsing digital video , 2000, CHI.

[17]  Rainer Lienhart.  Dynamic video summarization of home video , 1999, Electronic Imaging.

[18]  Thomas Haenselmann,et al.  Segmentation and Classification of Moving Video Objects , 2003 .

[19]  Gerald Kühne,et al.  Contour-based classification of video objects , 2001, IS&T/SPIE Electronic Imaging.

[20]  Wolfgang Effelsberg,et al.  Robust clustering-based video-summarization with integration of domain-knowledge , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[21]  Shingo Uchihashi,et al.  Video Manga: generating semantically meaningful video summaries , 1999, MULTIMEDIA '99.

[22]  Takeo Kanade,et al.  Neural Network-Based Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Dragutin Petkovic,et al.  Using audio time scale modification for video browsing , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.