SMAC: Smart Multimedia Archiving for Conferences

With the advent of new technologies, an increasing amount of (scientific) conferences is being digitally recorded and archived for redistribution. Usually such conferences take the form of a series of talks where different speakers make use of slide-based presentations displayed as a slide-show during the speech. The data within these electronic documents can be used to improve video indexing to facilitating hence the retrieval of specific sequences within a specific video. In order to exploit such data it is however necessary to synchronize the video with the corresponding slide-show presentation. So far such synchronization has been done mainly manually. Nowadays, given the large amount of conferences being recorded, manual archiving is becoming a too time-consuming task that need to be automated. This paper presents an algorithm that automatically segments the video of the presentation and aligns each segment to the corresponding slide. Multiple tests have been done to evaluate the performance of the proposed algorithm and the obtained results, presented in the paper, prove the effectiveness of the proposed algorithm.

[1]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[2]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[3]  Tom E. Bishop,et al.  Blind Image Restoration Using a Block-Stationary Signal Model , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Andreas Girgensohn,et al.  Automatically linking multimedia meeting documents by image matching , 2000, HYPERTEXT '00.

[5]  John R. Kender,et al.  Analysis and enhancement of videos of electronic slide presentations , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[6]  Denis Lalanne,et al.  Looking at projected documents: event detection & document identification , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  Quanfu Fan,et al.  Matching slides to presentation videos using SIFT and scene background matching , 2006, MIR '06.

[8]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Mathias Rossignol,et al.  Multimedia Scenario Extraction and Content Indexing for E-Learning , 2007, 2007 International Workshop on Content-Based Multimedia Indexing.

[10]  David Franklin,et al.  Jabberwocky: you don't have to be a rocket scientist to change slides for a hydrogen combustion lecture , 2000, IUI '00.

[11]  Wei Jyh Heng,et al.  Automatic synchronization of speech transcript and slides in presentation , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[12]  Brian Christopher Smith,et al.  Passive capture and structuring of lectures , 1999, MULTIMEDIA '99.

[13]  Tanveer F. Syeda-Mahmood Indexing for topics in videos using foils , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Jean-Marc Odobez,et al.  OCR based slide retrieval , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[15]  Chong-Wah Ngo,et al.  Synchronization of lecture videos and electronic slides by video text analysis , 2003, MULTIMEDIA '03.