Electronic slide matching and enhancement of a lecture video

This paper presents an automatic method to enhance video presentations for distance learning applications. From a material recorded by a fixed, non professional camera, the system matches the slides displayed during the presentation with their electronic versions. The process to achieve slide recognition consists of two phases. In the first phase, the location where the slides are displayed is located by colour matching. Then a shot detection is performed in the display area and a frame is selected for each slide displayed in the video. The second phase consists of matching the frames previously selected to the electronic version of the slides. Using correlation measure, a likelihood is computed for each electronic slide to correspond to the slides displayed in the frames selected. A prior distribution is then defined to model the probability of each possible slide transition. Finally the most probable sequence of slides displayed in the video is determined using the Viterbi algorithm. The results show that the method presented is robust against luminance conditions, occlusion by the lecturer and can be performed for a large variety of presentations. (7 pages)

[1]  Chong-Wah Ngo,et al.  Detection of slide transition for topic indexing , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[2]  Françoise Dibos Projective analysis of 2-D images , 1998, IEEE Trans. Image Process..

[3]  Hugh Denman,et al.  Discontinuity analysis for video processing , 2007 .

[4]  John R. Kender,et al.  Analysis and enhancement of videos of electronic slide presentations , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[5]  Van Nostrand,et al.  Error Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm , 1967 .

[6]  Tanveer F. Syeda-Mahmood Indexing for topics in videos using foils , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Quanfu Fan,et al.  Temporal Modeling of Slide Change in Presentation Videos , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[8]  Niall Rea,et al.  High-level event detection in broadcast sports video , 2005 .

[9]  J. Wang,et al.  Improving color based video shot detection , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[10]  Gregory D. Abowd,et al.  Teaching and learning as multimedia authoring: the classroom 2000 project , 1997, MULTIMEDIA '96.

[11]  Quanfu Fan,et al.  Matching slides to presentation videos using SIFT and scene background matching , 2006, MIR '06.

[12]  Alberto Del Bimbo Guest Editor's Introduction: Multimedia Computing and Systems , 2000, IEEE Multim..

[13]  Berna Erol,et al.  Linking multimedia presentations with their symbolic source documents: algorithm and applications , 2003, ACM Multimedia.

[14]  Chong-Wah Ngo,et al.  Gesture tracking and recognition for lecture video editing , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..