Gesture tracking and recognition for lecture video editing

This paper presents a gesture based driven approach for video editing. Given a lecture video, we adopt novel approaches to automatically detect and synchronize its content with electronic slides. The gestures in each synchronized topic (or shot) are then tracked and recognized continuously. By registering shots and slides and recovering their transformation, the regions where the gestures take place can be known. Based on the recognized gestures and their registered positions, the information in slides can be seamlessly extracted, not only to assist video editing, but also to enhance the quality of original lecture video.

[1]  Brian Christopher Smith,et al.  Passive capture and structuring of lectures , 1999, MULTIMEDIA '99.

[2]  Jérôme Martin,et al.  Automatic handwriting gestures recognition using hidden Markov models , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[3]  Svetha Venkatesh,et al.  High level segmentation of instructional videos based on content density , 2002, MULTIMEDIA '02.

[4]  Tanveer F. Syeda-Mahmood.  Indexing for topics in videos using foils , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Chong-Wah Ngo,et al.  Synchronization of lecture videos and electronic slides by video text analysis , 2003, MULTIMEDIA '03.

[6]  Anoop Gupta,et al.  Automating camera management for lecture room environments , 2001, CHI.

[7]  Michael J. Black,et al.  Summarization of videotaped presentations: automatic analysis of motion and gesture , 1998, IEEE Trans. Circuits Syst. Video Technol..

[8]  P. Peer,et al.  Human skin color clustering for face detection , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[9]  Gregory D. Abowd,et al.  Teaching and learning as multimedia authoring: the classroom 2000 project , 1997, MULTIMEDIA '96.

[10]  Anoop Gupta,et al.  Auto-summarization of audio-video presentations , 1999, MULTIMEDIA '99.

[11]  Chong-Wah Ngo,et al.  Detection of slide transition for topic indexing , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[12]  Jenq-Neng Hwang,et al.  A real-time interactive virtual classroom multimedia distance learning system , 2001, IEEE Trans. Multim..