An Actor-Based Video Segmentation System Using Visual and Audio Information in E-Learning

Video systems are widely used in real-time or off-line environments, especially in distance learning. A video system is used in distance learning programs to deliver pre-recorded lectures. Issues of video content analysis and annotation have many outstanding solutions. By using the solutions, we put our previous work into a video segmentation system. According to the visual and audio information of a learning video, we assume the segmentation rules. The rules are actor-based. We also start our discussion on a multi-streaming presentation recording system in which an instructor interacts with the presentation material. The video recording concept can be extended to realize a video segmentation system.

[1]  Zhu Liu,et al.  Integration of audio and visual information for content-based video segmentation , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[2]  Yongmin Li,et al.  Video classification using spatial-temporal features and PCA , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[3]  Phillip Heeler,et al.  A preliminary report on the use of video technology in online courses , 2005 .

[4]  Wendy E. Mackay,et al.  Virtual video editing in interactive multimedia applications , 1989, CACM.

[5]  Ying Li,et al.  Instructional Video Content Analysis Using Audio Information , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[6]  Hao Jiang,et al.  Video segmentation with the assistance of audio content analysis , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[7]  Anil K. Jain,et al.  Automatic caption localization in compressed video , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[8]  Jin-Hau Kuo,et al.  A musical-driven video summarization system using content-aware mechanisms , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[9]  Junehwa Song,et al.  A narrative-based abstraction framework for story-oriented video , 2007, TOMCCAP.

[10]  M. Brunig,et al.  Face detection and tracking for video coding applications , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[11]  Hiroaki Ogata,et al.  XML-based video annotation system for language learning environment , 2001, Proceedings of the Second International Conference on Web Information Systems Engineering.

[12]  M. Kodama,et al.  A Video Content's Creating Method using Keywords in E-learning System , 2006, 2006 7th International Conference on Information Technology Based Higher Education and Training.

[13]  Chitra Dorai,et al.  Structuralizing educational videos based on presentation content , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).