论文信息 - A highlight scene detection and video summarization system using audio feature for a personal video recorder

A highlight scene detection and video summarization system using audio feature for a personal video recorder

The personal video recorder such as recordable-DVD recorder, Blu-ray disc recorder and/or hard disc recorder has become popular for a large volume storage device for video/audio content data and a browsing function that would quickly provide a desired scene to the user is required as an essential part of such a large capacity recording/playback system. We propose a highlight scene detection function by using only 'audio' features and realize a browsing function for the recorder that enables completely automatic detection of sports highlights. We detect sports highlights by identifying portions with "commentator's excited speech" using Gaussian mixture models (GMM's) trained using the MDL criterion. Our computation is carried out directly on the MDCT coefficients from the AC-3 coefficients thus giving us a tremendous speed advantage. Our accuracy of detection of sports highlights is high across a variety of sports.

[1] M. Ogawa,et al. Development of combined HDD and recordable-DVD video recorder , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[2] Regunathan Radhakrishnan,et al. A Unified Framework for Video Summarization, Browsing, and Retrieval , 2006 .

[3] Ziyou Xiong,et al. Effective and efficient sports highlights extraction using the minimum description length criterion in selecting GMM structures [audio classification] , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[4] Ajay Divakaran,et al. A content-based browsing system for a HDD and/or recordable-DVD personal video recorder , 2003, 2003 IEEE International Conference on Consumer Electronics, 2003. ICCE..

[5] Regunathan Radhakrishnan,et al. Modeling sports highlights using a time-series clustering framework and model interpretation , 2005, IS&T/SPIE Electronic Imaging.

[6] Regunathan Radhakrishnan,et al. Effective and efficient sports highlights extraction using the minimum description length criterion in selecting GMM structures , 2004, ICME.