Automated MPEG audio-video summarization and description

The paper proposes a novel method for automatically summarizing MPEG coded audio-video content in the compressed domain, and describing audio-video summaries in the MPEG-7 standard format. Semantically important features for summary generation are carefully analyzed, and two types of summaries, digest and highlight, are extracted. A digest extraction is based on an audio level estimation and visual features analysis, where digest shots are adaptively determined for user-specified duration by utilizing the MPEG-7 based motion features. A highlight-based summarization from TV broadcast sports programmes is achieved by analyzing audio class and audio level. The extracted summaries and related features are described by the MPEG-7 description tools. Experimental results show that the digests and highlights can be successfully extracted in various kinds of contents without a priori knowledge of content characteristics.

[1]  Bernard Mérialdo,et al.  Using content models to build audio-video summaries , 1998, Electronic Imaging.

[2]  Qian Huang,et al.  Automated generation of news content hierarchy by integrating audio, video, and text information , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[3]  Yang Lu,et al.  A fast audio classification from MPEG coded data , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[4]  P. Beek,et al.  Text of 15938-5 FCD Information Technology-Multimedia Content Description Interface-Pard 5 Multimedia Description Schemes , 2001 .

[5]  Anoop Gupta,et al.  Automatically extracting highlights for TV Baseball programs , 2000, ACM Multimedia.

[6]  Tsuhan Chen,et al.  Multimedia content classification using motion and audio information , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[7]  Xin Liu,et al.  Video summarization with minimal visual content redundancies , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[8]  Noboru Babaguchi,et al.  Generation of personalized abstract of sports video , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..

[9]  Wolfgang Effelsberg,et al.  Video abstracting , 1997, CACM.

[10]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[11]  Akio Yoneyama,et al.  Universal scene change detection on MPEG-coded data domain , 1997, Electronic Imaging.