On-line video abstract generation of multimedia news

The amount of video content available nowadays makes video abstraction techniques a necessary tool to ease the access to the already huge and ever growing video databases. Nevertheless, many of the existing video abstraction approaches have high computational requirements, complicating the integration and exploitation of current technologies in real environments. This paper presents a novel method for news bulletin abstraction which combines on-line story segmentation, on-line video skimming and layout composition techniques. The developed algorithm provides an efficient, automatic and on-line news abstraction method which takes advantage of the specific characteristics of news bulletins for obtaining representative news abstracts.

[1]  José María Martínez Sanchez,et al.  Post-processing Techniques for On-Line Adaptive Video Summarization Based on Relevance Curves , 2007, SAMT.

[2]  Shih-Fu Chang,et al.  A utility framework for the automatic generation of audio-visual skims , 2002, MULTIMEDIA '02.

[3]  Paul Over,et al.  Proceedings of the 2nd ACM TRECVid Video Summarization Workshop , 2008, MM 2008.

[4]  Alan F. Smeaton,et al.  Dublin City University Video Track Experiments for TREC 2002 , 2001, TREC.

[5]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[6]  Paul Over,et al.  The trecvid 2008 BBC rushes summarization evaluation , 2008, TVS '08.

[7]  Michael G. Christel.  Evaluation and user studies with respect to video summarization and browsing , 2006, Electronic Imaging.

[8]  Hyung-Myung Kim,et al.  Summarization of news video and its description for content‐based access , 2003, Int. J. Imaging Syst. Technol..

[9]  Ying Li,et al.  An Overview of Video Abstraction Techniques , 2001 .

[10]  Regunathan Radhakrishnan,et al.  Motion activity-based extraction of key-frames from video shots , 2002, Proceedings. International Conference on Image Processing.

[11]  M. Flynn,et al.  Highlight Scene Detection And Video Summarization for PVR-Enabled High-Definition Television Systems , 2007, 2007 Digest of Technical Papers International Conference on Consumer Electronics.

[12]  Shih-Fu Chang,et al.  Story boundary detection in large broadcast news video archives: techniques, experience and trends , 2004, MULTIMEDIA '04.

[13]  Alan Hanjalic,et al.  An integrated scheme for automated video abstraction based on unsupervised cluster-validity analysis , 1999, IEEE Trans. Circuits Syst. Video Technol..

[14]  Scott P. Robertson,et al.  Proceedings of the SIGCHI Conference on Human Factors in Computing Systems , 1991 .

[15]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[16]  Qian Huang,et al.  Automated generation of news content hierarchy by integrating audio, video, and text information , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[17]  Stephen W. Smoliar,et al.  An integrated system for content-based video retrieval and browsing , 1997, Pattern Recognit..

[18]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  Qi Tian,et al.  A Two-Level Multi-Modal Approach for Story Segmentation of Large News Video Corpus , 2003, TRECVID.

[20]  Paul Over,et al.  Proceedings of the international workshop on TRECVID video summarization , 2007, MM 2007.

[21]  Liu Huayong,et al.  The segmentation of news video into story units , 2005 .

[22]  Ajay Divakaran,et al.  Browsing news and talk video on a consumer electronics platform using face detection , 2005, SPIE Optics East.

[23]  Shih-Ping Liou,et al.  Automatic key-frame selection for content-based video indexing and access , 1999, Electronic Imaging.

[24]  Azriel Rosenfeld,et al.  Extraction of key frames from videos by polygon simplification , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[25]  John R. Smith,et al.  On the detection of semantic concepts at TRECVID , 2004, MULTIMEDIA '04.

[26]  Alan F. Smeaton,et al.  A generic news story segmentation system and its evaluation , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[27]  Chun-Ming Lai,et al.  News Video Summarization Based on Spatial and Motion Feature Analysis , 2004, PCM.

[28]  Regunathan Radhakrishnan,et al.  Generation of sports highlights using motion activity in combination with a common audio feature extraction framework , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[29]  Raimondo Schettini,et al.  Dynamic key-frame extraction for video summarization , 2005, IS&T/SPIE Electronic Imaging.

[30]  John Adcock,et al.  A simplified approach to rushes summarization , 2008, TVS '08.

[31]  A. Murat Tekalp,et al.  Content-based video abstraction , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[32]  Chin-Hui Lee,et al.  A Multi-Modal Approach to Story Segmentation for News Video , 2003, World Wide Web.

[33]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[34]  Qi Tian,et al.  Content-adaptive digital music watermarking based on music structure analysis , 2007, TOMCCAP.

[35]  Azriel Rosenfeld,et al.  Automatic Extraction of Relevant Frames from Videos by Polygon Simplification , 2000, DAGM-Symposium.

[36]  Stephen W. Smoliar,et al.  Video parsing, retrieval and browsing: an integrated and content-based solution , 1997, MULTIMEDIA '95.

[37]  Michael J. Black,et al.  Summarization of videotaped presentations: automatic analysis of motion and gesture , 1998, IEEE Trans. Circuits Syst. Video Technol..

[38]  Ba Tu Truong,et al.  Video abstraction: A systematic review and classification , 2007, TOMCCAP.

[39]  Meng Wang,et al.  Video Content Structuring , 2009, Scholarpedia.

[40]  Meng Wang,et al.  Unified Video Annotation via Multigraph Learning , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[41]  Mubarak Shah,et al.  Story Segmentation in News Videos Using Visual and Text Cues , 2005, CIVR.

[42]  Chia-Hung Yeh,et al.  Robust TV News Story Identification Via Visual Characteristics of Anchorperson Scenes , 2006, PSIVT.

[43]  Kurt Hornik,et al.  The support vector machine under test , 2003, Neurocomputing.

[44]  Gary Marchionini,et al.  How fast is too fast? evaluating fast forward surrogates for digital video , 2003, 2003 Joint Conference on Digital Libraries, 2003. Proceedings..

[45]  John R. Kender,et al.  Optimization Algorithms for the Selection of Key Frame Sequences of Variable Length , 2002, ECCV.

[46]  Sriram Subramanian,et al.  Talking about tactile experiences , 2013, CHI.

[47]  Sang Uk Lee,et al.  Efficient video indexing scheme for content-based retrieval , 1999, IEEE Trans. Circuits Syst. Video Technol..

[48]  Tianming Liu,et al.  A novel video key-frame-extraction algorithm based on perceived motion energy model , 2003, IEEE Trans. Circuits Syst. Video Technol..

[49]  Yukinobu Taniguchi,et al.  An intuitive and efficient access interface to real-time incoming video based on automatic indexing , 1995, MULTIMEDIA '95.

[50]  V. S. Subrahmanian,et al.  The CPR model for summarizing video , 2003, MMDB '03.

[51]  José María Martínez Sanchez,et al.  Binary tree based on-line video summarization , 2008, TVS '08.

[52]  José María Martínez Sanchez,et al.  On-line video skimming based on histogram similarity , 2007, TVS '07.

[53]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[54]  Dragutin Petkovic,et al.  Content-based representation and retrieval of visual media: A state-of-the-art review , 1996, Multimedia Tools and Applications.

[55]  Zhu Liu,et al.  Major cast detection in video using both audio and visual information , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[56]  Yueting Zhuang,et al.  Adaptive key frame extraction using unsupervised clustering , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[57]  Ajay Divakaran,et al.  Broadcast Video Program Summarization using Face Tracks , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[58]  Ajay Divakaran,et al.  Discriminative genre-independent audio-visual scene change detection , 2009, Electronic Imaging.

[59]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimal video summary generation , 2005, IEEE Transactions on Image Processing.

[60]  José María Martínez Sanchez,et al.  A framework for video abstraction systems analysis and modelling from an operational point of view , 2010, Multimedia Tools and Applications.

[61]  Janko Calic,et al.  Efficient key-frame extraction and video analysis , 2002, Proceedings. International Conference on Information Technology: Coding and Computing.

[62]  Chia-Hung Yeh,et al.  Techniques for movie content analysis and skimming: tutorial and overview on video abstraction techniques , 2006, IEEE Signal Processing Magazine.

[63]  Henning Schulzrinne,et al.  Proceedings of the 12th annual ACM international conference on Multimedia , 2004, MM 2004.

[64]  Paul Over,et al.  The TRECVid 2008 BBC Rushes Summarization Evaluation | NIST , 2009 .

[65]  Harry W. Agius,et al.  Video summarisation: A conceptual framework and survey of the state of the art , 2008, J. Vis. Commun. Image Represent..

[66]  Michael J. Witbrock,et al.  Story segmentation and detection of commercials in broadcast news video , 1998, Proceedings IEEE International Forum on Research and Technology Advances in Digital Libraries -ADL'98-.

[67]  Lie Lu,et al.  Optimization-based automated home video editing system , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[68]  Baoxin Li,et al.  Event detection and summarization in American football broadcast video , 2001, IS&T/SPIE Electronic Imaging.

[69]  José María Martínez Sanchez,et al.  On-Line Video Summarization Based on Signature-Based Junk and Redundancy Filtering , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[70]  Wei-Hao Lin,et al.  Clever clustering vs. simple speed-up for summarizing rushes , 2007, TVS '07.

[71]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[72]  Ajay Divakaran,et al.  Adaptive fast playback-based video skimming using a compressed-domain visual complexity measure , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[73]  Paul Over,et al.  High-level feature detection from video in TRECVid: a 5-year retrospective of achievements , 2009 .

[74]  Jeho Nam,et al.  Video abstract of video , 1999, 1999 IEEE Third Workshop on Multimedia Signal Processing (Cat. No.99TH8451).

[75]  Akio Yamada,et al.  The MPEG-7 color layout descriptor: a compact image feature description for high-speed image/video segment retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).