Unsupervised Broadcast News Video Shot Segmentation and Classification

Shot segmentation and categorization is one of the most important and primary steps in building efficient and well sorted video storage and retrieval system. News video story segmentation and commercial detection surely deserve special attention for creation of a well-categorized system as different types of news are being broadcast over a variety of news channels in television. However, in order to garner more viewers, different news channels use different spatial and temporal structures for broadcasting news. Keeping this approach in mind, we present an unsupervised method for shot detection, and subsequently, commercial and news shots are classified. The proposed method does not depend on different temporal and spatial structures adopted by different news channels, and our method needs significantly less number of manual parameters.

[1]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[2]  Philip Rennert StreamSage Unsupervised ASR-Based Topic Segmentation , 2003, TRECVID.

[3]  Aditya Tiwari,et al.  Efficient and Language Independent News Story Segmentation for Telecast News Videos , 2011, 2011 IEEE International Symposium on Multimedia.

[4]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Diane J. Cook,et al.  Automatic Video Classification: A Survey of the Literature , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[6]  Paul Over,et al.  Video shot boundary detection: Seven years of TRECVid activity , 2010, Comput. Vis. Image Underst..

[7]  Alan Hanjalic,et al.  Automated high-level movie segmentation for advanced video-retrieval systems , 1999, IEEE Trans. Circuits Syst. Video Technol..

[8]  HongJiang Zhang,et al.  Text Area Detection from Video Frames , 2001, IEEE Pacific Rim Conference on Multimedia.

[9]  Jau-Ling Shih,et al.  A Context-Based Approach for Color Image Retrieval , 2002, Int. J. Pattern Recognit. Artif. Intell..

[10]  Adrian-Gabriel Chifu,et al.  SegChainW2V: Towards a Generic Automatic Video Segmentation Framework, Based on Lexical Chains of Audio Transcriptions and Word Embeddings , 2016, KES.

[11]  Yihong Gong,et al.  Automatic parsing of news video , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[12]  Yao Zhao,et al.  Exploiting Visual-Audio-Textual Characteristics for Automatic TV Commercial Block Detection and Segmentation , 2011, IEEE Transactions on Multimedia.

[13]  Qi Tian,et al.  A Two-Level Multi-Modal Approach for Story Segmentation of Large News Video Corpus , 2003, TRECVID.

[14]  Li Meng,et al.  TV Commercial Detection Based on Shot Change and Text Extraction , 2009, 2009 2nd International Congress on Image and Signal Processing.

[15]  David A. Forsyth,et al.  Towards auto-documentary: tracking the evolution of news stories , 2004, MULTIMEDIA '04.

[16]  Keiichiro Hoashi,et al.  Shot Boundary Determination on MPEC Compressed Domain and Story Segmentation Experiments for TRECVID 2003 , 2003, TRECVID.

[17]  Alexander G. Hauptmann,et al.  Text, Speech, and Vision for Video Segmentation: The InformediaTM Project , 1995 .

[18]  J. David Schaffer,et al.  Evolvable visual commercial detector , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[19]  Apostol Natsev,et al.  Dynamic Multimodal Fusion in Video Search , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[20]  Changsheng Xu,et al.  Segmentation, categorization, and identification of commercial clips from TV streams using multimodal analysis , 2006, MM '06.

[21]  Bülent Sankur,et al.  Automatic TV logo detection and classification in broadcast videos , 2009, 2009 17th European Signal Processing Conference.