Cooperative Shot Boundary Detection for Video

Video Shot boundary detection is a fundamental task in any kind of video content analysis and retrieval. Meaningful segments, such as cut or gradual transition, will be found by performing a boundary detection task. This task has already become an important part of the work on TRECVID. In this paper, we propose a general approach for shot boundary detection. We adopt cooperative model to decide whether a shot transition exists within a given video sequence. Such an approach is beneficial for multiple tasks and is carried out through a group of detection agents, which enables the agents to cooperate and be charged with detection task. By fusing detection results of agents, more precise detection effect is obtained. We demonstrate the power of our approach on the TRECVID-2005 benchmarking platform and the experimental results reveal the effectiveness of the proposed method.

[1]  Rita Cucchiara,et al.  Linear Transition Detection as a Unified Shot Detection Approach , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Hung-Khoon Tan,et al.  Experimenting VIREO-374: Bag-of-Visual-Words and Visual-Based Ontology for Semantic Video Indexing and search , 2007, TRECVID.

[3]  Jenny Benois-Pineau,et al.  Comparison of shot boundary detectors , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[4]  Chong-Wah Ngo,et al.  Video partitioning by temporal slice coherency , 2001, IEEE Trans. Circuits Syst. Video Technol..

[5]  Alexander G. Hauptmann.  TRECVID: the utility of a content-based video retrieval evaluation , 2006, Electronic Imaging.

[6]  Keiichiro Hoashi,et al.  SVM-Based Shot Boundary Detection with a Novel Feature , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[7]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[8]  Matthieu Cord,et al.  Video Segmentation by Supervised Learning , 2006, 2006 19th Brazilian Symposium on Computer Graphics and Image Processing.

[9]  Chong-Wah Ngo,et al.  Bag-of-visual-words expansion using visual relatedness for video indexing , 2008, SIGIR '08.

[10]  Jeho Nam,et al.  Detection of gradual transitions in video sequences using B-spline interpolation , 2005, IEEE Transactions on Multimedia.

[11]  Alan Hanjalic.  Towards Theoretical Performance Limits of Video Parsing , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Paul Over,et al.  TRECVID 2007--Overview , 2007, TRECVID.

[13]  Kuo-Chin Fan,et al.  A motion-tolerant dissolve detection algorithm , 2005, IEEE Transactions on Multimedia.

[14]  Yue-Ting Zhuang,et al.  A new method for shot gradual transiton detection using support vector machine , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[15]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  Alan F. Smeaton.  Techniques used and open challenges to the analysis, indexing and retrieval of digital video , 2007, Inf. Syst..