Video shot boundary detection by graph-theoretic dominant sets approach

We present a video shot boundary detection algorithm based on the novel graph theoretic concept, namely dominant sets. Dominant sets are defined as a set of the nodes in a graph, mostly similar to each other and dissimilar to the others. In order to achieve this goal, candidate shot boundaries are determined by using simply pixelwise differences between consequent frames. For each candidate position, a testing sequence is constructed by considering 4 frames before the candidate position and 2 frames after the candidate position. Proposed method works on a weighted undirected graph, where the graphs are established by using the frames in the testing sequence. Each frame in the sequence corresponds to a node in the graph, whereas edge weights between the nodes are calculated by using pairwise similarities of frames. By utilizing the complete information of the graph, its dominant set is detected. The simulation results indicate that the proposed algorithm can be a promising approach for abrupt shot boundary detection.

[1]  Yap-Peng Tan,et al.  Adaptive dual-cross search algorithm for block-matching motion estimation , 2004, IEEE Trans. Consumer Electron..

[2]  Marcello Pelillo,et al.  Dominant Sets and Pairwise Clustering , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  David C. Gibbon,et al.  AT&T Research at TRECVID 2006 , 2006, TRECVID.

[4]  U. Sakarya,et al.  Graph Partition Based Scene Boundary Detection , 2007, 2007 5th International Symposium on Image and Signal Processing and Analysis.

[5]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Paul Over,et al.  TRECVID 2007--Overview , 2007, TRECVID.

[8]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[9]  Evangelos Pallis,et al.  Shot boundary detection without threshold parameters , 2006, J. Electronic Imaging.

[10]  M. Pavan,et al.  A new graph-theoretic approach to clustering and segmentation , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[11]  Bo Zhang,et al.  Graph Partition Model for Robust Temporal Data Segmentation , 2005, PAKDD.