Abrupt Shot Detection in Video using Weighted Edge Information

Content Based Video Retrieval (CBVR) has been extensively utilized for automatic indexing, retrieval and management of video data. Segmentation of video is the prominent step in Content Based Video Retrieval. In this paper, we focus on automatic detection of abrupt shot cuts in video sequences. The proposed approach exploits the edge information of an image of a video frame for its characterization. A (2x2) mask of sliding window is used in both overlapping and non overlapping mode to assign binary weights to the edge information of an image. The binary weights evaluated for each mask is used to construct histogram for each image which forms the feature vector to represent an image. The Euclidean distance between the feature vectors of adjacent frames of a video are computed and these values are used for shot cut detection process using adaptive thresholding. To check the efficacy of the proposed shot boundary detection approach, experiments were carried out on a subset of standard video data set TRECVID 2001. The experimental results obtained by the proposed algorithm outperform some of the existing shot boundary detection algorithms in terms of precision, recall and F-measure rates.

[1]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[2]  D. S. Guru,et al.  A non parametric shot boundary detection: an eigen gap based approach , 2011, Bangalore Compute Conf..

[3]  Hyeokman Kim,et al.  Detection of gradual scene changes for parsing of video data , 1997, Electronic Imaging.

[4]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[5]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[6]  K. P. Uma,et al.  Kirsch Directional Derivatives Based Shot Boundary Detection: An Efficient and Accurate Method , 2015 .

[7]  Ralph M. Ford,et al.  Metrics for shot boundary detection in digital video sequences , 2000, Multimedia Systems.

[8]  Jonathan D. Courtney Automatic video indexing via object motion analysis , 1997, Pattern Recognit..

[9]  S. Domnic,et al.  Edge Strength Extraction using Orthogonal Vectors for Shot Boundary Detection , 2012 .

[10]  Wen Gao,et al.  Contour-motion feature (CMF): A space-time approach for robust pedestrian detection , 2009, Pattern Recognit. Lett..

[11]  Donald A. Adjeroh,et al.  Robust and Efficient Transform Domain Video Sequence Analysis: An Approach from the Generalized Color Ratio Model , 1997, J. Vis. Commun. Image Represent..

[12]  Sameer Antani,et al.  An Evaluation of Color Histogram Based Methods in Video Indexing , 2007 .

[13]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[14]  Patrick Bouthemy,et al.  A unified approach to shot change detection and camera motion characterization , 1999, IEEE Trans. Circuits Syst. Video Technol..

[15]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[16]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Shang-Hong Lai,et al.  Integrated video shot segmentation algorithm , 2003, IS&T/SPIE Electronic Imaging.

[18]  Steven C. H. Hoi,et al.  Chinese University of Hong Kong at TRECVID 2006: Shot Boundary Detection and Video Search , 2006, TRECVID.

[19]  Tobun Dorbin Ng,et al.  Informedia at TRECVID 2003 : Analyzing and Searching Broadcast News Video , 2003, TRECVID.

[20]  Shu-Yuan Chen,et al.  Retrieval of translated, rotated and scaled color textures , 2003, Pattern Recognit..

[21]  Abdelhamid Abdesselam,et al.  Improving Local Binary Patterns Techniques by Using Edge Information , 2013 .

[22]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[23]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[25]  Narendra Ahuja,et al.  Robust video shot change detection , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[26]  ZhangHongJiang,et al.  Automatic partitioning of full-motion video , 1993 .