A motion and illumination resilient framework for automatic shot boundary detection

Detecting and locating a desired information in hefty amount of video data through manual procedure is very cumbersome. This necessitates segregation of large video into shots and finding the boundary between the shots. But shot boundary detection problem is unable to achieve satisfactory performance for video sequences consisting of flash light and complex object/camera motion. The proposed method is intended for recognising abrupt boundary between shots in the presence of motion and illumination change in an automatic way. Typically any scene change detection algorithm assimilates time separation in a shot resemblance metric. In this communication, absolute sum gradient orientation feature difference is matched to automatically generated threshold for sensing a cut. Experimental study on TRECVid 2001 data set and other publicly available data set certifies the potentiality of the proposed scheme that identifies scene boundaries efficiently, in a complex environment while preserving a good trade-off between recall and precision measure.

[1]  S. Domnic,et al.  Walsh–Hadamard Transform Kernel-Based Feature Vector for Shot Boundary Detection , 2014, IEEE Transactions on Image Processing.

[2]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[3]  P. Kanungo,et al.  Cut detection using block based center symmetric local binary pattern , 2015, 2015 International Conference on Man and Machine Interfacing (MAMI).

[4]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[5]  Ioannis Pitas,et al.  Video Shot Boundary Detection and Condensed Representation : A Review , 2006 .

[6]  Uday B. Desai,et al.  Shot boundary detection in the presence of illumination and motion , 2013, Signal Image Video Process..

[7]  Mateu Sbert,et al.  Tsallis entropy-based information measures for shot boundary detection and keyframe selection , 2013, Signal Image Video Process..

[8]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[9]  Jr. Thomas G. Stockham,et al.  Image processing in the context of a visual model , 1972 .

[10]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[11]  A. Enis Çetin,et al.  Content-based video copy detection based on motion vectors estimated using a lower frame rate , 2014, Signal Image Video Process..

[12]  A. Enis Çetin,et al.  Motion Vector Based Features for Content Based Video Copy Detection , 2010, 2010 20th International Conference on Pattern Recognition.

[13]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[14]  Gye-Young Kim,et al.  Robust Scene Change Detection Algorithm for Flashlights , 2007, ICCSA.

[15]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[16]  Zhen Gao,et al.  Retrospective analysis of time series for frame selection in surveillance video summarization , 2017, Signal Image Video Process..

[17]  Shiguo Lian,et al.  Automatic video temporal segmentation based on multiple features , 2011, Soft Comput..

[18]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[19]  Uday B. Desai,et al.  Shot boundary detection in the presence of fire flicker and explosion using stationary wavelet transform , 2011, Signal Image Video Process..

[20]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[21]  C. V. Jawahar,et al.  Automatic analysis of broadcast football videos using contextual priors , 2017, Signal Image Video Process..

[22]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[23]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.