Local Binary Pattern Based Shot Boundary Detection for Video Summarization

Video Summarization plays a vital role in the internet user's life, especially for those searching for user specified video of interest for a long time. In order to provide support for users in terms of searching and retrieving video content, it is necessary to segment the video into shots and extract representative frame of each shot which acts as a summary of the video. So, in this paper, an approach for shot boundary detection and keyframe extraction is proposed. To provide a better summarization of video, Local Binary Pattern (LBP) based feature extraction for detecting video shots is performed in order to identify objects motion information. Based on local maxima analysis, an efficient keyframe, which contains salient information of a shot is proposed. The performance of the proposed work is evaluated using evaluation metrics like Precision, Recall, and F1-Measure.

[1]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[2]  Xin Liu,et al.  Video shot segmentation and classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[3]  Francesco Bianconi,et al.  Dominant local binary patterns for texture classification: Labelled or unlabelled? , 2015, Pattern Recognit. Lett..

[4]  Til Aach,et al.  Texture Classification by Modeling Joint Distributions of Local Patterns With Gaussian Mixtures , 2010, IEEE Transactions on Image Processing.

[5]  Joni-Kristian Kämäräinen,et al.  Video Shot Boundary Detection using Visual Bag-of-Words , 2013, VISAPP.

[6]  Mubarak Shah,et al.  Scene detection in Hollywood movies and TV shows , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[7]  HeikkilaMarko,et al.  A Texture-Based Method for Modeling the Background and Detecting Moving Objects , 2006 .

[8]  Bhabatosh Chanda,et al.  A Model-Based Shot Boundary Detection Technique Using Frame Transition Parameters , 2012, IEEE Transactions on Multimedia.

[9]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[11]  Matti Pietikäinen,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON MULTIMEDIA 1 Lipreading with Local Spatiotemporal Descriptors , 2022 .

[12]  Marko Heikkilä,et al.  Description of interest regions with local binary patterns , 2009, Pattern Recognit..

[13]  Stan Z. Li,et al.  Shape localization based on statistical method using extended local binary pattern , 2004, Third International Conference on Image and Graphics (ICIG'04).

[14]  Yong Shi,et al.  Fast Video Shot Boundary Detection Based on SVD and Pattern Matching , 2013, IEEE Transactions on Image Processing.

[15]  Xin Liu,et al.  Video summarization using singular value decomposition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[16]  Shigang Wang,et al.  A Fast Algorithm for MPEG Video Segmentation Based on Macroblock , 2007, Fourth International Conference on Fuzzy Systems and Knowledge Discovery (FSKD 2007).

[17]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[18]  Uma Mudenagudi,et al.  A Study on Keyframe Extraction Methods for Video Summary , 2011, 2011 International Conference on Computational Intelligence and Communication Networks.

[19]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Yongkun Wang,et al.  An Improved Keyframe Extraction Method Based on HSV Colour Space , 2013, J. Softw..

[21]  Donald A. Adjeroh,et al.  Adaptive Edge-Oriented Shot Boundary Detection , 2009, EURASIP J. Image Video Process..

[22]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[23]  Shiguo Lian,et al.  Automatic video temporal segmentation based on multiple features , 2011, Soft Comput..

[24]  Janko Calic,et al.  Spatial analysis in key-frame extraction using video segmentation , 2004 .