Video shot boundary detection: A review

Due to huge growth in multimedia and technology, it is very important to go through the point of interest rather than accessing the entire video. For efficient indexing and retrieving the interest points, content based video retrieval is used. The first step toward CBVR is shot boundary detection. It is necessary to partition the video into shots for easy indexing and retrieval of video. Therefore, segmentation plays an important role in digital media processing, pattern recognition, and computer vision. In this paper, we present different approaches to shot boundary detection problem.

[1]  S. Haykin.  Kalman Filtering and Neural Networks , 2001 .

[2]  Christian Petersohn.  Temporal video segmentation , 2010 .

[3]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[4]  Abdul Hameed,et al.  A novel framework of shot boundary detection for uncompressed videos , 2009, 2009 International Conference on Emerging Technologies.

[5]  King Ngi Ngan,et al.  Integrated shot boundary detection using object-based technique , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[6]  Xin Liu,et al.  Video shot segmentation and classification , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[7]  Monisha Sharma,et al.  Comparative Study of Block Matching Algorithm and Dual Tree Complex Wavelet Transform for Shot Detection in Videos , 2014, 2014 International Conference on Electronic Systems, Signal Processing and Computing Technologies.

[8]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[9]  Nikita Sao,et al.  A survey based on Video Shot Boundary Detection techniques , 2014 .

[10]  Alessandro Neri,et al.  Wipe effect detection for video sequences , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[11]  Vasumathi Narayanan,et al.  A Survey of Content-Based Video Retrieval , 2008 .

[12]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[13]  Nilesh V. Patel,et al.  Video shot detection and characterization for video databases , 1997, Pattern Recognit..

[14]  Yue Gao,et al.  Video Shot Boundary Detection Using Frame-Skipping Technique , 2006 .

[15]  Takafumi Miyatake,et al.  IMPACT: an interactive natural-motion-picture dedicated multimedia authoring system , 1991, CHI.

[16]  Masaru Sugano,et al.  A fast scene change detection on MPEG coding parameter domain , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[17]  Horst Bischof,et al.  Efficient Maximally Stable Extremal Region (MSER) Tracking , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[18]  Luis Miguel Bergasa,et al.  Gauge-SURF descriptors , 2013, Image Vis. Comput..

[19]  Shin'ichi Satoh,et al.  A Framework for Video Segmentation using Global and Local Features , 2013, Int. J. Pattern Recognit. Artif. Intell..

[20]  John M. Gauch,et al.  Real Time Video Scene Detection and Classification , 1999, Inf. Process. Manag..

[21]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[22]  Richard Baraniuk,et al.  The Dual-tree Complex Wavelet Transform , 2007 .

[23]  Dan Schonfeld,et al.  Statistical sequential analysis for real-time video scene change detection on compressed multimedia bitstream , 2003, IEEE Trans. Multim..

[24]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  Hui Chen,et al.  A practical method for video scene segmentation , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[26]  Salim Chavan,et al.  An Efficient Method for Detection of Wipes in Presence of Object and Camera Motion , 2014 .

[27]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[28]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[29]  Ioannis Pitas,et al.  Video shot segmentation using singular value decomposition , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[30]  N. Nikolaidis,et al.  Video shot detection and condensed representation. a review , 2006, IEEE Signal Processing Magazine.

[31]  Xinbo Gao,et al.  A Unified Framework for Shot Boundary Detection , 2005, CIS.

[32]  Majid Mirmehdi,et al.  Temporal video segmentation and classification of edit effects , 2003, Image Vis. Comput..

[33]  Chung-Lin Huang,et al.  A robust scene-change detection method for video segmentation , 2001, IEEE Trans. Circuits Syst. Video Technol..

[34]  Cedric Nishan Canagarajah,et al.  Video Scene Retrieval Based on Local Region Features , 2006, 2006 International Conference on Image Processing.

[35]  Zhao Huan,et al.  Shot Boundary Detection Based on Mutual Information and Canny Edge Detector , 2008, 2008 International Conference on Computer Science and Software Engineering.

[36]  Chong-Wah Ngo,et al.  Detection of gradual transitions through temporal slice analysis , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[37]  David S. Moore,et al.  Chi-Square Tests. , 1976 .

[38]  Yong Shi,et al.  Fast Video Shot Boundary Detection Based on SVD and Pattern Matching , 2013, IEEE Transactions on Image Processing.

[39]  Min Wu,et al.  An algorithm for wipe detection , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[40]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[41]  Yang Liu,et al.  Enhanced shot boundary detection using video text information , 2005, IEEE Transactions on Consumer Electronics.

[42]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  J. Tasic,et al.  Colour spaces: perceptual, historical and applicational background , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[44]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2006, IEEE Trans. Multim..

[45]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[46]  Bei Lu,et al.  Video Key-Frame-Extraction Based on Block Local Features and Mean Shift Clustering , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).

[47]  A. Murat Tekalp,et al.  Temporal video segmentation using unsupervised clustering and semantic object tracking , 1998, J. Electronic Imaging.

[48]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[49]  Sudipta Roy,et al.  A Survey on Video Segmentation , 2013, ICACNI.

[50]  Tie-Yan Liu,et al.  A new cut detection algorithm with constant false-alarm ratio for video segmentation , 2004, J. Vis. Commun. Image Represent..

[51]  Wei Li,et al.  Efficient Shot Boundary Detection Based on Scale Invariant Features , 2009, 2009 Fifth International Conference on Image and Graphics.

[52]  Ioannis Pitas,et al.  VIDEO SHOT BOUNDARY DETECTION USING SINGULAR VALUE DECOMPOSITION , 2003 .

[53]  Alessandro Neri,et al.  Automatic dissolve and fade detection for video sequences , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).

[54]  Li Huan,et al.  A General Method for Shot Boundary Detection , 2008, 2008 International Conference on Multimedia and Ubiquitous Engineering (mue 2008).

[55]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[56]  Warnakulasuriya Anil Chandana Fernando,et al.  Wipe scene change detection in video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[57]  Xinbo Gao,et al.  A Video Shot Boundary Detection Algorithm Based on Feature Tracking , 2006, RSKT.

[58]  Kanad K. Biswas,et al.  A fuzzy theoretic approach for video segmentation using syntactic features , 2001, Pattern Recognit. Lett..

[59]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, J. Electronic Imaging.

[60]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[61]  C. R. Deepak,et al.  Shot boundary detection using color correlogram and Gauge-SURF descriptors , 2013, 2013 Fourth International Conference on Computing, Communications and Networking Technologies (ICCCNT).

[62]  Xiuwen Liu,et al.  Shot boundary detection in videos using robust three-dimensional tracking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[63]  Kuo-Chin Fan,et al.  A motion-tolerant dissolve detection algorithm , 2005, IEEE Transactions on Multimedia.

[64]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[65]  King Ngi Ngan,et al.  An Object-Based Shot Boundary Detection Using Edge Tracing and Tracking , 2001, J. Vis. Commun. Image Represent..

[66]  Hui Fang,et al.  A fuzzy logic approach for detection of video shot boundaries , 2006, Pattern Recognit..

[67]  B. H. Shekar,et al.  Shot Boundary Detection Algorithm Based on Color Texture Moments , 2011 .

[68]  S. S. Chaudhuri,et al.  A new fast motion vector estimation algorithm for video compression , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[69]  Y.-N. Li,et al.  Fast video shot boundary detection framework employing pre-processing techniques , 2009, IET Image Process..

[70]  Dong Zhang,et al.  A New Shot Boundary Detection Algorithm , 2001, IEEE Pacific Rim Conference on Multimedia.

[71]  Alvaro Pardo.  Probabilistic Shot Boundary Detection Using Interframe Histogram Differences , 2006, CIARP.

[72]  Ioannis Pitas,et al.  Shot detection in video sequences using entropy based metrics , 2002, Proceedings. International Conference on Image Processing.

[73]  Scale Invariant Feature Transform-Scholarpedia , 2015 .

[74]  S. K. Singhai,et al.  Video shot boundary detection using dual-tree complex wavelet transform , 2013, 2013 3rd IEEE International Advance Computing Conference (IACC).

[75]  Nilanjan Dey,et al.  A novel Block Matching Algorithmic Approach with smaller block size for motion vector estimation in video compression , 2012, 2012 12th International Conference on Intelligent Systems Design and Applications (ISDA).

[76]  Chun-Rong Huang,et al.  Shot Change Detection via Local Keypoint Matching , 2008, IEEE Transactions on Multimedia.

[77]  Sang Wook Lee,et al.  Efficient Shot Boundary Detection for Action Movies Using Blockwise Motion-Based Features , 2005, ISVC.

[78]  Lihong Xu,et al.  A novel shot detection algorithm based on clustering , 2010, 2010 2nd International Conference on Education Technology and Computer.

[79]  Ruimin Hu,et al.  A shot boundary detection method based on color feature , 2011, Proceedings of 2011 International Conference on Computer Science and Network Technology.

[80]  Reginald Aubrey Fessenden,et al.  Transactions of the , 2016 .

[81]  N. Dey,et al.  An efficient motion estimation algorithm using division mechanism of low and high motion zone , 2013, 2013 International Mutli-Conference on Automation, Computing, Communication, Control and Compressed Sensing (iMac4s).

[82]  Juan Chen,et al.  Shot Boundary Detection in MPEG Videos Using Local and Global Indicators , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[83]  Anni Cai,et al.  A robust shot transition detection method based on support vector machine in compressed domain , 2007, Pattern Recognit. Lett..

[84]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[85]  Jong-Nam Kim,et al.  An automatic shot change detection algorithm using weighting variance and histogram variation , 2009, 2009 11th International Conference on Advanced Communication Technology.

[86]  ZhangHongJiang,et al.  Automatic partitioning of full-motion video , 1993 .

[87]  Tony Lindeberg,et al.  Scale Invariant Feature Transform , 2012, Scholarpedia.

[88]  Chi-Chun Lo,et al.  Video segmentation using a histogram-based fuzzy c-means clustering algorithm , 2001, Comput. Stand. Interfaces.

[89]  Seong-Whan Lee,et al.  Automatic video parsing using shot boundary detection and camera operation analysis , 2001, Pattern Recognit..

[90]  Lihong Xu,et al.  A novel shot detection algorithm based on graph theory , 2010, 2010 2nd International Conference on Computer Engineering and Technology.