Detection of Gradual Transition in Videos: Approaches and Applications

During video editing, the shots composing the video are coalesced together by different types of transition effects. These editing effects are classified into abrupt and gradual changes, based on the inherent nature of these transitions. In abrupt transitions, there is an instantaneous change in the visual content of two consecutive frames. Gradual transitions are characterized by a slow and continuous change in the visual contents occurring between two shots. In this chapter, the challenges faced in this field along with an overview of the different approaches are presented. Also, a novel method for detection of dissolve transitions using a two-phased approach is enumerated. The first phase deals with detection of candidate dissolves by identifying parabolic patterns in the mean fuzzy entropy of the frames. In the second phase, an ensemble of four parameters is used to design a filter which eliminates candidates based on thresholds set for each of the four stages of filtration. The experimental results show a marked improvement over other existing methods.

[1]  Weidong Min,et al.  Shot Boundary Detection Based on SVM Optimization Model , 2014 .

[2]  Nobuyuki Yagi,et al.  Shot Boundary Detection at TRECVID 2007 , 2007, TRECVID.

[3]  Ba Tu Truong,et al.  New enhancements to cut, fade, and dissolve detection processes in video segmentation , 2000, ACM Multimedia.

[4]  Yanjun Qi,et al.  Supervised classification for video shot segmentation , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[5]  Jafar M. H. Ali,et al.  Content-Based Image Classification and Retrieval: A Rule-based System Using Rough Sets Framework , 2007, Int. J. Intell. Inf. Technol..

[6]  Jie Zhao,et al.  Effective Dissolve Detection Based on Accumulating Histogram Difference and the Support Point , 2010, 2010 First International Conference on Pervasive Computing, Signal Processing and Applications.

[7]  B. Li,et al.  Event detection and summarization in sports video , 2001, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL 2001).

[8]  Rajashree Shettar,et al.  Analysis and Verification of Video Summarization using Shot Boundary Detection , 2013 .

[9]  D. S. Guru,et al.  A non parametric shot boundary detection: an eigen gap based approach , 2011, Bangalore Compute Conf..

[10]  Ze-Nian Li,et al.  Video dissolve and wipe detection via spatio-temporal images of chromatic histogram differences , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[11]  Bede Liu,et al.  Temporal segmentation of video using frame and histogram space , 2000, IEEE Transactions on Multimedia.

[12]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[13]  Hyeokman Kim,et al.  Detection of gradual scene changes for parsing of video data , 1997, Electronic Imaging.

[14]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[15]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[16]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Saurabh Thakare Intelligent Processing and Analysis of Image for Shot Boundary Detection , 2012 .

[18]  Ujjwal Maulik,et al.  High-speed target tracking by fuzzy hostility-induced segmentation of optical flow field , 2009, Appl. Soft Comput..

[19]  Angelo Chianese,et al.  Foveated shot detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Nicole Vincent,et al.  A review of real-time segmentation of uncompressed video sequences for content-based search and retrieval , 2003, Real Time Imaging.

[21]  M. M.,et al.  GRADUAL TRANSITION DETECTION FOR VIDEO PARTITIONING USING MORPHOLOGICAL OPERATORS , 2007 .

[22]  Xiuwen Liu,et al.  Shot boundary detection in videos using robust three-dimensional tracking , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[23]  Kuo-Chin Fan,et al.  A motion-tolerant dissolve detection algorithm , 2005, IEEE Transactions on Multimedia.

[24]  Antonio Torralba,et al.  Modeling the Shape of the Scene: A Holistic Representation of the Spatial Envelope , 2001, International Journal of Computer Vision.

[25]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[26]  Junaid Baber,et al.  Shot boundary detection from videos using entropy and local descriptor , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[27]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[28]  Andreas Girgensohn,et al.  A genetic algorithm for video segmentation and summarization , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[29]  Zhe-Ming Lu,et al.  DISSOLVE DETECTION BASED ON TWIN-COMPARISON WITH CURVE FITTING , 2011 .

[30]  Patrick Lambert,et al.  Dissolve detection in abstract video contents , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[31]  Tie-Yan Liu,et al.  A new cut detection algorithm with constant false-alarm ratio for video segmentation , 2004, J. Vis. Commun. Image Represent..

[32]  Kevin Curran,et al.  Innovative Applications of Ambient Intelligence: Advances in Smart Systems , 2012 .

[33]  Yiannis Kompatsiaris,et al.  Gradual transition detection using color coherence and other criteria in a video shot meta-segmentation framework , 2008, 2008 15th IEEE International Conference on Image Processing.

[34]  Mingwei Zhang,et al.  A Novel Shot Boundary Detection Method Based on Genetic Algorithm-Support Vector Machine , 2011, 2011 Third International Conference on Intelligent Human-Machine Systems and Cybernetics.

[35]  Xinbo Gao,et al.  A Shot Boundary Detection Method for News Video Based on Rough Sets and Fuzzy Clustering , 2005, ICIAR.

[36]  Mong-Kai Ku,et al.  Support vector machine FPGA implementation for video shot boundary detection application , 2009, 2009 IEEE International SOC Conference (SOCC).

[37]  Özgür Ulusoy,et al.  Fuzzy color histogram-based video segmentation , 2010, Comput. Vis. Image Underst..

[38]  Huaiqing Wang,et al.  An Agent-Based Approach to Process Management in E-Learning Environments , 2008, Int. J. Intell. Inf. Technol..

[39]  Dong-Sik Jang,et al.  Gradual shot boundary detection using localized edge blocks , 2006, Multimedia Tools and Applications.

[40]  Ji Hong-bing A Shot Boundary Detection Method for News Video Based on Rough Sets and Fuzzy Clustering , 2007 .

[41]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[42]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[43]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[44]  Li Huan,et al.  A Method for Fast Shot Boundary Detection Based on SVM , 2008, 2008 Congress on Image and Signal Processing.

[45]  Hans W. Guesgen,et al.  Spatio-Temporal Footprints , 2010, Int. J. Ambient Comput. Intell..

[46]  Jianchun Cao,et al.  Abrupt shot boundary detection algorithm based on fuzzy clustering neural network , 2011, 2011 3rd International Conference on Computer Research and Development.

[47]  Kimiaki Shirahama,et al.  Event retrieval in video archives using rough set theory and partially supervised learning , 2011, Multimedia Tools and Applications.

[48]  M. Ramesh Patnaik,et al.  Contourlet Transform Based Shot Boundary Detection , 2014 .

[49]  Frédéric Precioso,et al.  Shot Boundary Detection at TRECVID 2006 , 2006, TRECVID.

[50]  Tudor Barbu,et al.  Novel automatic video cut detection technique using Gabor filtering , 2009, Comput. Electr. Eng..

[51]  Yong Shi,et al.  Fast Video Shot Boundary Detection Based on SVD and Pattern Matching , 2013, IEEE Transactions on Image Processing.

[52]  Jeho Nam,et al.  Detection of gradual transitions in video sequences using B-spline interpolation , 2005, IEEE Transactions on Multimedia.

[53]  Hugh E. Williams,et al.  Gradual Transition Detection Using Average Frame Similarity , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[54]  Siddhartha Bhattacharyya,et al.  Video Shot Segmentation Using Spatio-temporal Fuzzy Hostility Index and Automatic Threshold , 2014, 2014 Fourth International Conference on Communication Systems and Network Technologies.

[55]  Liang Bai,et al.  Video shot boundary detection using Petri-Net , 2008, 2008 International Conference on Machine Learning and Cybernetics.

[56]  B. B. Meshram,et al.  Content based video retrieval systems , 2012, ArXiv.

[57]  Rita Cucchiara,et al.  Linear Transition Detection as a Unified Shot Detection Approach , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[58]  Yu Meng,et al.  A shot boundary detection algorithm based on Particle Swarm Optimization Classifier , 2009, 2009 International Conference on Machine Learning and Cybernetics.

[59]  Pankaj Gupta,et al.  Video Shot Boundary Detection Using Various Techniques , 2015 .

[60]  Alexander Wong,et al.  Shot Boundary Detection Using Genetic Algorithm Optimization , 2011, 2011 IEEE International Symposium on Multimedia.

[61]  José Manuel Menéndez,et al.  A unified model for techniques on video-shot transition detection , 2005, IEEE Transactions on Multimedia.

[62]  Nikolas P. Galatsanos,et al.  Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines , 2009, Pattern Recognit. Lett..

[63]  Wei Xiong,et al.  Automatic video data structuring through shot partitioning and key-frame computing , 1997, Machine Vision and Applications.

[64]  James M. Rehg,et al.  Video Segmentation by Tracking Many Figure-Ground Segments , 2013, 2013 IEEE International Conference on Computer Vision.

[65]  Ting Wang,et al.  An Approach to Video Key-frame Extraction Based on Rough Set , 2007, 2007 International Conference on Multimedia and Ubiquitous Engineering (MUE'07).

[66]  Tsuhan Chen,et al.  Shot boundary detection using temporal statistics modeling , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[67]  Pradip Panchal,et al.  Shot Detection Using Pixel wise Difference with Adaptive Threshold and Color Histogram Method in Compressed and Uncompressed Video , 2013 .

[68]  Hui Fang,et al.  A fuzzy logic approach for detection of video shot boundaries , 2006, Pattern Recognit..

[69]  I. Reljin,et al.  Video Shot Boundary Detection based on Multifractal Analisys , 2011 .

[70]  Th. Hermes,et al.  Automatic Shot Boundary Detecting Using Adaptive Thresholds , 2003, TRECVID.

[71]  Xinbo Gao,et al.  Unsupervised video-shot segmentation and model-free anchorperson detection for news video story parsing , 2002, IEEE Trans. Circuits Syst. Video Technol..

[72]  Jun Li,et al.  DWT-Based Shot Boundary Detection Using Support Vector Machine , 2009, 2009 Fifth International Conference on Information Assurance and Security.

[73]  R. Brunelli,et al.  A Survey on the Automatic Indexing of Video Data, , 1999, J. Vis. Commun. Image Represent..

[74]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[76]  Abdellatif Mtibaa,et al.  A study of the color-structure descriptor for shot boundary detection , 2009 .

[77]  Majid Mirmehdi,et al.  Detection and Classification of Shot Transitions , 2001, BMVC.

[78]  Mr. Hattarge,et al.  Analysis and Review of Formal Approaches to Automatic Video Shot Boundary Detection , 2014 .

[79]  Ahmed Tariq,et al.  Using Daub achy Wavelet for Shot Boundary Detection , 2014 .

[80]  Vincent Lepetit,et al.  BRIEF: Binary Robust Independent Elementary Features , 2010, ECCV.

[81]  M. K. Kundu,et al.  A novel technique for automatic abrupt shot transition detection , 2012, 2012 International Conference on Communications, Devices and Intelligent Systems (CODIS).

[82]  Quan Zheng,et al.  Video shot boundary detection with local feature post refinement , 2008, 2008 9th International Conference on Signal Processing.

[83]  Zhenhua Tang,et al.  A fast shot-boundary detection based on K-step slipped window , 2010, 2010 2nd IEEE InternationalConference on Network Infrastructure and Digital Content.

[84]  Shmuel Peleg,et al.  Temporal Segmentation of Egocentric Videos , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[85]  Lide Wu,et al.  Gradual Transition Detection Using EM Curve Fitting , 2005, 11th International Multimedia Modelling Conference.

[86]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[87]  Athanassios N. Skodras,et al.  A New Approach to Gradual Video Transition Detection , 2012, 2012 16th Panhellenic Conference on Informatics.

[88]  Nikita Sao,et al.  A survey based on Video Shot Boundary Detection techniques , 2014 .

[89]  Bing Han,et al.  A Novel Clustering Algorithm Based on Variable Precision Rough-Fuzzy Sets , 2006, ICIC.

[90]  S. Natarajan An efficient Video Segmentation Algorithm with Real time Adaptive Threshold Technique , 2009 .

[91]  Jiguo Yu,et al.  A Rapid and Robust Method for Shot Boundary Detection and Classification in Uncompressed MPEG Video Sequences , 2012 .

[92]  John S. Boreczky,et al.  A hidden Markov model framework for video segmentation using audio and image features , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[93]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[94]  S. Domnic,et al.  Transition Detection Using Hilbert Transform and Texture Features , 2012 .

[95]  Yiannis Kompatsiaris,et al.  Video shot meta-segmentation based on multiple criteria for gradual transition detection , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[96]  Chong-Wah Ngo,et al.  A robust dissolve detector by support vector machine , 2003, ACM Multimedia.

[97]  Hrvoje Dujmić,et al.  Shot Boundary Detection in Soccer Video using Twin-comparison Algorithm and Dominant Color Region , 2007 .

[98]  K. Kuppusamy,et al.  A New Hybrid Algorithm for Video Segmentation , 2012 .

[99]  Bo Zhang,et al.  Gradual transition detection with conditional random fields , 2007, ACM Multimedia.

[100]  Vasileios Mezaris,et al.  Fast shot segmentation combining global and local visual descriptors , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[101]  S. Palanivel,et al.  Unsupervised Approach for Retrieving Shots from Video , 2012 .

[102]  Irena Koprinska,et al.  Temporal video segmentation: A survey , 2001, Signal Process. Image Commun..

[103]  Kanad K. Biswas,et al.  A fuzzy theoretic approach for video segmentation using syntactic features , 2001, Pattern Recognit. Lett..