Simultaneous detection of abrupt cuts and dissolves in videos using support vector machines

Video shot detection is an important contemporary problem since it is the first step towards indexing and content based video retrieval. Traditionally, video shot segmentation approaches rely on thresholding methodologies which are sensitive to the content of the video being processed and do not generalize well the when there is little prior knowledge about the video content. To ameliorate this shortcoming we propose a learning based methodology using a set of features that are specifically designed to capture the differences among hard cuts, gradual transitions and normal sequences of frames at the same time. A support vector machine (SVM) classifier is trained both to locate shot boundaries and characterize transition types. Numerical experiments using a variety of videos demonstrate that our method is capable of accurately discriminating shot transitions in videos with different characteristics.

[1]  Nilesh V. Patel,et al.  Statistical approach to scene change detection , 1995, Electronic Imaging.

[2]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..

[3]  William J. Christmas,et al.  Video Shot Cut Detection using Adaptive Thresholding , 2000, BMVC.

[4]  David S. Doermann,et al.  Special-effect edit detection using VideoTrails: a comparison with existing techniques , 1998, Electronic Imaging.

[5]  Feng Tian On the use of support vector machines for intrusion detection , 2001 .

[6]  José Manuel Menéndez,et al.  A unified model for techniques on video-shot transition detection , 2005, IEEE Transactions on Multimedia.

[7]  Paul England,et al.  Comparison of automatic video segmentation algorithms , 1996, Other Conferences.

[8]  Rainer Lienhart,et al.  Reliable dissolve detection , 2001, IS&T/SPIE Electronic Imaging.

[9]  Marti A. Hearst Trends & Controversies: Support Vector Machines , 1998, IEEE Intell. Syst..

[10]  Françoise Fogelman-Soulié,et al.  Neurocomputing : algorithms, architectures and applications , 1990 .

[11]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[12]  Pau Klein,et al.  San Francisco, California , 2007 .

[13]  Chong-Wah Ngo,et al.  Video partitioning by temporal slice coherency , 2001, IEEE Trans. Circuits Syst. Video Technol..

[14]  Hugh E. Williams,et al.  RMIT University at TRECVID 2004 , 2004, TRECVID.

[15]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[16]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[17]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[18]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[19]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[20]  Sen Liu,et al.  A new general framework for shot boundary detection and key-frame extraction , 2005, MIR '05.

[21]  Dan Schonfeld,et al.  Statistical sequential analysis for real-time video scene change detection on compressed multimedia bitstream , 2003, IEEE Trans. Multim..

[22]  Alberto Del Bimbo,et al.  Visual information retrieval , 1999 .

[23]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[24]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[25]  Greg Schohn,et al.  Less is More: Active Learning with Support Vector Machines , 2000, ICML.

[26]  Stefano Spaccapietra,et al.  Visual Database Systems 3 , 1995, IFIP — The International Federation for Information Processing.

[27]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[28]  Angelo Chianese,et al.  Foveated shot detection for video segmentation , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[29]  S. Tsekeridou,et al.  USE OF SUPPORT VECTOR MACHINES BASED ON COLOR AND MOTION FEATURES FOR SHOT BOUNDARY DETECTION , 2007 .

[30]  Bo Zhang,et al.  A Formal Study of Shot Boundary Detection , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[31]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[32]  Ioannis Pitas,et al.  Information theory-based shot cut/fade detection and video summarization , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[33]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[34]  Yong Fang,et al.  A New General Framework for Shot Boundary Detection Based on SVM , 2005, 2005 International Conference on Neural Networks and Brain.