Detection of gradual transitions in video sequences using B-spline interpolation

We present a novel technique for detecting the presence of a gradual transition in video sequences and automatically identifying its type. Our scheme focuses on analyzing the characteristics of the underlying special edit effects and estimates actual transitions by polynomial data interpolation. In particular, a B-spline interpolation curve fitting technique is used. We make use of "goodness" of fitting to determine the presence of gradual transitions. Our approach is able to recover the original transition behavior of an edit effect even if it is distorted by various post-processing stages. Our gradual transition detectors have been extensively tested on various genres of real video sequences to evaluate the performance of the proposed algorithms.

[1]  Carl de Boor,et al.  A Practical Guide to Splines , 1978, Applied Mathematical Sciences.

[2]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[3]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[5]  John S. Boreczky,et al.  Comparison of video shot boundary detection techniques , 1996, Electronic Imaging.

[6]  Min Wu,et al.  An algorithm for wipe detection , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[7]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying scene breaks , 1995, MULTIMEDIA '95.

[8]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[9]  Andrew Lippman,et al.  Scalable open-architecture television , 1992 .

[10]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[11]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[12]  Adnan M. Alattar.  Detecting fade regions in uncompressed video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Ullas Gargi,et al.  Performance characterization of video-shot-change detection methods , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Rainer Lienhart,et al.  Reliable Transition Detection in Videos: A Survey and Practitioner's Guide , 2001, Int. J. Image Graph..

[15]  Peter Aundal Toft,et al.  Fast curve estimation using preconditioned generalized Radon transform , 1996, IEEE Trans. Image Process..

[16]  Gozde Bozdagi Akar,et al.  Feature-based hierarchical video segmentation , 1997, Proceedings of International Conference on Image Processing.

[17]  Hong Heather Yu,et al.  A multi-resolution video segmentation scheme for wipe transition identification , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[18]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[19]  Haibin Lu,et al.  Robust gradual scene change detection , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[20]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[21]  Warnakulasuriya Anil Chandana Fernando,et al.  Wipe scene change detection in video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[22]  Jinho Lee,et al.  Processing of partial video data for detection of wipes , 1998, Electronic Imaging.

[23]  Jeho Nam,et al.  Dissolve transition detection using B-splines interpolation , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[24]  Warnakulasuriya Anil Chandana Fernando,et al.  Fade and dissolve detection in uncompressed and compressed video sequences , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[25]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[26]  David S. Doermann,et al.  Special-effect edit detection using VideoTrails: a comparison with existing techniques , 1998, Electronic Imaging.