New enhancements to cut, fade, and dissolve detection processes in video segmentation

We present improved algorithms for cut, fade, and dissolve detection which are fundamental steps in digital video analysis. In particular, we propose a new adaptive threshold determination method that is shown to reduce artifacts created by noise and motion in scene cut detection. We also describe new two-step algorithms for fade and dissolve detection, and introduce a method for eliminating false positives from a list of detected candidate transitions. In our detailed study of these gradual shot transitions, our objective has been to accurately classify the type of transitions (fade-in, fade-out, and dissolve) and to precisely locate the boundary of the transitions. This distinguishes our work from other early work in scene change detection which tends to focus primarily on identifying the existence of a transition rather than its precise temporal extent. We evaluate our improved algorithms against two other commonly used shot detection techniques on a comprehensive data set, and demonstrate the improved performance due to our enhancements.

[1]  Ramin Zabih,et al.  A feature-based algorithm for detecting and classifying production effects , 1999, Multimedia Systems.

[2]  Riccardo Leonardi,et al.  Scene break detection: a comparison , 1998, Proceedings Eighth International Workshop on Research Issues in Data Engineering. Continuous-Media Databases and Applications.

[3]  Borko Furht,et al.  Video and Image Processing in Multimedia Systems , 1995 .

[4]  Ian H. Witten,et al.  Managing gigabytes (2nd ed.): compressing and indexing documents and images , 1999 .

[5]  Boon-Lock Yeo,et al.  Rapid scene analysis on compressed video , 1995, IEEE Trans. Circuits Syst. Video Technol..

[6]  T. Little,et al.  Compressed Video Processing For Cut Detection , 1996 .

[7]  Rainer Lienhart,et al.  Comparison of automatic shot boundary detection algorithms , 1998, Electronic Imaging.

[8]  Adnan M. Alattar Detecting and compressing dissolve regions in video sequences with a DVI multimedia image compression algorithm , 1993, 1993 IEEE International Symposium on Circuits and Systems.

[9]  Lifang Gu,et al.  Dissolve detection in MPEG compressed video , 1997, 1997 IEEE International Conference on Intelligent Processing Systems (Cat. No.97TH8335).

[10]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[11]  Ian H. Witten,et al.  Managing Gigabytes: Compressing and Indexing Documents and Images , 1999 .

[12]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[13]  Arbee L. P. Chen,et al.  Efficient shot change detection on compressed video data , 1996, Proceedings of International Workshop on Multimedia Database Management Systems.

[14]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[15]  Adnan M. Alattar Detecting fade regions in uncompressed video sequences , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[16]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.

[17]  Liming Chen,et al.  Improvement of shot detection methods based on dynamic threshold selection , 1997, Other Conferences.

[18]  David S. Doermann,et al.  Special-effect edit detection using VideoTrails: a comparison with existing techniques , 1998, Electronic Imaging.

[19]  Jinho Lee,et al.  Processing of partial video data for detection of wipes , 1998, Electronic Imaging.

[20]  Nilesh V. Patel,et al.  Compressed Video Processing for Cut Detection , 1996 .