Automatic partitioning of full-motion video

Partitioning a video source into meaningful segments is an important step for video indexing. We present a comprehensive study of a partitioning system that detects segment boundaries. The system is based on a set of difference metrics and it measures the content changes between video frames. A twin-comparison approach has been developed to solve the problem of detecting transitions implemented by special effects. To eliminate the false interpretation of camera movements as transitions, a motion analysis algorithm is applied to determine whether an actual transition has occurred. A technique for determining the threshold for a difference metric and a multi-pass approach to improve the computation speed and accuracy have also been developed.

[1]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Azriel Rosenfeld,et al.  Chapter 10 – Segmentation , 1982 .

[4]  Ramesh C. Jain,et al.  Dynamic vision , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[5]  Arun N. Netravali,et al.  Digital Pictures: Representation and Compression , 1988 .

[6]  Wendy E. Mackay,et al.  Virtual video editing in interactive multimedia applications , 1989, CACM.

[7]  Yoshinobu Tonomura,et al.  Video handling based on structured information for hypermedia systems , 1991 .

[8]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[9]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[10]  P.A. Ruetz,et al.  Video compression makes big gains , 1991, IEEE Spectrum.

[11]  R. L. Baker,et al.  Global zoom/pan estimation and compensation for video compression , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[12]  Ming Lei Liou,et al.  Overview of the p×64 kbit/s video coding standard , 1991, CACM.

[13]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[14]  Atreyi Kankanhalli,et al.  Automatic Video Partitioning and Indexing , 1993 .

[15]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[16]  P. Anandan,et al.  A computational framework and an algorithm for the measurement of visual motion , 1987, International Journal of Computer Vision.