Production model based digital video segmentation

Effective and efficient tools for segmenting and content-based indexing of digital video are essential to allow easy access to video-based information. Most existing segmentation techniques do not use explicit models of video. The approach proposed here is inspired and influenced by well established video production processes. Computational models of these processes are developed. The video models are used to classify the transition effects used in video and to design automatic edit effect detection algorithms. Video segmentation has been formulated as a production model based classification problem. The video models are also used to define segmentation error measures. Experimental results from applying the proposed technique to commercial cable television programming are presented.

[1]  Yukinobu Taniguchi,et al.  Structured Video Computing , 1994, IEEE MultiMedia.

[2]  Terrance E. Boult,et al.  Correcting chromatic aberrations using image warping , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[4]  Atreyi Kankanhalli,et al.  Automatic partitioning of full-motion video , 1993, Multimedia Systems.

[5]  Ira Konigsberg,et al.  The Complete Film Dictionary , 1987 .

[6]  Gary H. Anderson,et al.  Video editing and post-production: A professional guide , 1984 .

[7]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[8]  Ishwar K. Sethi,et al.  Finding Trajectories of Feature Points in a Monocular Image Sequence , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Ramesh C. Jain,et al.  Feature Based Digital Video Indexing , 1997, VDB.

[11]  Ramesh C. Jain,et al.  Difference and accumulative difference pictures in dynamic scene analysis , 1984, Image Vis. Comput..

[12]  J. Limb,et al.  Estimating the Velocity of Moving Images in Television Signals , 1975 .

[13]  David Bordwell,et al.  Film Art: An Introduction , 1979 .

[14]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[15]  Ramesh C. Jain,et al.  Metadata in video databases , 1994, SGMD.

[16]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[17]  E. Dubois,et al.  Digital picture processing , 1985, Proceedings of the IEEE.

[18]  Arun Hampapur Designing video data management systems , 1995 .

[19]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[20]  George Wolberg,et al.  Digital image warping , 1990 .

[21]  Ramesh C. Jain,et al.  On the Analysis of Accumulative Difference Pictures from Image Sequences of Real World Scenes , 1979, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[23]  Edward A. Feigenbaum,et al.  Switching and Finite Automata Theory: Computer Science Series , 1990 .

[24]  Ramesh C. Jain,et al.  Digital video segmentation , 1994, MULTIMEDIA '94.