Effective content representation for video

A universal description scheme to characterize video data and user queries is presented. We first identify content-significant components in a video sequence as defined by user requirements, and find that a representation based on people/objects, action/events, location, and time is appropriate for improving user interaction and database access. We demonstrate that currently available automatic or semi-automatic processing methods can be employed to characterize various types of content in terms of these descriptors by appropriate association of semantic meaning with syntactic features.

[1]  A. Murat Tekalp,et al.  Temporal video segmentation using unsupervised clustering and semantic object tracking , 1998, J. Electronic Imaging.

[2]  Osamu Hori,et al.  A shot classification method of selecting effective key-frames for video browsing , 1997, MULTIMEDIA '96.

[3]  A. Murat Tekalp,et al.  Editing cues for content-based analysis and summarization of motion pictures , 1997, Electronic Imaging.

[4]  Minerva M. Yeung,et al.  Efficient matching and clustering of video shots , 1995, Proceedings., International Conference on Image Processing.

[5]  Dragutin Petkovic,et al.  Content-Based Representation and Retrieval of Visual Media: A State-of-the-Art Review , 1996 .

[6]  A. Murat Tekalp,et al.  Multiscale content extraction and representation for video indexing , 1997, Other Conferences.

[7]  Remi Ronfard.  Shot-level description and matching of video content , 1997, Other Conferences.

[8]  Sol Worth,et al.  Cognitive aspects of sequence in visual communication , 1968 .

[9]  A. Murat Tekalp,et al.  Occlusion adaptive motion snake , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  Bilge Gunsel,et al.  Two-dimensional mesh-based visual-object representation for interactive synthetic/natural digital video , 1998, Proc. IEEE.

[11]  Sethuraman Panchanathan,et al.  Review of Image and Video Indexing Techniques , 1997, J. Vis. Commun. Image Represent..

[12]  A. Murat Tekalp,et al.  Digital Video Processing , 1995 .

[13]  Shih-Fu Chang,et al.  Clustering methods for video browsing and annotation , 1996, Electronic Imaging.