An integrated system for content-based video retrieval and browsing

This paper presents an integrated system solution for computer assisted video parsing and content-based video retrieval and browsing. The effectiveness of this solution lies in its use of video content information derived from a parsing process, being driven by visual feature analysis. That is, parsing will temporally segment and abstract a video source, based on low-level image analyses; then retrieval and browsing of video will be based on key-frame, temporal and motion features of shots. These processes and a set of tools to facilitate content-based video retrieval and browsing using the feature data set are presented in detail as functions of an integrated system.

[1]  Brian C. O'Connor,et al.  Selecting Key Frames of Moving Image Documents: A Digital Environment for Analysis and Navigation. , 1991 .

[2]  Makoto Miyahara,et al.  Mathematical Transform Of (R, G, B) Color Data To Munsell (H, V, C) Color Data , 1988, Other Conferences.

[3]  Behzad Shahraray,et al.  Automatic generation of pictorial transcripts of video programs , 1995, Electronic Imaging.

[4]  Alex Pentland,et al.  Photobook: tools for content-based manipulation of image databases , 1994, Electronic Imaging.

[5]  Esther M. Arkin,et al.  An efficiently computable metric for comparing polygonal shapes , 1991, SODA '90.

[6]  Jack Gregory.  Review of "Computational geometry for design and manufacture" by I. D. Faux and M. J. Pratt. Halsted Press (Wiley) 1979. , 1984, COMG.

[7]  HongJiang Zhang,et al.  Scheme for visual feature-based image indexing , 1995, Electronic Imaging.

[8]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[9]  John S. Boreczky,et al.  Indexes for user access to large video databases , 1994, Electronic Imaging.

[10]  R. L. Baker,et al.  Global zoom/pan estimation and compensation for video compression , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[11]  Marc Davis,et al.  Media Streams: an iconic visual language for video annotation , 1993, Proceedings 1993 IEEE Symposium on Visual Languages.

[12]  Stephen W. Smoliar,et al.  Content-based video browsing tools , 1995, Electronic Imaging.

[13]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[14]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[15]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[16]  Stefano Spaccapietra,et al.  Visual Database Systems 3 , 1995, IFIP — The International Federation for Information Processing.

[17]  Michael Mills,et al.  A magnifier tool for video data , 1992, CHI.

[18]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[19]  Philippe Aigrain,et al.  The automatic real-time analysis of film editing and transition effects and its applications , 1994, Comput. Graph..

[20]  Yihong Gong,et al.  Image retrieval based on color features: an evaluation study , 1995, Other Conferences.

[21]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[22]  Walter Bender,et al.  Salient video stills: content and context preserved , 1993, MULTIMEDIA '93.

[23]  Boon-Lock Yeo,et al.  Video browsing using clustering and scene transitions on compressed sequences , 1995, Electronic Imaging.

[24]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[25]  Yihong Gong,et al.  Video parsing using compressed data , 1994, Electronic Imaging.

[26]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[27]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .