Spatio-temporal indexing of vector quantized video sequences

Visual (image and video) database systems require efficient indexing to enable fast access to the images in a database. In addition, the large memory capacity and channel bandwidth requirements for the storage and transmission of visual data necessitate the use of compression techniques. Vector quantization (VQ) is an efficient technique for low bit-rate image and video compression. In addition, the low complexity of the decoder makes VQ attractive for low power systems and applications which require fast decoding. In this paper, we present an indexing technique for compressed video using vector quantization. Here, a video sequence is first compressed using VQ. Each frame is represented by a usage map, a set of VQ labels, and a set of motion vectors. The video sequence is partitioned into shots and the various camera operations and motion within each shot are then determined by processing the VQ label maps. Each shot is indexed using a spatio-temporal index. The spatial index refers to the spatial content of the representative frame of a shot, while the temporal index represents the temporal content of the shot. The spatial index is based on the codewords used to compress the representative frame, while the temporal index is based on motion and camera operations within the shot. The proposed indexing technique is executed entirely in the compressed domain. This entails significant savings in computational and storage costs resulting in faster execution.

[1]  Forouzan Golshani,et al.  Rx for semantic video database retrieval , 1994, MULTIMEDIA '94.

[2]  Yoshinobu Tonomura,et al.  Video tomography: an efficient method for camerawork extraction and motion analysis , 1994, MULTIMEDIA '94.

[3]  Ramesh Jain,et al.  Storage and Retrieval for Image and Video Databases III , 1995 .

[4]  Shi-Kuo Chang,et al.  Two-dimensional string matching algorithm for conceptual pictorial queries , 1992, Electronic Imaging.

[5]  Masato Kurokawa,et al.  Method for retrieving sequences of images on the basis of motion analysis , 1992, Electronic Imaging.

[6]  Michael J. Swain,et al.  Interactive indexing into image databases , 1993, Electronic Imaging.

[7]  Sethuraman Panchanathan,et al.  Indexing of compressed video sequences , 1996, Electronic Imaging.

[8]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[9]  Yihong Gong,et al.  An image database system with content capturing and fast image indexing abilities , 1994, 1994 Proceedings of IEEE International Conference on Multimedia Computing and Systems.

[10]  Sethuraman Panchanathan,et al.  Image indexing using vector quantization , 1995, Electronic Imaging.

[11]  Rosalind W. Picard,et al.  Finding similar patterns in large image databases , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[12]  Sethuraman Panchanathan,et al.  Adaptive algorithms for image coding using vector quantization , 1991, Signal Process. Image Commun..

[13]  D. Legall,et al.  MPEG : A video compression standard for multimedia applications , 1991 .

[14]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[15]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[16]  Glorianna Davenport,et al.  Cinematic primitives for multimedia , 1991, IEEE Computer Graphics and Applications.

[17]  Yoshinobu Tonomura,et al.  Projection-detecting filter for video cut detection , 1994, MULTIMEDIA '93.

[18]  Teresa H. Meng,et al.  Portable video-on-demand in wireless communication , 1995, Proc. IEEE.

[19]  Ya-Qin Zhang,et al.  New vector coding schemes for image and video compression , 1994, Other Conferences.

[20]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[21]  Takao Nishitani,et al.  Entropy coding for wavelet transform of image and its application for motion picture coding , 1991, Other Conferences.

[22]  Domenico Tegolo,et al.  Shape analysis for image retrieval , 1994, Electronic Imaging.

[23]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[24]  Nilesh V. Patel,et al.  Statistical approach to scene change detection , 1995, Electronic Imaging.

[25]  Boon-Lock Yeo,et al.  A unified approach to temporal segmentation of motion JPEG and MPEG compressed video , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[26]  Remi Depommier,et al.  Content-based browsing of video sequences , 1994, MULTIMEDIA '94.

[27]  Toshikazu Kato,et al.  A sketch retrieval method for full color image database-query by visual example , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[28]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[29]  Shih-Fu Chang,et al.  Compressed-domain techniques for image/video indexing and manipulation , 1995, Proceedings., International Conference on Image Processing.

[30]  F. Arman,et al.  A Statistical Approach to Scene Change Detection , 1995 .

[31]  Stephen W. Smoliar,et al.  Developing power tools for video indexing and retrieval , 1994, Electronic Imaging.

[32]  NagasakaAkio,et al.  Automatic video indexing and full-video search for object appearances (abstract) , 1992 .

[33]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[34]  Ya-Qin Zhang,et al.  High-compression video coding using generic vector mapping , 1994, Other Conferences.

[35]  Arding Hsu,et al.  Feature management for large video databases , 1993, Electronic Imaging.

[36]  Ramesh C. Jain,et al.  Knowledge-guided parsing in video databases , 1993, Electronic Imaging.

[37]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.