Tools for compressed-domain video indexing and editing

Indexing and editing digital video directly in the compressed domain offer many advantages in terms of storage efficiency and processing speed. We have designed automatic tools in the compressed domain for extracting key visual features such as scene cut, dissolve, camera operations (zoom, pan), and moving object detection and tracking. In addition, we have developed algorithms to solve the decoder buffer control problems and allow users to 'cut, copy and paste' arbitrary compressed video segments directly in the compressed domain. The compressed-domain approach does not require full decoding. Thus fast software implementations can be achieved. Our compressed video editing techniques enhance the reusability of existing compressed videos.

[1]  Akio Nagasaka,et al.  Automatic Video Indexing and Full-Video Search for Object Appearances , 1991, VDB.

[2]  R. L. Baker,et al.  Global zoom/pan estimation and compensation for video compression , 1991, [Proceedings] ICASSP 91: 1991 International Conference on Acoustics, Speech, and Signal Processing.

[3]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.

[4]  Hideo Hashimoto,et al.  Video indexing using motion vectors , 1992, Other Conferences.

[5]  Thomas A. Ohanian,et al.  Digital Nonlinear Editing: New Approaches to Editing Film and Video , 1993 .

[6]  Arding Hsu,et al.  Image processing on compressed data for large video databases , 1993, MULTIMEDIA '93.

[7]  Stephen W. Smoliar,et al.  Content based video indexing and retrieval , 1994, IEEE MultiMedia.

[8]  Shih-Fu Chang,et al.  Scene change detection in an MPEG-compressed video sequence , 1995, Electronic Imaging.

[9]  Shih-Fu Chang,et al.  Compressed-domain techniques for image/video indexing and manipulation , 1995, Proceedings., International Conference on Image Processing.

[10]  Forouzan Golshani,et al.  Motion recovery for video content classification , 1995, TOIS.

[11]  Ramesh C. Jain,et al.  Feature Based Digital Video Indexing , 1997, VDB.

[12]  Tat-Seng Chua,et al.  A video retrieval and sequencing system , 1995, TOIS.

[13]  Harpreet S. Sawhney,et al.  Model-based 2D&3D dominant motion estimation for mosaicing and video representation , 1995, Proceedings of IEEE International Conference on Computer Vision.

[14]  Ramesh Jain,et al.  Storage and Retrieval for Still Image and Video Databases IV , 1996 .

[15]  Shih-Fu Chang,et al.  Clustering methods for video browsing and annotation , 1996, Electronic Imaging.