Supporting region-of-interest cropping through constrained compression

The ability to create very high-resolution video is becoming relative easy to do today, either through a single high definition video camera or panoramic video stitched from multiple cameras. This means that supporting region-of-interest cropping will become more important in the future. In this paper, we propose a mechanism to support region-of-interest adaptation of stored video. The proposed approach creates a compression compliant stream (e.g., MPEG-2), while still allowing it to be cropped. Using data from a motion-picture industry video camera, we show that the proposed approach, while adding a small amount of overhead, can be used to efficiently crop large resolution video into a smaller stream.

[1]  Norman P. Jouppi,et al.  Region of interest editing of MPEG-2 video streams in the compressed domain , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[2]  Wesley De Neve,et al.  A real-time content adaptation framework for exploiting ROI scalability in H.264/AVC , 2006 .

[3]  Narendra Ahuja,et al.  A scheme for spatial scalability using nonscalable encoders , 2003, IEEE Trans. Circuits Syst. Video Technol..

[4]  Yong Man Ro,et al.  Multiple Region-of-Interest Support in Scalable Video Coding , 2006 .

[5]  Aniruddha Sinha,et al.  Region-of-interest based compressed domain video transcoding scheme , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Newton Lee,et al.  ACM Transactions on Multimedia Computing, Communications and Applications (ACM TOMCCAP) , 2007, CIE.

[7]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[8]  Ming-Ting Sun,et al.  Dynamic region of interest transcoding for multipoint video conferencing , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Arun N. Netravali,et al.  Digital Video: An introduction to MPEG-2 , 1996 .

[10]  P. Agathoklis,et al.  Frame-Accurate Video Cropping in Compressed MPEG Domain , 2007, 2007 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing.

[11]  Bernd Girod,et al.  Optimal slice size for streaming regions of high resolution video with virtual pan/tilt/zoom functionality , 2007, 2007 15th European Signal Processing Conference.

[12]  B. S. Manjunath,et al.  Region of interest extraction and virtual camera control based on panoramic video capturing , 2005, IEEE Transactions on Multimedia.

[13]  Larry S. Davis,et al.  Multi-scale video cropping , 2007, ACM Multimedia.

[14]  Jie Huang,et al.  An experimental analysis of DCT-based approaches for fine-grained multiresolution video , 2006, Multimedia Systems.

[15]  Wesley De Neve,et al.  A Real-Time Content Adaptation Framework for Exploiting ROI Scalability in H.264/AVC , 2006, ACIVS.

[16]  Haohong Wang,et al.  Real-Time Region-of-Interest Video Coding Using Content-Adaptive Background Skipping With Dynamic Bit Reallocation , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[17]  Xing Xie,et al.  Looking into video frames on small displays , 2003, ACM Multimedia.

[18]  Yu Sun,et al.  Video transcoding: an overview of various techniques and research issues , 2005, IEEE Transactions on Multimedia.