Block-based manipulations on transform-compressed images and videos

Abstract. This paper addresses the problem of direct image and video manipulation in compressed domain. The capability to perform such manipulations has become attractive in recent years, as more and more visual information is being captured, stored, and moved in compressed form. Our solution to direct manipulation of compressed images and video is based on a set of block-level transforms, called the inner block transforms (IBTs). Each IBT requires a minimal computation effort in compressed domain to yield a regular geometric transformation on an image block. The paper shows how the IBTs can be used to perform many image and video manipulations. This is done by describing the application of IBTs to image subtitling, shearing, and arbitrary angle rotation. The paper also discusses the application of IBT to M-JPEG and MPEG video. The benefits of the proposed direct compressed domain manipulation approach include faster speed, preservation of image quality, and less computing resources.

[1]  Anil K. Jain.  Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[2]  Alvy Ray Smith,et al.  3-D transformations of images in scanline order , 1980, SIGGRAPH '80.

[3]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1992 .

[4]  Neri Merhav,et al.  A transform domain approach to spatial domain image scaling , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[5]  David A. Huffman,et al.  A method for the construction of minimum-redundancy codes , 1952, Proceedings of the IRE.

[6]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[7]  Ephraim Feig,et al.  Fast algorithms for the discrete cosine transform , 1992, IEEE Trans. Signal Process..

[8]  Brian Christopher Smith,et al.  Fast software processing of motion JPEG video , 1994, MULTIMEDIA '94.

[9]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[10]  Didier Le Gall,et al.  MPEG: a video compression standard for multimedia applications , 1991, CACM.

[11]  Tom Duff,et al.  Compositing digital images , 1984, SIGGRAPH.

[12]  Carl F. R. Weiman,et al.  Continuous anti-aliased rotation and zoom of raster images , 1980, SIGGRAPH '80.

[13]  Lawrence A. Rowe,et al.  Algorithms for manipulating compressed images , 1993, IEEE Computer Graphics and Applications.

[14]  Y. Arai,et al.  A Fast DCT-SQ Scheme for Images , 1988 .