Video transcoding architectures and techniques: an overview

Throughout this article, we concentrate on the transcoding of block-based video coding schemes that use hybrid discrete cosine transform (DCT) and motion compensation (MC). In such schemes, the frames of the video sequence are divided into macroblocks (MBs), where each MB typically consists of a luminance block (e.g., of size 16 /spl times/ 16, or alternatively, four 8 /spl times/ 8 blocks) along with corresponding chrominance blocks (e.g., 8 /spl times/ 8 Cb and 8 /spl times/ 8 Cr). This article emphasizes the processing that is done on the luminance components of the video. In general, the chrominance components can be handled similarly and will not be discussed in this article. We first provide an overview of the techniques used for bit-rate reduction and the corresponding architectures that have been proposed. Then, we describe the advances regarding spatial and temporal resolution reduction techniques and architectures. Additionally, an overview of error resilient transcoding is also provided, as well as a discussion of scalable coding techniques and how they relate to video transcoding. Finally, the article ends with concluding remarks, including pointers to other works on video transcoding that have not been covered in this article, as well as some future directions.

[1]  Mohammed Ghanbari,et al.  Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats , 2000, IEEE Trans. Multim..

[2]  Yun Q. Shi,et al.  Constant-quality constrained-rate allocation for FGS video coded bitstreams , 2002, IS&T/SPIE Electronic Imaging.

[3]  Susie Wee Reversing motion vector fields , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[4]  John G. Apostolopoulos,et al.  Secure scalable streaming enabling transcoding without decryption , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[5]  Yap-Peng Tan,et al.  Methods and needs for transcoding MPEG-4 fine granularity scalability video , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[6]  Jenq-Neng Hwang,et al.  Dynamic frame-skipping in video transcoding , 1998, 1998 IEEE Second Workshop on Multimedia Signal Processing (Cat. No.98EX175).

[7]  Yuh-Ming Huang,et al.  AN EFFICIENT JPEG TO MPEG-11 TRANSCODING ALGORITHM , 1996 .

[8]  Anthony Vetro,et al.  Object-based transcoding for adaptable video content delivery , 2001, IEEE Trans. Circuits Syst. Video Technol..

[9]  Mohammed Ghanbari,et al.  Post-processing of MPEG2 coded video for transmission at lower bit rates , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[10]  Tihao Chiang,et al.  Efficient FGS to single layer transcoding , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[11]  Nick Feamster,et al.  MPEG-2 to H.263 transcoder , 1999, Optics East.

[12]  Feng Wu,et al.  A new rate allocation scheme for progressive fine granular scalable coding , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[13]  Ming-Ting Sun,et al.  Fast video transcoding architectures for networked multimedia applications , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[14]  Ahmet M. Kondoz,et al.  Error-resilient video transcoding for robust internetwork communications using GPRS , 2002, IEEE Trans. Circuits Syst. Video Technol..

[15]  Jenq-Neng Hwang,et al.  Scene-context-dependent reference-frame placement for MPEG video coding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[16]  Sile Yu,et al.  Dynamic Rate Scaling Of Coded Digital Video For Ivod Applications , 1998, International 1998 Conference on Consumer Electronics.

[17]  H. Kato,et al.  A fast motion estimation algorithm for DV to MPEG-2 conversion , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[18]  Yao Wang,et al.  Design and implementation of a high quality DV50-MPEG2 software transcoder , 2002, 2002 Digest of Technical Papers. International Conference on Consumer Electronics (IEEE Cat. No.02CH37300).

[19]  Ming-Ting Sun,et al.  Motion Vector Refinement for High-Performance Transcoding , 1999, IEEE Trans. Multim..

[20]  Nick Feamster,et al.  Field-to-frame transcoding with spatial and temporal downsampling , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[21]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[22]  Anthony Vetro,et al.  Drift compensation for reduced spatial resolution transcoding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jenq-Neng Hwang,et al.  Scene context dependent reference frame placement for MPEG video coding , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[24]  Yui-Lam Chan,et al.  New architecture for dynamic frame-skipping transcoder , 2002, IEEE Trans. Image Process..

[25]  N. Memon,et al.  Transcoding GIF images to JPEG-LS , 1997 .

[26]  Kyeong Ho Yang,et al.  CIF-to-QCIF video bitstream down-conversion in the DCT domain , 1998, Bell Labs Technical Journal.

[27]  Hironao Hori,et al.  Rate conversion of MPEG coded video by re-quantization process , 1995, Proceedings., International Conference on Image Processing.

[28]  Min Wu,et al.  Video transcoding by reducing spatial resolution , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[29]  Athanassios N. Skodras,et al.  Down — Sampling of compressed images in the DCT domain , 1998, 9th European Signal Processing Conference (EUSIPCO 1998).

[30]  Byung Cheol Song,et al.  Efficient video transcoding with scan format conversion , 2002, Proceedings. International Conference on Image Processing.

[31]  Chia-Wen Lin,et al.  Fast algorithms for DCT-domain video transcoding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[32]  Gustavo de los Reyes,et al.  Error-resilient transcoding for video over wireless channels , 2000, IEEE Journal on Selected Areas in Communications.

[33]  Anthony Vetro,et al.  Minimum drift architectures for 3-layer scalable DTV decoding , 1998 .

[34]  S. Gopalakrishnan Real - time MPEG System Stream Transcoder for Heterogenous Network , 1999 .

[35]  Bao,et al.  A New Approach For Memory Efficient ATV Decoding , 1997, 1997 International Conference on Consumer Electronics.

[36]  Neri Merhav,et al.  Multiplication-free approximate algorithms for compressed-domain linear operations on images , 1999, IEEE Trans. Image Process..

[37]  Yun Q. Shi,et al.  Constant quality constrained rate allocation for FGS-coded video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[38]  Gertjan Keesman,et al.  Transcoding of MPEG bitstreams , 1996, Signal Process. Image Commun..

[39]  Mohammed Ghanbari,et al.  Transcoding architectures for DCT-domain heterogeneous video transcoding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[40]  Ming-Ting Sun,et al.  Motion Re-estimation for MPEG-2 to MPEG-4 Simple Profile Transcoding , 2002 .

[41]  Mei-Juan Chen,et al.  Efficient motion-estimation algorithm for reduced frame-rate video transcoder , 2002, IEEE Trans. Circuits Syst. Video Technol..

[42]  André Vincent,et al.  Joint transcoding of multiple MPEG video bitstreams , 1999, ISCAS'99. Proceedings of the 1999 IEEE International Symposium on Circuits and Systems VLSI (Cat. No.99CH36349).

[43]  Charilaos Christopoulos,et al.  Transcoder architectures for video coding , 1998 .

[44]  Bo Shen,et al.  Adaptive motion-vector resampling for compressed video downscaling , 1999, IEEE Trans. Circuits Syst. Video Technol..

[45]  Anthony Vetro,et al.  Rate-distortion models for video transcoding , 2003, IS&T/SPIE Electronic Imaging.

[46]  Eric Barrau MPEG video transcoding to a fine-granular scalable format , 2002, Proceedings. International Conference on Image Processing.

[47]  Ming-Ting Sun,et al.  Motion re-estimation for HDTV to SDTV transcoding , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[48]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[49]  Anthony Vetro,et al.  Complexity-quality analysis of transcoding architectures for reduced spatial resolution , 2002, IEEE Trans. Consumer Electron..

[50]  Jun Yu,et al.  Video transcoding for fast forward/reverse video playback , 2002, Proceedings. International Conference on Image Processing.

[51]  Mohammed Ghanbari,et al.  A frequency-domain video transcoder for dynamic bit-rate reduction of MPEG-2 bit streams , 1998, IEEE Trans. Circuits Syst. Video Technol..

[52]  Bo Shen,et al.  Adaptive motion vector resampling for compressed video down-scaling , 1997, Proceedings of International Conference on Image Processing.

[53]  Anthony Vetro,et al.  Reduced spatio-temporal transcoding using an intra refresh technique , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[54]  Shih-Fu Chang,et al.  Manipulation and Compositing of MC-DCT Compressed Video , 1995, IEEE J. Sel. Areas Commun..

[55]  Mihaela van der Schaar,et al.  A hybrid temporal-SNR fine-granular scalability for Internet video , 2001, IEEE Trans. Circuits Syst. Video Technol..

[56]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[57]  Touradj Ebrahimi,et al.  The JPEG2000 still image coding system: an overview , 2000, IEEE Trans. Consumer Electron..

[58]  Huifang Sun,et al.  Architectures for MPEG compressed bitstream scaling , 1996, IEEE Trans. Circuits Syst. Video Technol..