Complexity management for video encoders

Computational complexity is an important performance constraint for software-only video CODECs. The aim of this research is to develop a video coding system with variable, controllable computational complexity. Adaptive algorithms for DCT and motion estimation are proposed separately to reduce complexity of each function and maintain it at target level. An integrated approach to video CODEC complexity management is also addressed. This work will have potential benefit for a wide range of computation-constrained or power-constrained multimedia applications.

[1]  Michael Joseph Gormish,et al.  Source coding with channel, distortion, and complexity constraints , 1994 .

[2]  Marta Karczewicz,et al.  The SP- and SI-frames design for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[3]  Abdul Hamid Sadka.  Compressed Video Communications , 2002 .

[4]  T Koga,et al.  MOTION COMPENSATED INTER-FRAME CODING FOR VIDEO CONFERENCING , 1981 .

[5]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[6]  Heiko Schwarz,et al.  Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[7]  Ricardo L. de Queiroz.  Variable complexity DCT approximations driven by an HVQ-based analyzer , 2002, IEEE Trans. Circuits Syst. Video Technol..

[8]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  Ming-Ting Sun,et al.  Fast variable-size block motion estimation using merging procedure with an adaptive threshold , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[10]  S. Kappagantula,et al.  Motion Compensated Predictive Coding , 1984, Optics + Photonics.

[11]  Konstantinos Konstantinides,et al.  Image and Video Compression Standards: Algorithms and Architectures , 1997 .

[12]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  Ming-Ting Sun,et al.  Approximation of calculations for forward discrete cosine transform , 1998, IEEE Trans. Circuits Syst. Video Technol..

[14]  Joan L. Mitchell,et al.  MPEG Video: Compression Standard , 1996 .

[15]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[16]  Iain E. G. Richardson,et al.  Macroblock skip-mode prediction for complexity control of video encoders , 2003 .

[17]  Faouzi Kossentini,et al.  An efficient computation-constrained block-based motion estimation algorithm for low bit rate video coding , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[18]  Touradj Ebrahimi,et al.  The MPEG-4 Book , 2002 .

[19]  Iain E. Garden Richardson,et al.  Macroblock classification for complexity management of video encoders , 2003, Signal Process. Image Commun..

[20]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..

[21]  Noel Brady.  MPEG-4 standardized methods for the compression of arbitrarily shaped video objects , 1999, IEEE Trans. Circuits Syst. Video Technol..

[22]  Iain E. G. Richardson,et al.  Video CODEC Design , 2002 .

[23]  C. Cheung,et al.  Normalized partial distortion search algorithm for block motion estimation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[24]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[25]  Ted Rzeszewski.  Digital video : concepts and applications across industries , 1995 .

[26]  Alexandros Eleftheriadis,et al.  Complexity distortion theory , 2003, IEEE Trans. Inf. Theory.

[27]  Jar-Ferr Yang,et al.  Computation reduction for motion search in low rate video coders , 2002, IEEE Trans. Circuits Syst. Video Technol..

[28]  Athanassios N. Skodras.  Fast discrete cosine transform pruning , 1994, IEEE Trans. Signal Process..

[29]  Narciso García,et al.  Rate control and bit allocation for MPEG-4 , 1999, IEEE Trans. Circuits Syst. Video Technol..

[30]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[31]  Oscar C. Au,et al.  A novel approach to fast multi-frame selection for H.264 video coding , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[32]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[33]  Athanassios N. Skodras,et al.  Motion estimation and DCT pruning: a combined approach to video coding , 1996, Proceedings of Third International Conference on Electronics, Circuits, and Systems.

[34]  Zhongde Wang,et al.  Pruning the fast discrete cosine transform , 1991, IEEE Trans. Commun..

[35]  Anil K. Jain,et al.  Displacement Measurement and Its Application in Interframe Image Coding , 1981, IEEE Trans. Commun..

[36]  Iain E. Garden Richardson,et al.  Adaptive algorithms for variable-complexity video coding , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[37]  Ming-Ting Sun,et al.  Modeling DCT coefficients for fast video encoding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[38]  K. Rijkse,et al.  H.263: video coding for low-bit-rate communication , 1996, IEEE Commun. Mag..

[39]  Antonio Ortega,et al.  DCT computation based on variable complexity fast approximations , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[40]  Jia-Shung Wang,et al.  A new fast block matching algorithm based on complexity‐distortion optimization , 2002, Int. J. Imaging Syst. Technol..

[41]  Chun-Hsien Chou,et al.  A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile , 1995, IEEE Trans. Circuits Syst. Video Technol..

[42]  Gaurav Bhatnagar,et al.  Introduction to Multimedia Systems , 2001 .

[43]  Wen-Hsiung Chen,et al.  A Fast Computational Algorithm for the Discrete Cosine Transform , 1977, IEEE Trans. Commun..

[44]  Iain E. Garden Richardson,et al.  Adaptive Management of Video Encoder Complexity , 2002, Real Time Imaging.

[45]  Alexis M. Tourapis,et al.  Fast motion estimation within the H.264 codec , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[46]  Mathias Wien,et al.  Variable block-size transforms for H.264/AVC , 2003, IEEE Trans. Circuits Syst. Video Technol..

[47]  Sanjit K. Mitra,et al.  Subband DCT: definition, analysis, and applications , 1996, IEEE Trans. Circuits Syst. Video Technol..

[48]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[49]  Antonio Ortega,et al.  Distortion/decoding time tradeoffs in software DCT-based image coding , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[50]  Hsieh S. Hou.  A fast recursive algorithm for computing the discrete cosine transform , 1987, IEEE Trans. Acoust. Speech Signal Process..

[51]  Gerard de Haan,et al.  Sub-pixel motion estimation with 3-D recursive search block-matching , 1994, Signal Process. Image Commun..

[52]  Paul S. Fisher,et al.  Image quality measures and their performance , 1995, IEEE Trans. Commun..

[53]  Francisco Argüello,et al.  Fast cosine transform based on the successive doubling method , 1990 .

[54]  Athanassios N. Skodras,et al.  The vector-radix fast cosine transform: Pruning and complexity analysis , 1995, Signal Process..

[55]  Rob Koenen.  Profiles and levels in MPEG-4: Approach and overview , 2000, Signal Process. Image Commun..

[56]  M. Vetterli,et al.  Computation-distortion characteristics of JPEG encoding and decoding , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[57]  K. L. Ho,et al.  A new two-dimensional fast cosine transform algorithm , 1991, IEEE Trans. Signal Process..

[58]  Zoran Bojkovic,et al.  Multimedia Communication Systems: Techniques, Standards, and Networks , 2002 .

[59]  Antonio Ortega,et al.  Novel computationally scalable algorithm for motion estimation , 1998, Electronic Imaging.

[60]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[61]  Bede Liu,et al.  New fast algorithms for the estimation of block motion vectors , 1993, IEEE Trans. Circuits Syst. Video Technol..

[62]  Antonio Ortega,et al.  Rate-complexity-distortion optimization for quadtree-based DCT coding , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[63]  Iain E. Garden Richardson,et al.  Computational complexity management of motion estimation in video encoders , 2002, Proceedings DCC 2002. Data Compression Conference.

[64]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[65]  Antonio Ortega,et al.  Bit allocation for dependent quantization with applications to multiresolution and MPEG video coders , 1994, IEEE Trans. Image Process..

[66]  Touradj Ebrahimi,et al.  MPEG-4 natural video coding - An overview , 2000, Signal Process. Image Commun..

[67]  Ulrich Heute,et al.  Subband DFT - Part II: Accuracy, complexity and applications , 1995, Signal Process..

[68]  Ulrich Heute,et al.  Fast approximate DCT: basic-idea, error analysis, applications , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[69]  Gerard de Haan,et al.  Complexity scalable motion estimation , 2002, IS&T/SPIE Electronic Imaging.

[70]  Jo Yew Tham,et al.  A novel unrestricted center-biased diamond search algorithm for block motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[71]  Injong Rhee,et al.  Error control techniques for interactive low-bit rate video transmission over the Internet , 1998, SIGCOMM '98.

[72]  M. GHANBARI,et al.  The cross-search algorithm for motion estimation [image coding] , 1990, IEEE Trans. Commun..

[73]  Gary J. Sullivan,et al.  Rate-constrained coder control and comparison of video coding standards , 2003, IEEE Trans. Circuits Syst. Video Technol..

[74]  Iain E. G. Richardson,et al.  Digital Video Communications , 1997 .

[75]  Vivek K. Goyal,et al.  Computation-distortion characteristics of block transform coding , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[76]  Lai-Man Po,et al.  A novel four-step search algorithm for fast block motion estimation , 1996, IEEE Trans. Circuits Syst. Video Technol..