Power and distortion optimized video coding for pervasive computing applications

This dissertation investigates video encoding schemes for pervasive computing applications that must ensure low power consumption in addition to high compression efficiency. The contribution of the dissertation is the formulation of a theoretical problem that captures the joint optimization of power and distortion in video coding. The study of the complexity distribution of typical video encoders helps to develop a complexity-scalable video encoding architecture that includes several control parameters to adjust the power consumption of the major modules of the encoder. An analytic framework to model, control and optimize the power-rate-distortion is developed, which facilitates the development of optimization schemes to determine the best configuration of the complexity control parameters according to either or both the power supply level of the device and the video presentation quality. The dissertation proposes complexity control schemes that dynamically adjust the control parameters. Using extensive simulations on an instruction set simulator, the accuracy of the model, and quality of the optimization schemes are investigated. For additional performance improvement, we propose algorithms that exploit the video content to reduce the power consumption and improve the video quality. This is done by obtaining and maintaining the "motion history" of a video sequence in a hierarchical fashion. By adaptively adjusting the complexity parameters according to the motion history information gained from the video sequence, the power is saved when the scene has little motion and consumed when the motion activity increases. Extensive experiments have been performed to show the validity and merits of the proposed techniques.

[1]  Zhihai He,et al.  Analysis and design of power constrained video encoder , 2004, Proceedings of the IEEE 6th Circuits and Systems Symposium on Emerging Technologies: Frontiers of Mobile and Wireless Communication (IEEE Cat. No.04EX710).

[2]  Zixiang Xiong,et al.  Joint source-channel video coding for a power constrained noisy channel , 1999, Conference Record of the Thirty-Third Asilomar Conference on Signals, Systems, and Computers (Cat. No.CH37020).

[3]  Yao Wang,et al.  Modelling power consumption of a H.263 video encoder , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[4]  P. Le Moigne,et al.  Energy gauge for lead-acid batteries in electric vehicles , 2000 .

[5]  Michael Joseph Gormish,et al.  Source coding with channel, distortion, and complexity constraints , 1994 .

[6]  Ephraim Feig,et al.  Fast algorithms for the discrete cosine transform , 1992, IEEE Trans. Signal Process..

[7]  Margaret Martonosi,et al.  Wattch: a framework for architectural-level power analysis and optimizations , 2000, Proceedings of 27th International Symposium on Computer Architecture (IEEE Cat. No.RS00201).

[8]  Masao Ikekawa,et al.  Fast and accurate motion estimation algorithm by adaptive search range and shape selection , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[9]  Ahmed H. Tewfik,et al.  Power optimized mode selection for H.263 video coding and wireless communications , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[10]  Yao Wang,et al.  Optimal coding rate and power allocation for the streaming of scalably encoded video over a wireless link , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Sanjit K. Mitra,et al.  A linear source model and a unified rate control algorithm for DCT video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[12]  Luca Benini,et al.  A survey of design techniques for system-level dynamic power management , 2000, IEEE Trans. Very Large Scale Integr. Syst..

[13]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[14]  Antonio Ortega,et al.  Bit-rate control using piecewise approximated rate-distortion characteristics , 1998, IEEE Trans. Circuits Syst. Video Technol..

[15]  Kenneth Y. Yun,et al.  A low-power VLSI architecture for full-search block-matching motion estimation , 1998, IEEE Trans. Circuits Syst. Video Technol..

[16]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[17]  Sanjit K. Mitra,et al.  A unified rate-distortion analysis framework for transform coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[18]  P. Yip,et al.  Discrete Cosine Transform: Algorithms, Advantages, Applications , 1990 .

[19]  Ishfaq Ahmad,et al.  A software-based MPEG-4 video encoder using parallel processing , 1998, IEEE Trans. Circuits Syst. Video Technol..

[20]  Thomas Sikora,et al.  The MPEG-4 video standard verification model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[21]  Magdy Bayoumi,et al.  A comparative analysis for low power motion estimation VLSI architectures , 2000, 2000 IEEE Workshop on SiGNAL PROCESSING SYSTEMS. SiPS 2000. Design and Implementation (Cat. No.00TH8528).

[22]  Ishfaq Ahmad,et al.  Optimization of H.263 video encoding using a single processor computer: performance tradeoffs and benchmarking , 2001, IEEE Trans. Circuits Syst. Video Technol..

[23]  L. Bowen,et al.  A microcontroller controlled battery fuel gauge and charger , 1994, Proceedings of 9th Annual Battery Conference on Applications and Advances.

[24]  Ming Lei Liou,et al.  A Data-Parallel Approach for Real-Time MPEG-2 Video Encoding , 1995, J. Parallel Distributed Comput..

[25]  Borko Furht,et al.  Motion estimation algorithms for video compression , 1996 .

[26]  Mihaela van der Schaar,et al.  Rate-distortion-complexity modeling for network and receiver aware adaptation , 2005, IEEE Transactions on Multimedia.

[27]  Chin-Liang Wang,et al.  New systolic array implementation of the 2-D discrete cosine transform and its inverse , 1995, IEEE Trans. Circuits Syst. Video Technol..

[28]  Qian Zhang,et al.  End-to-end power-optimized video communication over wireless channels , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[29]  Peter Pirsch,et al.  A VLSI based MIMD architecture of a multiprocessor system for real-time video processing applications , 1993, J. VLSI Signal Process..

[30]  Peter Kuhn,et al.  Algorithms, Complexity Analysis and VLSI Architectures for MPEG-4 Motion Estimation , 1999, Springer US.

[31]  Qian Zhang,et al.  A power-optimized joint source channel coding for scalable video streaming over wireless channel , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[32]  Prashant Jain,et al.  Dynamically parameterized architectures for power-aware video coding: motion estimation and DCT , 2001, Proceedings Second International Workshop on Digital and Computational Video.

[33]  Using Streaming SIMD Extensions in a Fast DCT Algorithm for MPEG Encoding , 1999 .

[34]  James W. Modestino,et al.  A joint source coding-power control approach for video transmission over CDMA networks , 2003, IEEE J. Sel. Areas Commun..

[35]  Wei Ding,et al.  Rate control of MPEG video coding and recording by rate-quantization modeling , 1996, IEEE Trans. Circuits Syst. Video Technol..

[36]  Pierre Duhamel,et al.  Polynomial transform computation of the 2-D DCT , 1990, International Conference on Acoustics, Speech, and Signal Processing.

[37]  Il-Min Kim,et al.  Transmit power optimization for video transmission over slowly-varying Rayleigh-fading channels in CDMA systems , 2004, IEEE Transactions on Wireless Communications.

[38]  Chi-Ying Tsui,et al.  Low-power VLSI design for motion estimation using adaptive pixel truncation , 2000, IEEE Trans. Circuits Syst. Video Technol..

[39]  Xiaodong Tian Efficient transmission power allocation for wireless video communications , 2004, 2004 IEEE Wireless Communications and Networking Conference (IEEE Cat. No.04TH8733).

[40]  Georgios Tziritas,et al.  Detection and location of moving objects using deterministic relaxation algorithms , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[41]  Faouzi Kossentini,et al.  Quantized discrete cosine transform: a combination of DCT and scalar quantization , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[42]  Liang-Gee Chen,et al.  Efficient moving object segmentation algorithm using background registration technique , 2002, IEEE Trans. Circuits Syst. Video Technol..

[43]  Ferran Marqués,et al.  The MPEG-4 Book , 2003, J. Electronic Imaging.

[44]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[45]  Dong Sam Ha,et al.  Low power design of DCT and IDCT for low bit rate video codecs , 2004, IEEE Transactions on Multimedia.

[46]  Il-Min Kim,et al.  Power-distortion optimized mode selection for transmission of VBR videos in CDMA systems , 2003, IEEE Trans. Commun..

[47]  Mohamed A. Elgamel,et al.  Enhanced low power motion estimation VLSI architectures for video compression , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[48]  Ming-Ting Sun,et al.  Modeling DCT coefficients for fast video encoding , 1999, IEEE Trans. Circuits Syst. Video Technol..

[49]  Mani B. Srivastava,et al.  Power-aware multimedia systems using run-time prediction , 2001, VLSI Design 2001. Fourteenth International Conference on VLSI Design.

[50]  Qian Zhang,et al.  Power-minimized bit allocation for video communication over wireless channels , 2002, IEEE Trans. Circuits Syst. Video Technol..

[51]  Sarma B. K. Vrudhula,et al.  Battery Modeling for Energy-Aware System Design , 2003, Computer.

[52]  Nam Ik Cho,et al.  DCT algorithms for VLSI parallel implementations , 1990, IEEE Trans. Acoust. Speech Signal Process..

[53]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraints , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[54]  Elza Erkip,et al.  Power efficient H.263 video transmission over wireless channels , 2002, Proceedings. International Conference on Image Processing.

[55]  Mohan Vishwanath,et al.  A low power video encoder with power, memory and bandwidth scalability , 1996, Proceedings of 9th International Conference on VLSI Design.

[56]  Ian F. Akyildiz,et al.  Wireless sensor networks: a survey , 2002, Comput. Networks.

[57]  N. Cho,et al.  Fast algorithm and implementation of 2-D discrete cosine transform , 1991 .

[58]  Touradj Ebrahimi,et al.  The MPEG-4 Book , 2002 .

[59]  Valentin S. Kisimov,et al.  Video Acceptability and Frame Rate , 1995, IEEE Multim..

[60]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[61]  P. Yang,et al.  Prime factor decomposition of the discrete cosine transform and its hardware realization , 1985, ICASSP '85. IEEE International Conference on Acoustics, Speech, and Signal Processing.

[62]  John A. Canaris A VLSI architecture for the real time computation of discrete trigonometric transforms , 1993, J. VLSI Signal Process..

[63]  Elza Erkip,et al.  Power efficient multimedia communication over wireless channels , 2003, IEEE J. Sel. Areas Commun..

[64]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[65]  Ishfaq Ahmad,et al.  Power-rate-distortion analysis for wireless video communication under energy constraint , 2004, IS&T/SPIE Electronic Imaging.

[66]  Rabab Kreidieh Ward,et al.  Computation-performance control for DCT-based video coding , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[67]  Krishna M. Sivalingam,et al.  Battery power sensitive video processing in wireless networks , 1998, Ninth IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (Cat. No.98TH8361).

[68]  Vivek K. Goyal,et al.  Computation-distortion characteristics of block transform coding , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[69]  Aggelos K. Katsaggelos,et al.  Minimizing transmission energy in wireless video communications , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[70]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1997, IEEE Trans. Circuits Syst. Video Technol..

[71]  Peter Pirsch,et al.  VLSI architectures for video compression-a survey , 1995, Proc. IEEE.

[72]  Yuzhuo Zhong,et al.  Rate Allocation of Equal Image Quality for MPEG-4 FGS Video Streaming , 2002 .

[73]  David K. Y. Yau,et al.  Predicting energy consumption of MPEG video playback on handhelds , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[74]  Chok-Kwan Cheung,et al.  A hierarchical block motion estimation algorithm using partial distortion measure , 1997, Proceedings of International Conference on Image Processing.

[75]  Aggelos K. Katsaggelos,et al.  Joint source-channel coding and power adaptation for energy efficient wireless video communications , 2005, Signal Process. Image Commun..

[76]  Linda Dailey Paulson,et al.  Will Fuel Cells Replace Batteries in Mobile Devices? , 2003, Computer.

[77]  T. Cover,et al.  Rate Distortion Theory , 2001 .

[78]  K. J. Ray Liu,et al.  Low-Power Architectures for Compressed Domain Video Coding Co-Processor , 2000, IEEE Trans. Multim..