Video distortion analysis and system design for wireless video communication

of Dissertation Presented to the Graduate School of the University of Florida in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy VIDEO DISTORTION ANALYSIS AND SYSTEM DESIGN FOR WIRELESS VIDEO COMMUNICATION By Zhifeng Chen December 2010 Chair: Dapeng Wu Major: Electrical and Computer Engineering In this dissertation, we address the problem of minimizing the end-to-end distortion in wireless video communication. We first analytically derive transmission distortion as a function of video statistics, channel conditions and system parameters for wireless video communication systems. Then we design practical algorithms to estimate the system parameters and video statistics. Given the channel condition, we may accurately predict the instantaneous transmission distortion by our formulae and estimation algorithms. We also prove a new theorem to extend our algorithms to support rate-distortion optimized mode decision in practical video codecs. Finally, we derive a more accurate source bit rate model and quantization distortion model than existing parametric models. Our models help us to design a rate-distortion optimized cross-layer rate control algorithm for minimizing the end-to-end distortion under resource constraints in wireless video communication systems. Our results achieve remarkable performance gains over existing solutions.

[1]  Jordi Ribas-Corbera,et al.  Rate control in DCT video coding for low-delay communications , 1999, IEEE Trans. Circuits Syst. Video Technol..

[2]  Hua Yang,et al.  Advances in Recursive Per-Pixel End-to-End Distortion Estimation for Robust Video Coding in H.264/AVC , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  K Ramchandran,et al.  Best wavelet packet bases in a rate-distortion sense , 1993, IEEE Trans. Image Process..

[4]  Jun Wu,et al.  A temporal error concealment method for H.264/AVC using motion vector recovery , 2008, IEEE Transactions on Consumer Electronics.

[5]  Sanjit K. Mitra,et al.  A linear source model and a unified rate control algorithm for DCT video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[6]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[7]  Zhihai He,et al.  Transmission distortion modeling for wireless video communication , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[8]  Sanjit K. Mitra,et al.  . Optimum bit allocation and accurate rate control for video coding via ρ-domain source modeling , 2002, IEEE Trans. Circuits Syst. Video Technol..

[9]  Yao Wang,et al.  Modeling of transmission-loss-induced distortion in decoded video , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  David Haccoun,et al.  Further results on high-rate punctured convolutional codes for Viterbi and sequential decoding , 1990, IEEE Trans. Commun..

[11]  Josef A. Nossek,et al.  Models and analysis of streaming video transmission over wireless fading channels , 2009, Signal Process. Image Commun..

[12]  André Kaup,et al.  Laplace Distribution Based Lagrangian Rate Distortion Optimization for Hybrid Video Coding , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[14]  Cedric Nishan Canagarajah,et al.  Enhanced error concealment with mode selection , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Tihao Chiang,et al.  Scalable rate control for MPEG-4 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[16]  Hua Yang,et al.  GOP-level transmission distortion modeling for mobile streaming video , 2008, Signal Process. Image Commun..

[17]  Bernd Girod,et al.  Rate-distortion hint tracks for adaptive video streaming , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Bernd Girod,et al.  Analysis of Packet Loss for Compressed Video: Effect of Burst Losses and Correlation Between Error Frames , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Wen Gao,et al.  Rate-distortion analysis for H.264/AVC video coding and its application to rate control , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Yair Shoham,et al.  Efficient bit allocation for an arbitrary set of quantizers [speech coding] , 1988, IEEE Trans. Acoust. Speech Signal Process..

[21]  Aggelos K. Katsaggelos,et al.  Joint source-channel coding for motion-compensated DCT-based SNR scalable video , 2002, IEEE Trans. Image Process..

[22]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[23]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[24]  Hsueh-Ming Hang,et al.  Source model for transform video coder and its application. I. Fundamental theory , 1997, IEEE Trans. Circuits Syst. Video Technol..

[25]  Gary J. Sullivan,et al.  Rate-distortion optimization for video compression , 1998, IEEE Signal Process. Mag..

[26]  John G. Proakis,et al.  Digital Communications , 1983 .

[27]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[28]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[29]  Miska M. Hannuksela,et al.  H.264/AVC in wireless environments , 2003, IEEE Trans. Circuits Syst. Video Technol..

[30]  Abbas Jamalipour,et al.  Wireless communications , 2005, GLOBECOM '05. IEEE Global Telecommunications Conference, 2005..

[31]  Athanasios Leontaris,et al.  Video compression for lossy packet networks with mode switching and a dual-frame buffer , 2004, IEEE Transactions on Image Processing.

[32]  Antonio Ortega,et al.  Rate-distortion methods for image and video compression , 1998, IEEE Signal Process. Mag..

[33]  Harry Leib,et al.  Evaluating the performance of convolutional codes over block fading channels , 1999, IEEE Trans. Inf. Theory.

[34]  Sanjit K. Mitra,et al.  Object-level bit allocation and scalable rate control for MPEG-4 video coding , 2001, Proceedings of Workshop and Exhibition on MPEG-4 (Cat. No.01EX511).

[35]  Bernd Girod,et al.  Distortion chains for predicting the video distortion for general packet loss patterns , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[36]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[37]  Robert W. Heath,et al.  Joint Source-Channel Distortion Modeling for MPEG-4 Video , 2006, IEEE Transactions on Image Processing.

[38]  Toby Berger,et al.  Lossy Source Coding , 1998, IEEE Trans. Inf. Theory.

[39]  Frederic Dufaux,et al.  Entropy criterion for optimal bit allocation between motion and prediction error information , 1993, Other Conferences.

[40]  Dariush Divsalar,et al.  Some new twists to problems involving the Gaussian probability integral , 1998, IEEE Trans. Commun..

[41]  Thomas Wiegand,et al.  Optimized transmission of H.26L/JVT coded video over packet-lossy networks , 2002, Proceedings. International Conference on Image Processing.

[42]  Harvey J. Everett.  Generalized Lagrange Multiplier Method for Solving Problems of Optimum Allocation of Resources , 1963 .

[43]  Bernd Girod,et al.  The Efficiency of Motion-Compensating Prediction for Hybrid Coding of Video Sequences , 1987, IEEE J. Sel. Areas Commun..

[44]  Susanto Rahardja,et al.  Adaptive rate control for H.264 , 2004, ICIP.

[45]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[46]  Thomas J. Goblick,et al.  Analog source digitization: A comparison of theory and practice (Corresp.) , 1967, IEEE Trans. Inf. Theory.

[47]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[48]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[49]  Tihao Chiang,et al.  A new rate control scheme using quadratic rate distortion model , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[50]  Cyril Leung,et al.  Efficient ARQ schemes with multiple copy decoding , 1992, IEEE Trans. Commun..

[51]  G. Bjontegaard,et al.  Calculation of Average PSNR Differences between RD-curves , 2001 .

[52]  Wen Gao,et al.  Joint Source-Channel Rate-Distortion Optimization for H.264 Video Coding Over Error-Prone Networks , 2007, IEEE Transactions on Multimedia.

[53]  Stephan Wenger,et al.  H.264/AVC over IP , 2003, IEEE Trans. Circuits Syst. Video Technol..

[54]  Sanjit K. Mitra,et al.  A novel linear source model and a unified rate control algorithm for H.263/MPEG-2/MPEG-4 , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[55]  K. Yang,et al.  A normalized rate-distortion model for H.263-compatible codecs and its application to quantizer selection , 1997, Proceedings of International Conference on Image Processing.

[56]  André Kaup,et al.  Rate-distortion optimized frame level rate control for H.264/AVC , 2008, 2008 16th European Signal Processing Conference.

[57]  Thomas Wiegand,et al.  Rate-Distortion Optimization for JVT/H.26L Video Coding in Packet Loss Environment , 2002 .

[58]  Nariman Farvardin,et al.  Optimum quantizer performance for a class of non-Gaussian memoryless sources , 1984, IEEE Trans. Inf. Theory.

[59]  Gerry Leversha,et al.  Statistical inference (2nd edn), by Paul H. Garthwaite, Ian T. Jolliffe and Byron Jones. Pp.328. £40 (hbk). 2002. ISBN 0 19 857226 3 (Oxford University Press). , 2003, The Mathematical Gazette.