Joint Source-Channel Distortion Modeling for MPEG-4 Video

Multimedia communication has become one of the main applications in commercial wireless systems. Multimedia sources, mainly consisting of digital images and videos, have high bandwidth requirements. Since bandwidth is a valuable resource, it is important that its use should be optimized for image and video communication. Therefore, interest in developing new joint source-channel coding (JSCC) methods for image and video communication is increasing. Design of any JSCC scheme requires an estimate of the distortion at different source coding rates and under different channel conditions. The common approach to obtain this estimate is via simulations or operational rate-distortion curves. These approaches, however, are computationally intensive and, hence, not feasible for real-time coding and transmission applications. A more feasible approach to estimate distortion is to develop models that predict distortion at different source coding rates and under different channel conditions. Based on this idea, we present a distortion model for estimating the distortion due to quantization and channel errors in MPEG-4 compressed video streams at different source coding rates and channel bit error rates. This model takes into account important aspects of video compression such as transform coding, motion compensation, and variable length coding. Results show that our model estimates distortion within 1.5 dB of actual simulation values in terms of peak-signal-to-noise ratio.

[1]  Aggelos K. Katsaggelos,et al.  Joint source-channel coding for motion-compensated DCT-based SNR scalable video , 2002, IEEE Trans. Image Process..

[2]  Hamid Jafarkhani,et al.  Power optimization of wireless media systems with space-time block codes , 2004, IEEE Transactions on Image Processing.

[3]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[4]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[5]  David J. Miller,et al.  Transport of wireless video using separate, concatenated, and joint source-channel coding , 1999, Proc. IEEE.

[6]  Rui Zhang,et al.  Video coding with optimal inter/intra-mode switching for packet loss resilience , 2000, IEEE Journal on Selected Areas in Communications.

[7]  Robert W. Heath,et al.  A joint source-channel distortion model for JPEG compressed images , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[8]  Ya-Qin Zhang,et al.  Transporting real-time video over the Internet: challenges and approaches , 2000, Proceedings of the IEEE.

[9]  Il-Min Kim,et al.  An optimum power management scheme for wireless video service in CDMA systems , 2003, IEEE Trans. Wirel. Commun..

[10]  Lianji Cheng,et al.  Rate-distortion optimized unequal loss protection for FGS compressed video , 2004, IEEE Transactions on Broadcasting.

[11]  Il-Min Kim,et al.  A new resource allocation scheme based on a PSNR criterion for wireless video transmission to stationary receivers over Gaussian channels , 2002, IEEE Trans. Wirel. Commun..

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  Faouzi Kossentini,et al.  Rate-distortion optimized layered coding with unequal error protection for robust Internet video , 2001, IEEE Trans. Circuits Syst. Video Technol..

[14]  R. Talluri,et al.  Error-resilient video coding in the ISO MPEG-4 standard , 1998, IEEE Commun. Mag..

[15]  K. J. Ray Liu,et al.  The subband modulation: a joint power and rate allocation framework for subband image and video transmission , 1999, IEEE Trans. Circuits Syst. Video Technol..

[16]  James W. Modestino,et al.  Operational rate-distortion performance for joint source and channel coding of images , 1999, IEEE Trans. Image Process..

[17]  Maja Bystrom,et al.  Combined source-channel coding schemes for video transmission over an additive white Gaussian noise channel , 2000, IEEE Journal on Selected Areas in Communications.

[18]  Thomas Stockhammer,et al.  Dependent source and channel rate allocation for video transmission , 2004, IEEE Transactions on Wireless Communications.

[19]  Kannan Ramchandran,et al.  Robust image transmission over energy-constrained time-varying channels using multiresolution joint source-channel coding , 1998, IEEE Trans. Signal Process..

[20]  Iain E. G. Richardson,et al.  H.264 and MPEG-4 Video Compression: Video Coding for Next-Generation Multimedia , 2003 .

[21]  Antonio Ortega,et al.  Multiresolution broadcast for digital HDTV using joint source-channel coding , 1992, [Conference Record] SUPERCOMM/ICC '92 Discovering a New World of Communications.

[22]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[23]  Bernd Girod,et al.  Analysis of video transmission over lossy channels , 2000, IEEE Journal on Selected Areas in Communications.

[24]  Douglas L. Jones,et al.  Joint source channel matching for a wireless image transmission , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[25]  Aria Nosratinia,et al.  Source-channel rate allocation for progressive transmission of images , 2003, IEEE Trans. Commun..

[26]  Hayder Radha,et al.  Statistical analysis and distortion modeling of MPEG-4 FGS , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[27]  Siavash Alamouti,et al.  Multipriority video transmission for third-generation wireless communication systems , 1999 .

[28]  K.M. Uz,et al.  Multiresolution Broadcast for Digital HDTV Using Joint Source/Channel Coding , 1993, IEEE J. Sel. Areas Commun..

[29]  Aggelos K. Katsaggelos,et al.  Joint source coding and transmission power management for energy efficient wireless video communications , 2002, IEEE Trans. Circuits Syst. Video Technol..

[30]  Avideh Zakhor,et al.  Bit allocation for joint source/channel coding of scalable video , 2000, IEEE Trans. Image Process..

[31]  Anastasis A. Sofokleous,et al.  Review: H.264 and MPEG-4 Video Compression: Video Coding for Next-generation Multimedia , 2005, Comput. J..

[32]  Cyril Bergeron,et al.  Modelling H.264/AVC sensivitity for error protection in wireless transmissions , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[33]  J. Hagenauer,et al.  Channel coding and transmission aspects for wireless multimedia , 1999, Proc. IEEE.

[34]  Hayder Radha,et al.  Rate-distortion modeling of scalable video coders , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[35]  Qian Zhang,et al.  Power-minimized bit allocation for video communication over wireless channels , 2002, IEEE Trans. Circuits Syst. Video Technol..

[36]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimized hybrid error control for real-time packetized video transmission , 2006 .

[37]  Aggelos K. Katsaggelos,et al.  Rate-distortion optimized hybrid error control for real-time packetized video transmission , 2006, IEEE Transactions on Image Processing.