Macroblock‐based progressive fine granularity scalable video coding

A novel highly efficient macroblock‐based progressive fine granularity scalable (MBPFGS) video coding scheme that can optimally balance drifting errors and coding efficiency is proposed in this article. In order to improve coding efficiency, the existing PFGS video coding scheme uses a set of high‐quality references to predict the enhancement layers. However, potential drifting errors may arise because high‐quality references may not always be available at the decoder when channel bandwidth fluctuates. To solve this problem, we first analyze when drifting errors occur and how they will propagate. Then, an iterative model is established to estimate the drifting errors at the encoder. Meanwhile, three new INTER modes are proposed for the coding of macroblocks at the enhancement layers. One of these modes provides an effective and flexible method to reduce the drifting errors at low enhancement bit rates. Furthermore, we present a decision‐making mechanism to select the proper coding mode for each macroblock at the enhancement layers. Experimental results show that the proposed techniques can dramatically reduce drifting errors at low enhancement bit rates, while significantly improving coding efficiency, up to 2.3 dB in average PSNR, compared with MPEG‐4 FGS at moderate or high bit rates. © 2004 Wiley Periodicals, Inc. Int J Imaging Syst Technol 13, 297–307, 2003; Published online in Wiley InterScience (www.interscience.wiley.com). DOI 10.1002/ima.10071

[1]  Andrea Basso,et al.  DCT-based scalable video coding with drift , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[2]  Feng Wu,et al.  A framework for efficient progressive fine granularity scalable video coding , 2001, IEEE Trans. Circuits Syst. Video Technol..

[3]  Feng Wu,et al.  H.26L-based fine granularity scalable video coding , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[4]  Mohammed Ghanbari,et al.  Efficient H.261-based two-layer video codecs for ATM networks , 1995, IEEE Trans. Circuits Syst. Video Technol..

[5]  Sun Xiao-yan Macroblock-Based Progressive Fine Granularity Scalable Video Coding , 2002 .

[6]  Michael R. Frater,et al.  Efficient drift-free signal-to-noise ratio scalability , 2000, IEEE Trans. Circuits Syst. Video Technol..

[7]  Mihaela van der Schaar,et al.  A hybrid temporal-SNR fine-granular scalability for Internet video , 2001, IEEE Trans. Circuits Syst. Video Technol..

[8]  John D. Villasenor,et al.  . Adaptive intra block update for robust transmission of H.263 , 2000, IEEE Trans. Circuits Syst. Video Technol..

[9]  B. Girod,et al.  Scalable codec architectures for Internet video-on-demand , 1997, Conference Record of the Thirty-First Asilomar Conference on Signals, Systems and Computers (Cat. No.97CB36136).

[10]  Oliver Werner,et al.  Drift analysis and drift reduction for multiresolution hybrid video coding , 1996, Signal Process. Image Commun..

[11]  Weiping Li,et al.  Overview of fine granularity scalability in MPEG-4 video standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[12]  John F. Arnold,et al.  Layered coding using bitstream decomposition with drift correction , 1997, IEEE Trans. Circuits Syst. Video Technol..

[13]  Pao-Chi Chang,et al.  Precise and fast error tracking for error-resilient transmission of H.263 video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[14]  Jian Lu,et al.  Signal processing for Internet video streaming: a review , 2000, Electronic Imaging.

[15]  Injong Rhee,et al.  Error recovery for interactive video transmission over the Internet , 2000, IEEE Journal on Selected Areas in Communications.

[16]  Xuemin Chen,et al.  Fine granularity scalability in MPEG-4 for streaming video , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[17]  Bernd Girod,et al.  Standard compatible extension of H.263 for robust video transmission in mobile environments , 1997, IEEE Trans. Circuits Syst. Video Technol..

[18]  Tihao Chiang,et al.  A robust fine granularity scalability using trellis-based predictive leak , 2002, IEEE Trans. Circuits Syst. Video Technol..

[19]  Wen Gao,et al.  Macroblock-based progressive fine granularity scalable (PFGS) video coding with flexible temporal-SNR scalablilities , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[20]  Yen-Kuang Chen,et al.  Mode-adaptive fine granularity scalability , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[21]  Wen Gao,et al.  Macroblock-based progressive fine granularity scalable video coding , 2001, IEEE International Conference on Multimedia and Expo, 2001. ICME 2001..