Efficient Frame Error Concealment Using Bilateral Motion Estimation for Low Bit-Rate Video Transmission

In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains. Thus, the loss of a single packet can lead to the loss of a whole video frame. In this paper, we propose a novel error concealment algorithm that can effectively reconstruct the lost frame and protect the quality of video streams from the degradation caused by propagation errors. The proposed algorithm employs a bilateral motion estimation scheme where the weighted sum of the received motion vectors (MVs) in the neighboring frames is utilized to construct the MV field for the concealed frame. Unlike the conventional algorithms, the proposed scheme does not produce any overlapped pixel and hole region in the reconstructed frame. The proposed algorithm can be applied not only to the case of single frame loss but also adaptively extended to the case of multiframe loss. Experimental results show that the proposed algorithm outperforms other conventional techniques in terms of both peak signal-to-noise ratio (PSNR) performance and subjective visual quality.

[1]  Jianfei Cai,et al.  Joint source channel rate-distortion analysis for adaptive mode selection and rate control in wireless video coding , 2002, IEEE Trans. Circuits Syst. Video Technol..

[2]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[3]  Mahmoud Naghshineh,et al.  End-to-end QoS provisioning in multimedia wireless/mobile networks using an adaptive framework , 1997, IEEE Commun. Mag..

[4]  Peter Csillag,et al.  Enhancement of video data using motion-compensated postprocessing techniques , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Michael R. Frater,et al.  A cell-loss concealment technique for MPEG-2 coded video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[6]  Pierpaolo Baccichet,et al.  Frame concealment for H.264/AVC decoders , 2005, IEEE Transactions on Consumer Electronics.

[7]  Yong Bai,et al.  Performance of a mixed-traffic CDMA2000 wireless network with scalable streaming video , 2003, IEEE Trans. Circuits Syst. Video Technol..

[8]  Jechang Jeong,et al.  Fine directional interpolation for spatial error concealment , 2006, IEEE Transactions on Consumer Electronics.

[9]  Yanling Xu,et al.  H.264 video communication based refined error concealment schemes , 2004, IEEE Transactions on Consumer Electronics.

[10]  Ming-Chieh Chi,et al.  Temporal error concealment algorithm by recursive block-matching principle , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Frédéric Dufaux,et al.  A motion field segmentation to improve moving edges reconstruction in video coding , 1994, Proceedings of 1st International Conference on Image Processing.

[12]  Sung-Jea Ko,et al.  Robust error concealment for visual communications in burst-packet-loss networks , 2003, IEEE Trans. Consumer Electron..

[13]  Sung-Jea Ko,et al.  Improved Fading Scheme for Spatio-Temporal Error Concealment in Video Transmission , 2008, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[14]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[15]  Sung-Jea Ko,et al.  Frame Error Concealment Technique Using Adaptive Inter-Mode Estimation for H.264/AVC , 2008, 2008 Digest of Technical Papers - International Conference on Consumer Electronics.

[16]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[17]  Jian Lu,et al.  Signal processing for Internet video streaming: a review , 2000, Electronic Imaging.