Error concealment for whole frame losses based on motion vectors estimation

Losing a packet will cause losing a whole frame in high compression and high payload video communication such as wireless low bit rate video transmission. In this paper, we present a novel technique which can deal with the problem of error concealment for whole frame losses. The proposed technique exploits objects motion information from video by combining gray and color optical flow methods to reconstruct lost images. After recovering main body of the lost frame, the MRF model is applied to deal with the overlap and occlusion caused by objects movements. Results show that the proposed technique provides good subject and object image quality and has a low complexity which make it can be used on real time operation.

[1]  Judea Pearl,et al.  Probabilistic reasoning in intelligent systems - networks of plausible inference , 1991, Morgan Kaufmann series in representation and reasoning.

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[4]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[5]  Yao Wang,et al.  Error control and concealment for video communication: a review , 1998, Proc. IEEE.

[6]  Jiang Li,et al.  An Error Concealment Algorithm for Entire Frame Loss in Video Transmission , 2004 .

[7]  Naoya Ohta,et al.  Optical flow detection by color images , 1990 .

[8]  Di Hui-jun Markov Random Field in Visual Information Processing , 2009 .

[9]  오승준 [서평]「Digital Video Processing」 , 1996 .

[10]  Daniel P. Huttenlocher,et al.  Efficient Belief Propagation for Early Vision , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Polina Golland,et al.  Motion from Color , 1997, Comput. Vis. Image Underst..

[12]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..