A novel frame recovery algorithm based on spatial and temporal correlation

In video transmission over unreliable channels such as wireless channels or the Internet, transmission errors by for example packet loss are inevitable. For low bit-rate video applications, the loss of a packet may result in the loss of a whole video frame. In this paper, we propose a new algorithm to recover the lost frame. The proposed algorithm explores the spatial and temporal correlation among motion vectors integrative, and then estimates the motion vector field of the lost frame. Finally, adaptive overlapped block motion compensation is used to reconstruct the concealed picture. Results show that the proposed algorithm outperforms other techniques in both PSNR and subjective visual quality.

[1]  Ioannis Pitas,et al.  Vector rational interpolation schemes for erroneous motion field estimation applied to MPEG-2 error concealment , 2004, IEEE Transactions on Multimedia.

[2]  C.-C. Jay Kuo,et al.  Fast motion vector estimation using multiresolution-spatio-temporal correlations , 1997, IEEE Trans. Circuits Syst. Video Technol..

[3]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[4]  Chang-Su Kim,et al.  Error Concealment of H.264/AVC Video Frames for Mobile Video Broadcasting , 2007, IEEE Transactions on Consumer Electronics.

[5]  Itu-T Video coding for low bitrate communication , 1996 .

[6]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[7]  Liang-Gee Chen,et al.  Analysis and complexity reduction of multiple reference frames motion estimation in H.264/AVC , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Michael R. Frater,et al.  A cell-loss concealment technique for MPEG-2 coded video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[9]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[10]  Cedric Nishan Canagarajah,et al.  Enhanced error concealment with mode selection , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  A. Chimienti,et al.  Frame concealment for H.264/AVC decoders , 2005, 2005 Digest of Technical Papers. International Conference on Consumer Electronics, 2005. ICCE..