Spatial Error Concealment Based on Edge Visual Clearness for Image/Video Communication

In this paper, we propose a technique for concealing missing image/video blocks based on the concept of visual clearness of an edge. A scanning procedure based on the Hough transform allows us to find the relevant edges, and the visually clearest ones are employed in an interpolation based reconstruction. Specifically, several interpolations are combined according to a set of weights which allows the reconstruction of more complex textures. These weights are derived from the visual clearness associated to an edge and are unique for every pixel within the missing macroblock. The resulting algorithm is quite efficient, simple, and competitive in comparison with other state-of-the-art techniques.

[1]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Yan Zhao,et al.  Spatial Error Concealment Using Directional Extrapolation , 2005, Digital Image Computing: Techniques and Applications (DICTA'05).

[3]  Russell M. Mersereau,et al.  The use of Hough transforms in spatial error concealment , 2000, 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.00CH37100).

[4]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[5]  Ángel M. Gómez,et al.  Error concealment based on MMSE estimation for multimedia wireless and IP applications , 2008, 2008 IEEE 19th International Symposium on Personal, Indoor and Mobile Radio Communications.

[6]  Ness B. Shroff,et al.  Error concealment techniques for encoded video streams , 1995, Proceedings., International Conference on Image Processing.

[7]  Hamid Gharavi,et al.  Spatial interpolation algorithm for error concealment , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[9]  C.-C. Jay Kuo,et al.  Spatial and Temporal Error Concealment Techniques for Video Transmission Over Noisy Channels , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Rabab Kreidieh Ward,et al.  An adaptive Markov random field based error concealment method for video communication in an error prone environment , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[11]  Zhang Rongfu,et al.  Content-adaptive spatial error concealment for video communication , 2004 .

[12]  Zhou Wang,et al.  Multi-scale structural similarity for image quality assessment , 2003 .

[13]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[14]  Xiaojing Ma,et al.  A Data Hiding Algorithm for H.264/AVC Video Streams Without Intra-Frame Distortion Drift , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[15]  Jianfei Cai,et al.  Image error-concealment via Block-based Bilateral Filtering , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[16]  Sumohana S. Channappayya,et al.  The High-Resolution Rate-Distortion Function under the Structural Similarity Index , 2011, EURASIP J. Adv. Signal Process..

[17]  Oscar C. Au,et al.  Edge-Directed Error Concealment , 2010, IEEE Transactions on Circuits and Systems for Video Technology.