Temporal error concealment using quad-tree prediction and coherency sensitive hashing for HEVC

Abstract. This paper presents a temporal video error concealment method specially designed for H.265/HEVC. We propose the quad-tree partitioning prediction and the coherency sensitive hashing in order for better error concealment performance in the corrupted frames via HEVC codec. First, we try to deduce the most probable partitioning of the missing coding tree unit (CTU) using the proposed quad-tree partitioning prediction, which generates several CUs that constitute the CTU. Then, a coding unit (CU) priority choosing method is applied to select the best one from these CUs for prior concealment. Last, the coherency sensitive hashing is adopted for concealing the chosen best CU for better searching quality. The experiments shows that the recovery performance of the purposed method surpasses the compared state-of-the-art methods since the quad-tree partitioning prediction, the priority choosing process, and the coherency sensitive hashing help to improve the overall performance.

[1]  Enrico Magli,et al.  Concealment of whole-frame losses for wireless low bit-rate video based on multiframe optical flow estimation , 2005, IEEE Transactions on Multimedia.

[2]  Zhi-Heng Zhou,et al.  Efficient adaptive MRF-MAP error concealment of video sequences , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[3]  Aditi,et al.  Robust image hashing through DWT-SVD and spectral residual method , 2017, EURASIP Journal on Image and Video Processing.

[4]  André Kaup,et al.  Content-Adaptive Motion Compensated Frequency Selective Extrapolation for error concealment in video communication , 2010, 2010 IEEE International Conference on Image Processing.

[5]  Huijun Gao,et al.  Sparsity-Based Image Error Concealment via Adaptive Dual Dictionary Learning and Regularization. , 2017, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[6]  Thomas Eriksson,et al.  Spatio-Temporal Markov Random Field-Based Packet Video Error Concealment , 2007, 2007 IEEE International Conference on Image Processing.

[7]  Wen-Nung Lie,et al.  Motion Vector Recovery for Video Error Concealment by Using Iterative Dynamic-Programming Optimization , 2014, IEEE Transactions on Multimedia.

[8]  Ting-Lan Lin,et al.  Video Motion Vector Recovery Method Using Decoding Partition Information , 2016, Journal of Display Technology.

[9]  Jian Sun,et al.  Computing nearest-neighbor fields via Propagation-Assisted KD-Trees , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Rabul Hussain Laskar,et al.  Image authentication based on robust image hashing with geometric correction , 2018, Multimedia Tools and Applications.

[11]  Xinpeng Zhang,et al.  An Effective CU Size Decision Method for HEVC Encoders , 2013, IEEE Transactions on Multimedia.

[12]  Gary J. Sullivan,et al.  Overview of the High Efficiency Video Coding (HEVC) Standard , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Ram Kumar Karsh,et al.  Robust image hashing using ring partition-PGNMF and local features , 2016, SpringerPlus.

[14]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Gwo-Long Li,et al.  Effective error concealment algorithm of whole frame loss for H.264 video coding standard by recursive motion vector refinement , 2010, IEEE Transactions on Consumer Electronics.

[16]  Til Aach,et al.  Frequency selective signal extrapolation with applications to error concealment in image communication , 2005 .

[17]  Jun Wu,et al.  A temporal error concealment method for H.264/AVC using motion vector recovery , 2008, IEEE Transactions on Consumer Electronics.

[18]  Huijuan Cui,et al.  An effective error concealment scheme for heavily corrupted H.264/AVC videos based on Kalman filtering , 2014, Signal Image Video Process..

[19]  Dinh Trieu Duong,et al.  Hybrid Temporal Error Concealment Methods for Block-Based Compressed Video Transmission , 2008, IEEE Transactions on Broadcasting.

[20]  Shai Avidan,et al.  Coherency Sensitive Hashing , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Aleksandra Pizurica,et al.  Passive Error Concealment for Wavelet-Coded I-Frames With an Inhomogeneous Gauss–Markov Random Field Model , 2009, IEEE Transactions on Image Processing.

[22]  Stan Z. Li,et al.  Markov Random Field Models in Computer Vision , 1994, ECCV.

[23]  Gary J. Sullivan,et al.  High Efficiency Video Coding (HEVC), Algorithms and Architectures , 2014, Integrated Circuits and Systems.

[24]  Zhi Liu,et al.  Adaptive Inter-Mode Decision for HEVC Jointly Utilizing Inter-Level and Spatiotemporal Correlations , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[25]  André Kaup,et al.  An error-based recursive filling ordering for image error concealment , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[26]  Michael R. Frater,et al.  A cell-loss concealment technique for MPEG-2 coded video , 2000, IEEE Trans. Circuits Syst. Video Technol..

[28]  Jianjun Lei,et al.  Adaptive Fractional-Pixel Motion Estimation Skipped Algorithm for Efficient HEVC Motion Estimation , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[29]  Qiang Peng,et al.  Block-based temporal error concealment for video packet using motion vector extrapolation , 2002, IEEE 2002 International Conference on Communications, Circuits and Systems and West Sino Expositions.

[30]  Adam Finkelstein,et al.  The Generalized PatchMatch Correspondence Algorithm , 2010, ECCV.

[31]  Bertrand Granado,et al.  Sparse Recovery-Based Error Concealment , 2017, IEEE Transactions on Multimedia.

[32]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[33]  Wen-Chih Chen,et al.  Recovery of Lost Motion Vectors Using Encoded Residual Signals , 2013, IEEE Transactions on Broadcasting.