Low complexity H.264 list decoder for enhanced quality real-time video over IP

This paper presents a novel list decoding approach exploiting the receiver side user datagram protocol (UDP) checksum. The proposed method identifies the possible locations of errors in the packet by analyzing the calculated UDP checksum value at the receiver side. This makes it possible to considerably reduce the number of candidate bitstreams in comparison to conventional list decoding approaches. When a packet composed of N bits contains a single bit in error, instead of considering N candidate bitstreams, as is the case in conventional list decoding approaches, the proposed approach considers N/32 candidate bitstreams, leading to a 97% reduction in the number of candidates. Our simulation results on H.264 compressed sequences reveal that, on average, the error is corrected perfectly 80% of the time, and thus, the original bitstream is fully recovered when the first valid candidate is considered as the best candidate. In addition, the proposed approach provides, on average, a 2.78 dB gain over the error concealment approach used by the H.264 reference software, as well as 1.31 dB and 1.51 dB gains over the state-of-the-art error concealment and HO-MLD approaches, respectively.

[1]  Jon Postel,et al.  User Datagram Protocol , 1980, RFC.

[2]  Guangtao Zhai,et al.  Spatial Error Concealment With an Adaptive Linear Predictor , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Oscar C. Au,et al.  Video Error Concealment Using Spatio-Temporal Boundary Matching and Partial Differential Equation , 2008, IEEE Transactions on Multimedia.

[4]  Bo Yan,et al.  Efficient Motion Vector Interpolation for Error Concealment of H.264/AVC , 2011, IEEE Transactions on Broadcasting.

[5]  Bede Liu,et al.  Recovery of lost or erroneously received motion vectors , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[6]  Gary J. Sullivan,et al.  Video Compression - From Concepts to the H.264/AVC Standard , 2005, Proceedings of the IEEE.

[7]  Tho Le-Ngoc,et al.  Iterative Joint Source-Channel Decoding of H.264 Compressed Video , 2007, 2007 IEEE International Symposium on Circuits and Systems.

[8]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[9]  Cyril Bergeron,et al.  Soft-input decoding of variable-length codes applied to the H.264 standard , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[10]  Stéphane Coulombe,et al.  Video Error Correction Using Soft-Output and Hard-Output Maximum Likelihood Decoding Applied to an H.264 Baseline Profile , 2015, IEEE Transactions on Circuits and Systems for Video Technology.

[11]  Steven Pigeon,et al.  Pixel domain referenceless visual degradation detection and error concealment for mobile video , 2011, 2011 18th IEEE International Conference on Image Processing.

[12]  Stéphane Coulombe,et al.  A maximum likelihood approach to correcting transmission errors for joint source-channel decoding of H.264 coded video , 2013, 2013 IEEE International Conference on Image Processing.

[13]  Pierre Duhamel,et al.  Robust Decoding of H.264 Encoded Video Transmitted over Wireless Channels , 2006, 2006 IEEE Workshop on Multimedia Signal Processing.

[14]  Yue Wang,et al.  Joint source-channel decoding for H.264 coded video stream , 2005, IEEE Transactions on Consumer Electronics.

[15]  Søren Holdt Jensen,et al.  Sequential Error Concealment for Video/Images by Sparse Linear Prediction , 2013, IEEE Transactions on Multimedia.

[16]  Tho Le-Ngoc,et al.  Iterative Joint Source-Channel Decoding for H.264 video transmission using virtual checking method at source decoder , 2010, CCECE 2010.

[17]  Reuben A. Farrugia,et al.  Robust decoder-based error control strategy for recovery of H.264/AVC video content , 2011, IET Commun..

[18]  Aggelos K. Katsaggelos,et al.  Error resilient video coding techniques , 2000, IEEE Signal Process. Mag..

[19]  Yao Wang,et al.  Video Processing and Communications , 2001 .

[20]  Huifang Sun,et al.  Concealment of damaged block transform coded images using projections onto convex sets , 1995, IEEE Trans. Image Process..

[21]  Stéphane Coulombe,et al.  A Maximum Likelihood Approach to Video Error Correction Applied to H.264 Decoding , 2012, 2012 Sixth International Conference on Next Generation Mobile Applications, Services and Technologies.

[22]  Ladislav Polak,et al.  DVB-H and DVB-SH-A performance and evaluation of transmission in fading channels , 2011, 2011 34th International Conference on Telecommunications and Signal Processing (TSP).

[23]  Richard A. Dean,et al.  Elements of Abstract Algebra , 1968 .

[24]  Olivia Nemethova,et al.  Combined sequential decoding and error concealment of H.264 video , 2004, IEEE 6th Workshop on Multimedia Signal Processing, 2004..

[25]  Patrick Corlay,et al.  Checksum-Filtered List Decoding Applied to H.264 and H.265 Video Error Correction , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Hong Zhang,et al.  High efficiency video coding (HEVC) based screen content coding , 2013 .