An efficient algorithm to eliminate temporal pumping artifact in video coding with hierarchical prediction structure

A metric for just noticeable temporal pumping artifact (TPA) is established.An efficient TPA eliminating algorithm in video coding is proposed.The proposed algorithm achieves a more smooth subjective video quality.The proposed algorithm improves the observe comfort of the human eye. At low bit-rates, hierarchical prediction structure using quantization parameter cascading strategy will introduce a new temporal distortion, i.e., the temporal pumping artifact (TPA) presenting itself as a stumbling effect which seriously affect the subjective video reconstructive quality. This paper analyzes one important key factor which greatly influence the critical perceptual of the TPA and proposes a metric for just noticeable temporal pumping artifact (JNTPA) based on spatial-temporal masking effects in human visual system (HVS). Finally, an efficient TPA eliminating algorithm in video coding based on the JNTPA has been proposed. The subsequent experiments demonstrate that the estimated JNTPA values using the proposed metric are in line with the HVS perception and comparable with JVT-P104, the proposed TPA eliminating algorithm achieves a more smooth subjective video quality and improves the observe comfort of the human eye. At the same bit-rate, better subjective video quality can be observed using the eliminating algorithm.

[1]  Stefan Winkler,et al.  Issues in vision modeling for perceptual video quality assessment , 1999, Signal Process..

[2]  Heiko Schwarz,et al.  Analysis of Hierarchical B Pictures and MCTF , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[3]  André Kaup,et al.  Adaptive quantization parameter cascading for hierarchical video coding , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[4]  Truong Q. Nguyen,et al.  Adaptive Fuzzy Filtering for Artifact Reduction in Compressed Images and Videos , 2009, IEEE Transactions on Image Processing.

[5]  Shuai Wan,et al.  Perception of Temporal Pumping Artifact in Video Coding with the Hierarchical Prediction Structure , 2012, 2012 IEEE International Conference on Multimedia and Expo.

[6]  Hong Ren Wu,et al.  Robust Filtering Technique for Reduction of Temporal Fluctuation in H.264 Video Sequences , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Giovanni Iacovoni,et al.  Quality-Temporal Transcoder Driven by the Jerkiness , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[8]  Houssam Abbas,et al.  Suppression of Mosquito Noise by Recursive Epsilon-Filters , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[9]  Weisi Lin,et al.  Perceptual visual quality metrics: A survey , 2011, J. Vis. Commun. Image Represent..

[10]  Patrick Le Callet,et al.  Considering Temporal Variations of Spatial Visual Distortions in Video Quality Assessment , 2009, IEEE Journal of Selected Topics in Signal Processing.

[11]  Heiko Schwarz,et al.  Overview of the Scalable Video Coding Extension of the H.264/AVC Standard , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[12]  Sanghoon Sull,et al.  Intra prediction mode selection for flicker reduction in H.264/AVC , 2006, IEEE Transactions on Consumer Electronics.

[13]  André Kaup,et al.  Model based analysis for quantization parameter cascading in hierarchical video coding , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[14]  Tsuhan Chen,et al.  A survey on image-based rendering - representation, sampling and compression , 2004, Signal Process. Image Commun..

[15]  Luo Zhong,et al.  A no-reference blocking artifact metric for B-DCT video * , 2006 .

[16]  Keiichi Chono,et al.  Detented Quantization to Suppress Flicker Artifacts in Periodically Inserted Intra-Coded Pictures in H.264 Video Coding , 2006, 2006 International Conference on Image Processing.

[17]  Weisi Lin,et al.  Perceptual quality and objective quality measurements of compressed videos , 2006, J. Vis. Commun. Image Represent..

[18]  Arnd Eden No-Reference Estimation of the Coding PSNR for H.264-Coded Sequences , 2007, IEEE Transactions on Consumer Electronics.

[19]  C.-C. Jay Kuo,et al.  Review of Postprocessing Techniques for Compression Artifact Removal , 1998, J. Vis. Commun. Image Represent..

[20]  S. Borer,et al.  A model of jerkiness for temporal impairments in video transmission , 2010, 2010 Second International Workshop on Quality of Multimedia Experience (QoMEX).

[21]  Claire Mantel,et al.  A temporal mosquito noise corrector , 2009, 2009 International Workshop on Quality of Multimedia Experience.

[22]  Nick G. Kingsbury,et al.  A distortion measure for blocking artifacts in images based on human visual sensitivity , 1995, IEEE Trans. Image Process..

[23]  Zhou Wang,et al.  Video quality assessment based on structural distortion measurement , 2004, Signal Process. Image Commun..