Modeling subjectively perceived annoyance of H.264/AVC video as a function of perceived artifact strength

This paper is concerned with the subjective perception of video coding artifacts in H.264/AVC encoded and decoded video. Our objective is to model the perceived annoyance of such low bit rate video sequences as a function of perceived artifact strength. We introduce a new method for determining this function and apply it to the data from two psychophysical experiments. Both experiments produced numerical judgments of the subjectively perceived annoyance of artifact combinations and the perceived strength of the respective coding artifacts. Our method produces a discrete multi-dimensional representation of the relationships in the data from which the function relating annoyance to artifact strength is derived. The method is applied to the data of the first experiment and the resulting function is shown to describe the data from the second experiment as well.

[1]  Sanjit K. Mitra,et al.  Detectability and Annoyance of Synthetic Blocky, Blurry, Noisy, and Ringing Artifacts , 2007, IEEE Transactions on Signal Processing.

[2]  Detlev Marpe,et al.  H.264/MPEG4-AVC fidelity range extensions: tools, profiles, performance, and application areas , 2005, IEEE International Conference on Image Processing 2005.

[3]  Bruno O. Shubert,et al.  Random variables and stochastic processes , 1979 .

[4]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[5]  R. A. Fox,et al.  Introduction to Mathematical Statistics , 1947 .

[6]  Athanasios Papoulis,et al.  Probability, Random Variables and Stochastic Processes , 1965 .

[7]  Huib de Ridder.  Minkowski-metrics as a combination rule for digital-image-coding impairments , 1992 .

[8]  Sanghoon Sull,et al.  Intra prediction mode selection for flicker reduction in H.264/AVC , 2006, IEEE Transactions on Consumer Electronics.

[9]  Bernhard Ganter,et al.  Formal Concept Analysis: Mathematical Foundations , 1998 .

[10]  Rudolf Wille,et al.  Restructuring Lattice Theory: An Approach Based on Hierarchies of Concepts , 2009, ICFCA.

[11]  Sanjit K. Mitra,et al.  Annoyance of individual artifacts in MPEG-2 compressed video and their relation to overall annoyance , 2005, IS&T/SPIE Electronic Imaging.

[12]  Michael Yuen,et al.  A survey of hybrid MC/DPCM/DCT video coding distortions , 1998, Signal Process..

[13]  Gerd Stumme,et al.  Numerical Aspects in the Data Model of Conceptual Information Systems , 1998, ER Workshops.

[14]  Sanjit K. Mitra,et al.  Defect visibility and content importance: effects on perceived impairment , 2004, Signal Process. Image Commun..

[15]  Sanjit K. Mitra,et al.  H.264 coding artifacts and their relation to perceived annoyance , 2006, 2006 14th European Signal Processing Conference.

[16]  Jani Lainema,et al.  Adaptive deblocking filter , 2003, IEEE Trans. Circuits Syst. Video Technol..

[17]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..