Quality evaluation of long duration AV content—an extended analysis using a novel assessment methodology

This paper is an extension of our previous work describing a novel methodology for quality assessment of long duration audiovisual content. In this article we focus on data analysis of results obtained from two experiments conducted using the new methodology. In the first study, we found that the time dimension does not influence participants’ expectations with respect to perceived video quality and that a possible increase or decrease in acceptable quality level is rather directly related to the presented material itself. Moreover, we found that participants are less sensitive to quality changes when the process is controlled externally than when they are in charge of the quality adjustment. A second experiment (study 2) was performed to evaluate the effect of simultaneous quality changes in the two modalities (audio and video) which confirmed the previous results.

[1]  Ulrich Reiter,et al.  Quality evaluation of long duration audiovisual content , 2012, 2012 IEEE Consumer Communications and Networking Conference (CCNC).

[2]  Stefan Winkler,et al.  Video quality evaluation for mobile streaming applications , 2003, Visual Communications and Image Processing.

[3]  Florian Wickelmaier,et al.  Perceptual Audio Evaluation - Theory, Method and Application , 2006 .

[4]  Ulrich Reiter Toward a Classification of Audiovisual Media Content , 2010 .

[5]  Ulrich Reiter,et al.  Evaluation of Audio Quality Requirements over Extended Periods of Time Using Long Duration Audiovisual Content , 2012, PCM.

[6]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[7]  Ulrich Reiter,et al.  Audio Quality Requirements and Comparison of Multimodal vs. Unimodal Perception of Impairments for Long Duration Content , 2014, J. Signal Process. Syst..

[8]  ITU-T Rec. P.910 (04/2008) Subjective video quality assessment methods for multimedia applications , 2009 .

[9]  R. Zajonc Feeling and thinking : Preferences need no inferences , 1980 .

[10]  Peter E. Rossi,et al.  Overcoming Scale Usage Heterogeneity , 2001 .

[11]  Chin-Laung Lei,et al.  A crowdsourceable QoE evaluation framework for multimedia content , 2009, ACM Multimedia.

[12]  M. Angela Sasse,et al.  Measuring perceived quality of speech and video in multimedia conferencing applications , 1998, MULTIMEDIA '98.

[13]  Gustav Theodor Fechner,et al.  Elements of psychophysics , 1966 .

[14]  Xueming Qian,et al.  Inter mode decision based on Just Noticeable Difference profile , 2010, 2010 IEEE International Conference on Image Processing.

[15]  H de Ridder,et al.  Continuous assessment of perceptual image quality. , 1995, Journal of the Optical Society of America. A, Optics, image science, and vision.

[16]  George Ghinea,et al.  The impact of cognitive styles on perceptual distributed multimedia quality , 2003, Br. J. Educ. Technol..

[17]  Søren Bech,et al.  Perceptual Audio Evaluation-Theory, Method and Application: Bech/Perceptual Audio Evaluation-Theory, Method and Application , 2006 .

[18]  Margaret H. Pinson,et al.  Comparing subjective video quality testing methodologies , 2003, Visual Communications and Image Processing.

[19]  Xiaokang Yang,et al.  Rate Control for H.264 with Two-Step Quantization Parameter Determination but Single-Pass Encoding , 2006, EURASIP J. Adv. Signal Process..