Combining Preference Ratings with Sensory Profiling for the Comparison of Audio Reproduction Systems

One aim of perceptual audio evaluation is to understand the relationships between individual sensory attributes and overall quality of experience. This paper discusses one perceptual evaluation method by which this can be realized. Open Profiling of Quality (OPQ), a method first introduced in the field of visual and audiovisual evaluation, involves psychoperceptual evaluation, sensory profiling, and external preference mapping stages and is suitable for use with naive listeners. Here, a methodological case study is presented in which we discuss the implementation of this method and its adaptation for the comparison of audio reproduction systems.

[1]  Dominik Strohmeier.  Open profiling of quality: a mixed methods research approach for audiovisual quality evaluations , 2012, ACMMR.

[2]  Frank Melchior,et al.  A Subjective Comparison of Discrete Surround Sound and Soundbar Technology by Using Mixed Methods , 2016 .

[3]  Sylvain Choisel,et al.  Evaluation of multichannel reproduced sound: scaling auditory attributes underlying listener preference. , 2007, The Journal of the Acoustical Society of America.

[4]  Tim Brookes,et al.  Determining and labeling the preference dimensions of spatial audio replay , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[5]  Francis Rumsey,et al.  On Some Biases Encountered in Modern Audio Quality Listening Tests-A Review , 2008 .

[6]  Patricia Stefanowicz,et al.  Sensory evaluation of food principles and practices , 2013 .

[7]  John R. Piggott,et al.  Free choice profiling in consumer research , 1991 .

[8]  Francis Rumsey,et al.  Relationships between experienced listener ratings of multichannel audio quality and naïve listener preferences. , 2005, The Journal of the Acoustical Society of America.

[9]  Jan Berg,et al.  How do we determine the attribute scales and questions that we should ask of subjects when evaluating spatial audio quality , 2006 .

[10]  Dominik Strohmeier,et al.  The Extended-OPQ Method for User-Centered Quality of Experience Evaluation: A Study for Mobile 3D Video Broadcasting over DVB-H , 2011, EURASIP J. Image Video Process..

[11]  Nick Zacharov,et al.  Unraveling the perception of spatial sound reproduction: Techniques and experimental design , 2001 .

[12]  Dominik Strohmeier,et al.  Open Profiling of Quality: A Mixed Method Approach to Understanding Multimodal Quality Perception , 2010, Adv. Multim..

[13]  Dominik Strohmeier,et al.  Open Profiling of Quality: Probing the method in the context of use , 2011, 2011 Third International Workshop on Quality of Multimedia Experience.

[14]  Etienne Parizet,et al.  Paired comparison listening tests and circular error rates , 2002 .

[15]  Sylvain Choisel,et al.  Extraction of auditory features and elicitation of attributes for the assessment of multichannel reproduced sound , 2006 .

[16]  Tapio Lokki,et al.  Disentangling preference ratings of concert hall acoustics using subjective sensory profiles. , 2012, The Journal of the Acoustical Society of America.

[17]  Frank Melchior,et al.  Next generation audio system assessment using the multiple stimulus ideal profile method , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).

[18]  Ville-Veikko Mattila.  Descriptive Analysis of Speech Quality in Mobile Communications: Descriptive Language Development and External Preference Mapping , 2001 .

[19]  Ulrike Sloma.  Evaluation of Quality Features of Spatial Audio Signals in Non-Standardized Rooms: Two Mixed Method Studies , 2016 .

[20]  Søren Bech,et al.  Perceptual Audio Evaluation - Theory, Method and Application , 2006 .

[21]  Judith Liebetrau,et al.  Assessment of spherical microphone array auralizations using open-profiling of quality (OPQ) , 2016, 2016 Eighth International Conference on Quality of Multimedia Experience (QoMEX).