论文信息 - Potential Biases in MUSHRA Listening Tests

Potential Biases in MUSHRA Listening Tests

The method described in the ITU-R BS.1534-1 standard, commonly known as MUSHRA (MUltiple Stimulus with Hidden Reference and Anchors), is widely used for the evaluation of systems exhibiting intermediate quality levels, in particular low-bit rate codecs. This paper demonstrates that this method, despite its popularity, is not immune to biases. In two different experiments designed to investigate potential biases in the MUSHRA test, systematic discrepancies in the results were observed with a magnitude up to 22%. The data indicates that these discrepancies could be attributed to the stimulus spacing and range equalizing biases.

Francis Rumsey | Slawomir Zielinski | Christopher Hummersone | Philip Hardisty

[1] Martin Link. Internet Audio Quality and the Mushra Test , 2002 .

[2] Francis Rumsey,et al. Comparison of quality degradation effects caused by limitation of bandwidth and by down-mix algorithms in consumer multichannel audio delivery systems , 2003 .

[3] Ralph Sperschneider. Error Resilient Source Coding with Variable Length Codes and Its Application to MPEG Advanced Audio Coding , 2000 .

[4] M H Birnbaum,et al. Loci of contextual effects in judgment. , 1982, Journal of experimental psychology. Human perception and performance.

[5] S. Link,et al. Bias in Quantifying Judgments , 1989 .

[6] Methods for the subjective assessment of small impairments in audio systems , 2015 .

[7] RECOMMENDATION ITU-R BS.1534-1 - Method for the subjective assessment of intermediate quality level of coding systems , 2003 .

[8] Sugato Chakravarty,et al. Method for the subjective assessment of intermedi-ate quality levels of coding systems , 2001 .

[9] Ralph Sperschneider,et al. Error Resilient Source Coding with Differential Variable Length Codes and its Application to MPEG Advanced Audio Coding , 2002 .

[10] Francis Rumsey,et al. Development and Initial Validation of a Multichannel Audio Quality Expert System , 2005 .