INRS Audiovisual Quality Dataset

We present the INRS audiovisual quality dataset made of 160 unique configurations for audiovisual content including various media compression and network distortion parameters such as video frame rate, quantization and noise reduction parameters, and packet loss rate. The compression and network distortion parameter range values are selected to match real-time communications use cases. The H.264 video codec in 720p resolution and the AMR-WB audio codec are used for encoding video and audio streams. Thirty observers have rated the overall audiovisual quality on the Absolute Category Rating (ACR) 5-level quality scale in a controlled environment. The dataset includes MOS values, packet loss rates measured at bit stream level for both video and audio streams, compression parameters and various packet header information. We have used open source software for producing source audiovisual sequences, end-to-end streaming and a custom video player. These tools and the dataset are free to public access for research and development purposes.

[1]  Marie-Neige Garcia Parametric Packet-Based Audiovisual Quality Model for Iptv Services , 2014 .

[2]  Dragan Kukolj,et al.  A reduced-reference parametric model for audiovisual quality of IPTV services , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[3]  Christian Keimel,et al.  The TUM high definition video datasets , 2012, 2012 Fourth International Workshop on Quality of Multimedia Experience.

[4]  Lingfen Sun,et al.  Audiovisual Quality Estimation for Video Calls in Wireless Applications , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[5]  Margaret H. Pinson,et al.  The Consumer Digital Video Library [Best of the Web] , 2013, IEEE Signal Processing Magazine.

[6]  Slawomir Zielinski On Some Biases Encountered in Modern Listening Tests , 2006 .

[7]  John D. Hunter,et al.  Matplotlib: A 2D Graphics Environment , 2007, Computing in Science & Engineering.

[8]  Marcus Barkowsky,et al.  The Influence of Subjects and Environment on Audiovisual Subjective Tests: An International Study , 2012, IEEE Journal of Selected Topics in Signal Processing.

[9]  Marcus Barkowsky,et al.  Subjective and objective evaluation of an audiovisual subjective dataset for research and development , 2013, 2013 Fifth International Workshop on Quality of Multimedia Experience (QoMEX).

[10]  Margaret H. Pinson,et al.  The Consumer Digital Video Library , 2010 .