Measuring perceived quality of speech and video in multimedia conferencing applications

There is currently much discussion of Quality of Service (QoS) measurements at the network level of real-time multimedia services, but it is the subjective qualify perceived by the user that will determine whether these applications are adopted This paper argues that ITU-recommended methods for subjective quality assessment of speech and video are not suitable for assessing the quality of many newer services and applications. We present an outline of what we believe to be a more suitable testing methodology, which acknowledges the multi-dimensional nature of perceived audio and video quality.

[1]  Kees Teunissen.  The Validity of CCIR Quality Indicators Along a Graphical Scale , 1996 .

[2]  A Watson,et al.  Multimedia Conferencing via Multicast: Determining the Quality of Service Required by the End User , 1997 .

[3]  de H Huib Ridder,et al.  Continuous assessment of image quality , 1997 .

[4]  Bronwen L. Jones,et al.  Graphic scaling of qualitative terms , 1986 .

[5]  Sugato Chakravarty,et al.  Methodology for the subjective assessment of the quality of television pictures , 1995 .

[6]  N.S. Jayant.  High-quality coding of telephone speech and wideband audio , 1990, IEEE Communications Magazine.

[7]  Mohammed Ghanbari,et al.  Forgiveness effect in subjective assessment of packet video , 1992 .

[8]  Mohammed Ghanbari,et al.  Measurement of scene-dependent quality variations in digitally coded television pictures , 1995 .

[9]  D. Estrin,et al.  RSVP: a new resource reservation protocol , 1993, IEEE Communications Magazine.

[10]  D J Van Tasell,et al.  Quantifying the relation between speech quality and speech intelligibility. , 1995, Journal of speech and hearing research.

[11]  Steven McCanne,et al.  Simulation of FEC-based error control for packet audio on the Internet , 1998, Proceedings. IEEE INFOCOM '98, the Conference on Computer Communications. Seventeenth Annual Joint Conference of the IEEE Computer and Communications Societies. Gateway to the 21st Century (Cat. No.98.

[12]  Itu-T.  Interactive test methods for audiovisual communications , 1996 .

[13]  Nagato Narita.  Graphic Scaling and Validity of Japanese Descriptive Terms Used in Subjective-Evaluation Tests , 1993 .

[14]  Ian Wakeman,et al.  Quality of Service Parameters for Commercial Application of Video Telephony , 1993 .

[15]  M. Angela Sasse,et al.  Evaluating Audio and Video Quality in Low-Cost Multimedia Conferencing Systems , 1996, Interact. Comput..

[16]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.