Quality assessment of speech codecs in synchronous e-learning environments

Synchronous e-learning tools always include an audio-conference feature so participants in e-learning sessions can communicate orally. Audio quality is critical to avoid misunderstandings and improve user experience. Therefore, it is important to evaluate the audio quality that speech codecs can provide. Few existing assessment works consider the resources consumed (CPU or bitrate) to provide the audio quality, although synchronous e-learning sessions usually involve various participants, making resource consumption an important issue. In this paper, both objective and subjective audio quality measurement methods are used to characterize and estimate the audio quality of twenty speech codecs as a function of the resources consumed during synchronous e-learning sessions. Although users' opinions on audio quality are often more pessimistic than the evaluation provided by objective measurements, the correlation between objective and subjective measurements is high for medium-quality codecs. Users perceive lower audio quality for low-quality codecs than indicated by objective measurements, while they are not able to identify high-quality codecs, scoring them similarly to medium-quality codecs.

[1]  A. Bhuvaneshwari,et al.  Performance analysis of audio codecs over real-time transmission protocol (RTP) for voice services over Internet protocol , 2004, Proceedings. Second Annual Conference on Communication Networks and Services Research, 2004..

[2]  C. Okino,et al.  Space-Based Voice over IP Networks , 2007, 2007 IEEE Aerospace Conference.

[3]  Timothy A. Hall Objective speech quality measures for Internet telephony , 2001, SPIE ITCom.

[4]  Mihai Ivanovici,et al.  User-Perceived Quality Assessment for VoIP Applications , 2004 .

[5]  Francisco J. Suárez,et al.  A multimedia tool for synchronous distance e-training of employees in geographically dispersed industries , 2008, EuroIMSA 2008.

[6]  Francisco J. Suárez,et al.  A Functional Evaluation of the Commercial Platforms and Tools for Synchronous Distance e-Learning , 2007 .

[7]  Nasir D. Memon,et al.  Steganalysis of audio based on audio quality metrics , 2003, IS&T/SPIE Electronic Imaging.

[8]  Oscar C. Au,et al.  Objective speech quality measure for cellular phone , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[9]  Anssi Rämö,et al.  On comparing speech quality of various narrow- and wideband speech codecs , 2005, Proceedings of the Eighth International Symposium on Signal Processing and Its Applications, 2005..