Performance Study of Objective Speech Quality Measurement for Modern Wireless-VoIP Communications

Wireless-VoIP communications introduce perceptual degradations that are not present with traditional VoIP communications. This paper investigates the effects of such degradations on the performance of three state-of-the-art standard objective quality measurement algorithms—PESQ, P.563, and an "extended" E-model. The comparative study suggests that measurement performance is significantly affected by acoustic background noise type and level as well as speech codec and packet loss concealment strategy. On our data, PESQ attains superior overall performance and P.563 and E-model attain comparable performance figures.

[1]  ITU-T Rec. P.862.3 (11/2007) Application guide for objective quality measurement based on Recommendations P.862, P.862.1 and P.862.2 , 2008 .

[2]  Tiago H. Falk,et al.  Hybrid Signal-and-Link-Parametric Speech Quality Measurement for VoIP Communications , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[3]  Valérie Gautier-Turbin,et al.  Influence of Loudness Level on the Overall Quality of Transmitted Speech , 2007 .

[4]  Scott Pennock,et al.  Accuracy of the Perceptual Evaluation of Speech Quality (PESQ) algorithm , 2002 .

[5]  Antony William Rix,et al.  PESQ-The New ITU Standard for End-to-End Speech Quality Assessment , 2000 .

[6]  Ramón Cáceres,et al.  RTP Control Protocol Extended Reports (RTCP XR) , 2003, RFC.

[7]  J. Tukey,et al.  Variations of Box Plots , 1978 .

[8]  Schuyler Quackenbush,et al.  Objective measures of speech quality , 1995 .

[9]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .

[10]  Jerry D. Gibson,et al.  Tandem voice communications: digital cellular, VoIP, and voice over Wi-Fi , 2004, IEEE Global Telecommunications Conference, 2004. GLOBECOM '04..

[11]  N. O. Johannesson.  The ETSI computation model: a tool for transmission planning of telephone networks , 1997 .

[12]  Henning Schulzrinne,et al.  RTP: A Transport Protocol for Real-Time Applications , 1996, RFC.

[13]  Pekka Perälä.  Some Experiences with VoIP Over Converging Networks ∗ , 2007 .

[14]  J. Berger,et al.  P.563—The ITU-T Standard for Single-Ended Speech Quality Assessment , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Nobuhiko Kitawaki,et al.  Perceptual QoS assessment technologies for VoIP , 2004, IEEE Communications Magazine.

[16]  Ian Marsh,et al.  A systematic study of PESQ’s behavior(from a networking perspective) , 2006 .

[17]  Henning Schulzrinne,et al.  RTP Profile for Audio and Video Conferences with Minimal Control , 2003, RFC.

[18]  Ayman Radwan,et al.  Non-intrusive single-ended speech quality assessment in VoIP , 2007, Speech Commun..

[19]  S. R. Broom,et al.  VoIP Quality Assessment: Taking Account of the Edge-Device , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[20]  Antony William Rix,et al.  Perceptual evaluation of speech quality (PESQ): The new ITU standard for end-to-end speech quality a , 2002 .