Subjective Quality Estimation Using PESQ For Hands-Free Terminals

Previous reports have mentioned the possibility that subjective quality of the echo-suppressed speech signal can be estimated based on perceptual evaluation of speech quality (PESQ), but there are few experimental results. We propose third-party listening and conversational test procedures to assess whether PESQ can be used for predicting the subjective quality of an acoustic echo canceler. In the proposed third-party listening test procedure, near-end and far-end signals are presented separately in the left and right channels of stereo playback and differential category rating evaluation is applied to those stimuli for obtaining differential mean opinion scores. In the proposed conversational test procedure, impaired and non-impaired reference signals are recorded during a conversation to make PESQ processing possible. Experimental results indicate that there is a strong correlation between PESQ and subjective scores.

[1]  Hannes Müsch,et al.  Subjective Rating and PESQ Prediction of Listener Echo and Duplex Impairments , 2019, Journal of the Audio Engineering Society.

[2]  Yusuke Hioka,et al.  DNN-based source enhancement self-optimized by reinforcement learning using sound quality measurements , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Yusuke Hioka,et al.  DNN-Based Source Enhancement to Increase Objective Sound Quality Assessment Score , 2018, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[4]  Shou-De Lin,et al.  MetricGAN: Generative Adversarial Networks based Black-box Metric Scores Optimization for Speech Enhancement , 2019, ICML.

[5]  Nisachon Tangsangiumvisai,et al.  The a priori SDR Estimation Techniques with Reduced Speech Distortion for Acoustic Echo and Noise Suppression , 2009, IEICE Trans. Commun..

[6]  Antony William Rix,et al.  Perceptual evaluation of speech quality (PESQ): The new ITU standard for end-to-end speech quality a , 2002 .

[7]  Objective measuring apparatus Objective test methods for speech communication systems using complex test signals , .

[8]  Methods for objective and subjective assessment of quality Perceptual evaluation of speech quality ( PESQ ) : An objective method for end-to-end speech quality assessment of narrow-band telephone networks and speech codecs , 2002 .

[9]  Antony William Rix,et al.  PESQ-The New ITU Standard for End-to-End Speech Quality Assessment , 2000 .

[10]  Ron Appel,et al.  On the Quality of Hearing One's Own Voice , 2002 .

[11]  Hui Zhang,et al.  Training Supervised Speech Separation System to Improve STOI and PESQ Directly , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[12]  H. W. Gierlich,et al.  ECHO PERCEPTION IN WIDEBAND TELECOMMUNICATION SCENARIOS – COMPARISON TO E-MODEL’S NARROWBAND ECHO FINDINGS , 2008 .

[13]  METHODS FOR SUBJECTIVE DETERMINATION OF TRANSMISSION QUALITY Summary , 2022 .

[14]  Akinori Nishihara,et al.  Stereophonic Acoustic Echo Canceler Based on Two-Filter Scheme , 2007, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[15]  Masashi Tanaka,et al.  Subjective Assessment of the Desired Echo Return Loss for Subband Acoustic Echo Cancellers , 2000 .

[16]  Kohei Yatabe,et al.  Stable Training of Dnn for Speech Enhancement Based on Perceptually-Motivated Black-Box Cost Function , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).