Construction and evaluation of the Mandarin Chinese matrix (CMNmatrix) sentence test for the assessment of speech recognition in noise

Abstract Objective: Development of the Mandarin Chinese matrix (CMNmatrix) sentence test for speech intelligibility measurements in noise according to the international standard procedure. Design: A 50-word base matrix representing the distribution of phonemes and lexical tones of spoken Mandarin was established. Hundred sentences capturing all the co-articulations of two consecutive words were recorded. Word-specific speech recognition functions, speech reception thresholds (SRT: signal-to-noise ratio (SNR), that provides 50% speech intelligibility) and slopes were obtained from measurements at fixed SNRs. The speech material was homogenised in intelligibility by applying level corrections up to ± 2 dB. Subsequently, the CMNmatrix test was evaluated, the comparability of test lists was measured at two fixed SNRs. To investigate the training effect and establish the reference data, speech recognition was measured adaptively. Study sample: Overall, the study sample contained 80 normal-hearing native Mandarin-speaking listeners. Results: Multi-centre evaluation measurements confirmed that test lists are equivalent in intelligibility, with a mean SRT of −10.1 ± 0.1 dB SNR and a slope of 13.1 ± 0.9 %/dB. The reference SRT is −9.3 ± 0.8 and −11.2 ± 1.2 dB SNR for the open- and closed-set response format, respectively. Conclusion: The CMNmatrix test is suitable for accurate and internationally comparable speech recognition measurements in noise.

[1]  Alfred Mertins,et al.  Oldenburg logatome speech corpus (OLLO) for speech recognition experiments with humans and machines , 2005, INTERSPEECH.

[2]  B Kollmeier,et al.  Development and evaluation of a German sentence test for objective and subjective speech intelligibility assessment. , 1997, The Journal of the Acoustical Society of America.

[3]  Jan Wouters,et al.  FIST: A French sentence test for speech intelligibility in noise , 2008, International journal of audiology.

[4]  Sha Liu,et al.  Development of the Mandarin Hearing in Noise Test (MHINT) , 2007, Ear and hearing.

[5]  Anna Warzybok,et al.  The multilingual matrix test: Principles, applications, and comparison across languages: A review , 2015, International journal of audiology.

[6]  P. Van cauwenberge,et al.  Sensitivity of transient evoked and distortion product otoacoustic emissions to the direct effects of noise on the human cochlea. , 1999, Audiology : official organ of the International Society of Audiology.

[7]  B. Kollmeier,et al.  International Collegium of Rehabilitative Audiology (ICRA) recommendations for the construction of multilingual speech tests , 2015, International journal of audiology.

[8]  J Doyle,et al.  Mismatch between aspects of hearing impairment and hearing disability/handicap in adult/elderly Cantonese speakers: some hypotheses concerning cultural and linguistic influences. , 1996, Journal of the American Academy of Audiology.

[9]  A. M. Mimpen,et al.  Improving the reliability of testing the speech reception threshold for sentences. , 1979, Audiology : official organ of the International Society of Audiology.

[10]  Jing Xia,et al.  Development and evaluation of a mixed gender, multi-talker matrix sentence test in Australian English , 2017, International journal of audiology.

[11]  Qian-Jie Fu,et al.  Development and validation of the Mandarin speech perception test. , 2011, The Journal of the Acoustical Society of America.

[12]  T Houtgast,et al.  Method for the selection of sentence materials for efficient measurement of the speech reception threshold. , 1999, The Journal of the Acoustical Society of America.

[13]  Birger Kollmeier,et al.  Efficient adaptive procedures for threshold and concurrent slope estimates for psychophysics and speech intelligibility tests. , 2002, The Journal of the Acoustical Society of America.

[14]  Y. Hu,et al.  Effects of lexical tone contour on Mandarin sentence intelligibility. , 2014, Journal of speech, language, and hearing research : JSLHR.

[15]  Paul Boersma,et al.  Praat: doing phonetics by computer , 2003 .

[16]  A. Boothroyd,et al.  Mathematical treatment of context effects in phoneme and word recognition. , 1988, The Journal of the Acoustical Society of America.

[17]  Astrid van Wieringen,et al.  LIST and LINT: Sentences and numbers for quantifying speech understanding in severely impaired listeners for Flanders and the Netherlands , 2008, International journal of audiology.

[18]  Sigfrid D Soli,et al.  Development of the Cantonese Hearing In Noise Test (CHINT) , 2005, Ear and hearing.

[19]  Birger Kollmeier,et al.  Development and evaluation of the Turkish matrix sentence test , 2015, International journal of audiology.

[20]  Birger Kollmeier,et al.  A Spanish matrix sentence test for assessing speech reception thresholds in noise , 2012, International journal of audiology.

[21]  Astrid van Wieringen,et al.  Development of a Dutch matrix sentence test to assess speech intelligibility in noise , 2014, International journal of audiology.

[22]  Anna Warzybok,et al.  Speech-in-noise tests for multilingual hearing screening and diagnostics1. , 2013, American journal of audiology.

[23]  W. T. Nelson,et al.  A speech corpus for multitalker communications research. , 2000, The Journal of the Acoustical Society of America.

[24]  Torsten Dau,et al.  The Danish hearing in noise test , 2011, International journal of audiology.

[25]  K. Wagener,et al.  Design, optimization and evaluation of a Danish sentence test in noise: Diseño, optimización y evaluación de la prueba Danesa de frases en ruido , 2003, International journal of audiology.

[26]  B Hagerman,et al.  Sentences for testing speech intelligibility in noise. , 1982, Scandinavian audiology.

[27]  Aleksander Sek,et al.  Polish sentence tests for measuring the intelligibility of speech in interfering noise , 2009, International journal of audiology.

[28]  Anna Warzybok,et al.  Polish sentence matrix test for speech intelligibility measurement in noise , 2010, International journal of audiology.

[29]  R Carhart,et al.  An expanded test for speech discrimination utilizing CNC monosyllabic words. Northwestern University Auditory Test No. 6. SAM-TR-66-55. , 1966, [Technical report] SAM-TR. USAF School of Aerospace Medicine.

[30]  Torsten Dau,et al.  A Danish open-set speech corpus for competing-speech studies. , 2014, The Journal of the Acoustical Society of America.

[31]  Astrid van Wieringen,et al.  Comparison of three types of French speech-in-noise tests: A multi-center study , 2012, International journal of audiology.

[32]  Tim Jürgens,et al.  Talker- and language-specific effects on speech intelligibility in noise assessed with bilingual talkers: Which language is more robust against noise and reverberation? , 2015, International journal of audiology.

[33]  X. Xi,et al.  Development of a mandarin monosyllable test material with homogenous items (II): Lists equivalence evaluation , 2011, Acta oto-laryngologica.

[34]  S. Soli,et al.  Development of the Hearing in Noise Test for the measurement of speech reception thresholds in quiet and in noise. , 1994, The Journal of the Acoustical Society of America.

[35]  Anna Warzybok,et al.  Development of the Russian matrix sentence test , 2015, International journal of audiology.

[36]  Janet Doyle,et al.  Hearing levels and hearing handicap in Cantonese-speaking Australians , 2002 .

[37]  Kirsten Carola Wagener,et al.  Factors influencing sentence intelligibility in noise , 2004 .

[38]  G. A. Miller,et al.  The intelligibility of speech as a function of the context of the test materials. , 1951, Journal of experimental psychology.

[39]  Anna Warzybok,et al.  An Italian matrix sentence test for the evaluation of speech intelligibility in noise , 2015, International journal of audiology.

[40]  Harvey Dillon,et al.  Development of a corpus of Mandarin sentences in babble with homogeneity optimized via psychometric evaluation , 2012, International journal of audiology.

[41]  Birger Kollmeier,et al.  The development and evaluation of the Finnish Matrix Sentence Test for speech intelligibility assessment , 2014, Acta oto-laryngologica.

[42]  J. S. Anderson Development of the hearing , 1910 .

[43]  Sigfrid D Soli,et al.  Assessment of speech intelligibility in noise with the Hearing in Noise Test , 2008, International journal of audiology.

[44]  Shuenn-Tsong Young,et al.  Development of a Mandarin Monosyllable Recognition Test , 2009, Ear and hearing.

[45]  Shuo Wang,et al.  [Digital recording and equivalent evaluation of Mandarin speech test materials]. , 2006, Lin chuang er bi yan hou ke za zhi = Journal of clinical otorhinolaryngology.

[46]  I. Hirsh,et al.  Development of materials for speech audiometry. , 1952, The Journal of speech and hearing disorders.

[47]  G. Rei,et al.  Diagnostic significance of the staggered spondaic word test and 40-Hz auditory event-related potentials. , 1988, Audiology : official organ of the International Society of Audiology.

[48]  J. Ying,et al.  Development of a Mandarin monosyllable test material with homogenous items (I): Homogeneity selection , 2011, Acta oto-laryngologica.

[49]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[50]  Shawn L. Nissen,et al.  Psychometrically equivalent trisyllabic words for speech reception threshold testing in Mandarin , 2005, International journal of audiology.

[51]  Tammo Houtgast,et al.  Development and validation of an automatic speech-in-noise screening test by telephone , 2004, International journal of audiology.

[52]  P. Newall,et al.  Development and evaluation of Mandarin disyllabic materials for speech audiometry in China , 2007, International journal of audiology.

[53]  Birger Kollmeier,et al.  Internationally comparable screening tests for listening in noise in several European languages: The German digit triplet test as an optimization prototype , 2012, International journal of audiology.

[54]  Shawn L. Nissen,et al.  Psychometrically equivalent mandarin bisyllabic speech discrimination materials spoken by male and female talkers , 2005, International journal of audiology.

[55]  Qian-Jie Fu,et al.  The development and validation of the Closed-set Mandarin Sentence (CMS) test , 2017, Speech Commun..

[56]  B. McPherson,et al.  Chinese speech audiometry material: Past, present, future , 2013 .