Face Masks Impact Auditory and Audiovisual Consonant Recognition in Children With and Without Hearing Loss

Teachers and students are wearing face masks in many classrooms to limit the spread of the coronavirus. Face masks disrupt speech understanding by concealing lip-reading cues and reducing transmission of high-frequency acoustic speech content. Transparent masks provide greater access to visual speech cues than opaque masks but tend to cause greater acoustic attenuation. This study examined the effects of four types of face masks on auditory-only and audiovisual speech recognition in 18 children with bilateral hearing loss, 16 children with normal hearing, and 38 adults with normal hearing tested in their homes, as well as 15 adults with normal hearing tested in the laboratory. Stimuli simulated the acoustic attenuation and visual obstruction caused by four different face masks: hospital, fabric, and two transparent masks. Participants tested in their homes completed auditory-only and audiovisual consonant recognition tests with speech-spectrum noise at 0 dB SNR. Adults tested in the lab completed the same tests at 0 and/or −10 dB SNR. A subset of participants from each group completed a visual-only consonant recognition test with no mask. Consonant recognition accuracy and transmission of three phonetic features (place of articulation, manner of articulation, and voicing) were analyzed using linear mixed-effects models. Children with hearing loss identified consonants less accurately than children with normal hearing and adults with normal hearing tested at 0 dB SNR. However, all the groups were similarly impacted by face masks. Under auditory-only conditions, results were consistent with the pattern of high-frequency acoustic attenuation; hospital masks had the least impact on performance. Under audiovisual conditions, transparent masks had less impact on performance than opaque masks. High-frequency attenuation and visual obstruction had the greatest impact on place perception. The latter finding was consistent with the visual-only feature transmission data. These results suggest that the combination of noise and face masks negatively impacts speech understanding in children. The best mask for promoting speech understanding in noisy environments depend on whether visual cues will be accessible: hospital masks are best under auditory-only conditions, but well-fit transparent masks are best when listeners have a clear, consistent view of the talker’s face.

[1]  George P. Kafentzis,et al.  Effect of face mask and noise on word recognition by children and adults , 2021, Proceedings of International Conference of Experimental Linguistics.

[2]  P. Bottalico,et al.  The effects of face masks on speech-in-speech recognition for children and adults. , 2021, International journal of audiology.

[3]  Kristin J. Van Engen,et al.  Face mask type affects audiovisual speech intelligibility and subjective listening effort in young and older adults , 2021, Cognitive Research: Principles and Implications.

[4]  H. Yi,et al.  Effects of Wearing Face Masks While Using Different Speaking Styles in Noise on Speech Intelligibility During the COVID-19 Pandemic , 2021, Frontiers in Psychology.

[5]  Rajka Smiljanic,et al.  Face masks and speaking style affect audio-visual word recognition and memory of native and non-native speecha) , 2021, The Journal of the Acoustical Society of America.

[6]  Malte Reichelt,et al.  The impact of face masks on interpersonal trust in times of COVID-19 , 2021, Scientific Reports.

[7]  Joseph C. Toscano,et al.  Effects of face masks on speech recognition in multi-talker babble noise , 2021, PloS one.

[8]  E. Buss,et al.  Influence of Protective Face Coverings on the Speech Recognition of Cochlear Implant Patients , 2021, The Laryngoscope.

[9]  Michelle Cohn,et al.  Intelligibility of face-masked speech depends on speaking style: Comparing casual, clear, and emotional speech , 2021, Cognition.

[10]  Amanda Saksida,et al.  Short report on the effects of SARS-CoV-2 face protective equipment on verbal communication , 2021, European Archives of Oto-Rhino-Laryngology.

[11]  L. Werner,et al.  Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit , 2021, Brain sciences.

[12]  A. Weber,et al.  The impact of face masks on the recall of spoken sentencesa) , 2021, The Journal of the Acoustical Society of America.

[13]  Christoph Pörschmann,et al.  Impact of face masks on voice radiationa) , 2020, The Journal of the Acoustical Society of America.

[14]  G. Saunders,et al.  Impacts of face coverings on communication: an indirect impact of COVID-19 , 2020, International journal of audiology.

[15]  Pasquale Bottalico,et al.  Effect of masks on speech intelligibility in auralized classroomsa) , 2020, The Journal of the Acoustical Society of America.

[16]  Jeong-Ho Jeong,et al.  Changes on Speech Transmission Characteristics by Types of Mask , 2020 .

[17]  Adam P. Vogel,et al.  Effects of face masks on acoustic analysis and speech perception: Implications for peri-pandemic protocolsa) , 2020, bioRxiv.

[18]  A. Singer,et al.  Acoustic effects of medical, cloth, and transparent face masks on speech signals , 2020, The Journal of the Acoustical Society of America.

[19]  Jack A. Holman,et al.  Covid-19 Lockdown Affects Hearing Disability and Handicap in Diverse Ways: A Rapid Online Survey Study , 2020, Ear and hearing.

[20]  R. McCreery,et al.  Audiovisual Enhancement of Speech Perception in Noise by School-Age Children Who Are Hard of Hearing , 2020, Ear and hearing.

[21]  Lori J. Leibold,et al.  Masking Release for Speech-in-Speech Recognition Due to a Target/Masker Sex Mismatch in Children With Hearing Loss , 2019, Ear and hearing.

[22]  Daniel L. Valente,et al.  Looking Behavior and Audiovisual Speech Understanding in Children With Normal Hearing and Children With Mild Bilateral or Unilateral Hearing Loss , 2017, Ear and hearing.

[23]  Lisa Lucks Mendel,et al.  The Effect of Conventional and Transparent Surgical Masks on Speech Understanding in Individuals with and without Hearing Loss , 2017, Journal of the American Academy of Audiology.

[24]  Ronald E Shaffer,et al.  Speech intelligibility assessment of protective facemasks and air-purifying respirators , 2016, Journal of occupational and environmental hygiene.

[25]  Daniel L. Valente,et al.  Effect of Minimal/Mild Hearing Loss on Children’s Speech Understanding in a Simulated Classroom , 2015, Ear and hearing.

[26]  R. Holt,et al.  Audiovisual speech perception development at varying levels of perceptual processing. , 2014, The Journal of the Acoustical Society of America.

[27]  J. Myerson,et al.  Lipreading in school-age children: the roles of age, hearing status, and cognitive ability. , 2014, Journal of speech, language, and hearing research : JSLHR.

[28]  Lori J. Leibold,et al.  Influence of Hearing Loss on Children’s Identification of Spondee Words in a Speech-Shaped Noise or a Two-Talker Masker , 2013, Ear and hearing.

[29]  Emily Buss,et al.  Children's identification of consonants in a speech-shaped noise or a two-talker masker. , 2013, Journal of speech, language, and hearing research : JSLHR.

[30]  L. Feth,et al.  The effects of surgical masks on speech perception in noise , 2013 .

[31]  M. Coleman,et al.  Speechreading development in deaf and hearing children: introducing the test of child speechreading. , 2013, Journal of speech, language, and hearing research : JSLHR.

[32]  Daniel L. Valente,et al.  Experimental investigation of the effects of the acoustical conditions in a simulated classroom on speech recognition and learning in children. , 2012, The Journal of the Acoustical Society of America.

[33]  P. Stelmachowicz,et al.  Audibility-based predictions of speech recognition for children and adults with normal hearing. , 2011, The Journal of the Acoustical Society of America.

[34]  Sharon M. Thomas,et al.  When half a face is as good as a whole: Effects of simple substantial occlusion on visual and audiovisual speech perception , 2011, Attention, perception & psychophysics.

[35]  John J. Foxe,et al.  The development of multisensory speech perception continues into the late childhood years , 2011, The European journal of neuroscience.

[36]  Joseph W. Hall,et al.  Spectral Integration and Bandwidth Effects on Speech Recognition in School-Aged Children and Adults , 2010, Ear and hearing.

[37]  Lisa Lucks Mendel,et al.  Speech understanding using surgical masks: a problem in health care? , 2008, Journal of the American Academy of Audiology.

[38]  T. Ricketts,et al.  Head angle and elevation in classroom environments: implications for amplification. , 2008, Journal of speech, language, and hearing research : JSLHR.

[39]  Jeesun Kim,et al.  Audio-visual speech perception off the top of the head , 2006, Cognition.

[40]  M. Harris,et al.  Concurrent correlates and predictors of reading and spelling achievement in deaf and hearing school children. , 2006, Journal of deaf studies and deaf education.

[41]  Douglas Brungart,et al.  Informational masking of speech in children: auditory-visual integration. , 2006, The Journal of the Acoustical Society of America.

[42]  Sharon M. Thomas,et al.  Contributions of oral and extraoral facial movement to visual and audiovisual speech perception. , 2004, Journal of experimental psychology. Human perception and performance.

[43]  Jeffery A. Jones,et al.  Visual Prosody and Speech Intelligibility , 2004, Psychological science.

[44]  P. Stelmachowicz,et al.  Effect of stimulus bandwidth on the perception of /s/ in normal- and hearing-impaired children and adults. , 2001, The Journal of the Acoustical Society of America.

[45]  B. Lyxell,et al.  Visual speechreading and cognitive performance in hearing-impaired and normal hearing children (11-14 years). , 2000, The British journal of educational psychology.

[46]  P G Stelmachowicz,et al.  The relation between stimulus context, speech audibility, and perception for normal-hearing and hearing-impaired children. , 2000, Journal of speech, language, and hearing research : JSLHR.

[47]  H Levitt,et al.  Selective visual masking in speechreading. , 1998, Journal of speech, language, and hearing research : JSLHR.

[48]  C. Lansing,et al.  Visual word recognition in two facial motion conditions: full-face versus lips-plus-mandible. , 1995, Journal of speech and hearing research.

[49]  F J IJsseldijk,et al.  Speechreading performance under different conditions of video image, repetition, and speech rate. , 1992, Journal of Speech and Hearing Research.

[50]  E. Owens,et al.  Visemes observed by hearing-impaired and normal-hearing adult viewers. , 1985, Journal of speech and hearing research.

[51]  Judy S. Scheinberg,et al.  Analysis of speechreading cues using an interleaved technique , 1980 .

[52]  Q Summerfield,et al.  Use of Visual Information for Phonetic Perception , 1979, Phonetica.

[53]  R Conrad,et al.  Lip-reading by deaf and hearing children. , 1977, The British journal of educational psychology.

[54]  A A Montgomery,et al.  Auditory and visual contributions to the perception of consonants. , 1974, Journal of speech and hearing research.

[55]  H. J. Greenberg,et al.  Visual discrimination of consonants. , 1968, Journal of speech and hearing research.

[56]  Lina Motlagh Zadeh,et al.  Impact of Face Masks on Audiovisual Word Recognition in Young Children with Hearing Loss During the Covid-19 Pandemic , 2021 .

[57]  Paul E. Carrillo,et al.  The Effects of Different , 2016 .

[58]  Simon Lucey,et al.  Deformable Model Fitting by Regularized Landmark Mean-Shift , 2010, International Journal of Computer Vision.

[59]  Philip Harrison,et al.  EFFECTS OF DIFFERENT TYPES OF FACE COVERINGS ON SPEECH ACOUSTICS AND INTELLIGIBILITY , 2008 .

[60]  Coarticulation • Suprasegmentals,et al.  Acoustic Phonetics , 2019, The SAGE Encyclopedia of Human Communication Sciences and Disorders.

[61]  Eric Vatikiotis-Bateson,et al.  The moving face during speech communication , 1998 .

[62]  Christian Benoît,et al.  Which components of the face do humans and machines best speechread , 1996 .