Using Virtual Reality to Evaluate the Impact of Room Acoustics on Cognitive Performance and Well-Being

Irrelevant ambient noise can have profound effects on human performance and wellbeing. Acoustic interventions (e.g., installation of sound absorbing materials) that reduce intelligible noise (i.e., sound unrelated to the relevant speech, including noise from other talkers within the space) by reducing room reverberation, have been found to be an effective means to alleviate the negative effects of noise on cognitive performance. However, these interventions are expensive, and it is difficult to evaluate their impact in the field. Virtual reality (VR) provides a promising simulation platform to evaluate the likely impact of varied acoustic interventions before they are chosen and installed. This study employed a virtual classroom environment to evaluate whether an intervention to reduce reverberation can be simulated successfully in VR and mitigate the effects of ambient noise on cognitive performance, physiological stress, and mood. The repeated-measures experimental design consisted of three acoustic conditions: no ambient noise, typical open-plan classroom ambient noise without acoustic treatment, and the same ambient noise with acoustic treatment to reduce reverberation. Results revealed that ambient noise negatively affected participants’ cognitive performance but had no measurable effect on physiological stress or self-reported mood. Importantly, the negative effect of ambient noise was completely ameliorated by the acoustic treatment (i.e. indistinguishable from performance in the no noise condition). The study shows that VR provides an effective and efficient means to evaluate the cognitive effects of acoustic interventions.

[1]  Julie E. Dockrell,et al.  Acoustical barriers in classrooms: the impact of noise on performance in the classroom , 2006 .

[2]  S. Lawrence Effects in the Classroom , 2019, The Grieving Child in the Classroom.

[3]  S. Jaeggi,et al.  The concurrent validity of the N-back task as a working memory measure , 2010, Memory.

[4]  A. Malliani,et al.  Heart rate variability. Standards of measurement, physiological interpretation, and clinical use , 1996 .

[5]  Michael Vorländer,et al.  Audio-video virtual reality environments in building acoustics: An exemplary study reproducing performance results and subjective ratings of a laboratory listening experiment. , 2019, The Journal of the Acoustical Society of America.

[6]  A. Heinz,et al.  Differential effects of wakeful rest, music and video game playing on working memory performance in the n-back task , 2015, Front. Psychol..

[7]  Anders Kjellberg,et al.  Long Reverberation Time Decreases Recall of Spoken Information , 2009 .

[8]  AG Armin Kohlrausch,et al.  The indoor sound environment and human task performance: A literature review on the role of room acoustics , 2017 .

[9]  Maarten Hornikx,et al.  Auditory distraction in open-plan study environments: Effects of background speech and reverberation time on a collaboration task , 2019, Applied Acoustics.

[10]  A. Meule,et al.  Reporting and Interpreting Working Memory Performance in n-back Tasks , 2017, Front. Psychol..

[11]  L. Rantala,et al.  Effects of Classroom Acoustics on Teachers' Voices , 2015 .

[12]  A. Merla,et al.  Multiresolution Karhunen Loéve analysis of galvanic skin response for psycho-physiological studies , 2012 .

[13]  Michael Vorländer,et al.  A round robin on room acoustical simulation and auralization. , 2019, The Journal of the Acoustical Society of America.

[14]  Murray Hodgson,et al.  The Role of Acoustics in the Perceived Suitability of, and Well-Being in, Informal Learning Spaces , 2016 .

[15]  T. Lachmann,et al.  Effects of noise and reverberation on speech perception and listening comprehension of children and adults in a classroom-like setting. , 2010, Noise & health.

[16]  Gerhart Tiesler,et al.  Classroom Acoustics and Impact on Health and Social Behaviour , 2015 .

[17]  M Vorländer,et al.  The impact of background speech varying in intelligibility: Effects on cognitive performance and perceived disturbance , 2008, Ergonomics.

[18]  Patrik Sörqvist,et al.  A 3 year update on the influence of noise on performance and behavior. , 2012, Noise & health.

[19]  Martin Dijst,et al.  Wearables and Location Tracking Technologies for Mental-State Sensing in Outdoor Environments , 2019, The Professional Geographer.

[20]  Nigel Holt,et al.  Reverberant auditory environments: the effects of multiple echoes on distraction by ‘irrelevant’ speech , 2007 .

[21]  Patrick Olivier,et al.  N-backer: An auditory n-back task with automatic scoring of spoken responses , 2011, Behavior research methods.

[22]  L. Shtrepi,et al.  A Cross-Sectional Survey on the Impact of Irrelevant Speech Noise on Annoyance, Mental Health and Well-being, Performance and Occupants’ Behavior in Shared and Open-Plan Offices , 2019, International journal of environmental research and public health.

[23]  J. V. van Merrienboer,et al.  Heart Rate and Heart Rate Variability Correlate with Clinical Reasoning Performance and Self-Reported Measures of Cognitive Load , 2019, Scientific Reports.

[24]  A. Vercammen,et al.  The Application of Wearable Technology to Quantify Health and Wellbeing Co-benefits From Urban Wetlands , 2019, Front. Psychol..

[25]  Maximilian Bayer,et al.  Handbook For Sound Engineers , 2016 .

[26]  John S. Bradley,et al.  A just noticeable difference in C50 for speech , 1999 .

[27]  J. Seidel,et al.  Effects of Classroom Acoustics on Performance and Well-Being in Elementary School Children: A Field Study , 2010 .

[28]  J. Thayer,et al.  eview meta-analysis of heart rate variability and neuroimaging studies : Implications or heart rate variability as a marker of stress and health , 2012 .

[29]  Sebastian Lange,et al.  Reliability Generalization , 2011, Assessment.

[30]  Zhiwei Lian,et al.  Human physiological responses to wooden indoor environment , 2017, Physiology & Behavior.

[31]  I. Mammarella,et al.  Noise, Age, and Gender Effects on Speech Intelligibility and Sentence Comprehension for 11- to 13-Year-Old Children in Real Classrooms , 2019, Front. Psychol..

[32]  D. Bai,et al.  Stress and Heart Rate Variability: A Meta-Analysis and Review of the Literature , 2018, Psychiatry investigation.

[33]  T. Wüstenberg,et al.  Working Memory Load-Dependent Brain Response Predicts Behavioral Training Gains in Older Adults , 2014, The Journal of Neuroscience.

[34]  F. K. Berrien The effects of noise. , 1946, Psychological bulletin.

[35]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[36]  R. Luerding,et al.  Impaired working-memory after cerebellar infarcts paralleled by changes in BOLD signal of a cortico-cerebellar circuit , 2007, Neuropsychologia.

[37]  David L. Neumann,et al.  The sensitivity of 38 heart rate variability measures to the addition of artifact in human and artificial 24‐hr cardiac recordings , 2018, Annals of noninvasive electrocardiology : the official journal of the International Society for Holter and Noninvasive Electrocardiology, Inc.

[38]  Mohamed Al-Hussein,et al.  Virtual reality applications for the built environment: Research trends and opportunities , 2020 .

[39]  Cumhur Erkut,et al.  Sonic Interactions in Virtual Reality: State of the Art, Current Challenges, and Future Directions , 2018, IEEE Computer Graphics and Applications.

[40]  H Ising,et al.  Health effects caused by noise: evidence in the literature from the past 25 years. , 2004, Noise & health.

[41]  Alan D. Baddeley,et al.  Disruption of short-term memory by unattended speech : Implications for the structure of working memory , 1982 .

[42]  F. Pellerey,et al.  Influence of Classroom Acoustics on Noise Disturbance and Well-Being for First Graders , 2019, Front. Psychol..

[43]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[44]  D. Watson,et al.  Development and validation of brief measures of positive and negative affect: the PANAS scales. , 1988, Journal of personality and social psychology.

[45]  Christina Bodin Danielson,et al.  Concentration requirements modify the effect of office type on indicators of health and performance , 2014 .