Development and evaluation of a new virtual reality-based audio-tactile cueing-system to guide visuo-spatial attention

Spatial attention is an important feature for filtering everyday inputs. The direction of the attention can be guided by the use of visual, auditory or tactile stimuli. The literature regarding the effect of cueing spatial attention in visual search tasks consistently shows an improvement in accuracy and reaction time. So far, most studies have used two-dimensional setups, for which ecological validity may be questioned. In this study with healthy participants, we investigated the feasibility of a virtual reality-based setup. We examined the feasibility and compared the performance in a visual search task as auditory, tactile or combined cues were given. The results revealed high usability and a significantly higher detection rate for combined audio-tactile cues compared to auditory cues alone.

[1]  R. Ptak,et al.  Dynamic modulation of visual detection by auditory cues in spatial neglect , 2005, Neuropsychologia.

[2]  Cristy Ho,et al.  Multisensory In-Car Warning Signals for Collision Avoidance , 2007, Hum. Factors.

[3]  Nergiz Turgut,et al.  Adaptive Cueing Treatment of Neglect in Stroke Patients Leads to Improvements in Activities of Daily Living: A Randomized Controlled, Crossover Trial , 2018, Neurorehabilitation and neural repair.

[4]  Robert S. Kennedy,et al.  Simulator Sickness Questionnaire: An enhanced method for quantifying simulator sickness. , 1993 .

[5]  Jeremy L. Loebach,et al.  A comparison of free-field and headphone based sound localization tasks , 2018 .

[6]  Michael Rohs,et al.  HapticHead: A Spherical Vibrotactile Grid around the Head for 3D Guidance in Virtual and Augmented Reality , 2017, CHI.

[7]  Francesco Pavani,et al.  Acoustical Vision of Neglected Stimuli: Interaction among Spatially Converging Audiovisual Inputs in Neglect Patients , 2002, Journal of Cognitive Neuroscience.

[8]  P. Joseph,et al.  Unilateral neglect syndrome rehabilitation by trunk rotation and scanning training. , 1997, Archives of physical medicine and rehabilitation.

[9]  T. Nef,et al.  Visuo-acoustic stimulation that helps you to relax: A virtual reality setup for patients in the intensive care unit , 2017, Scientific Reports.

[10]  James L. Merlo,et al.  Quantification of Tactile Cueing for Enhanced Target Search Capacity , 2011 .

[11]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[12]  Mauro Ursino,et al.  Crossmodal Links between Vision and Touch in Spatial Attention: A Computational Modelling Study , 2009, Comput. Intell. Neurosci..

[13]  D. Grantham,et al.  Auditory spatial resolution in horizontal, vertical, and diagonal planes. , 2003, The Journal of the Acoustical Society of America.

[14]  Jon Driver,et al.  Covert Spatial Orienting in Audition: Exogenous and Endogenous Mechanisms , 1994 .

[15]  S. Clarke,et al.  The effect of contextual auditory stimuli on virtual spatial navigation in patients with focal hemispheric lesions , 2018, Neuropsychological rehabilitation.

[16]  Peter A Hancock,et al.  Improving target detection in visual search through the augmenting multi-sensory cues , 2013, Ergonomics.

[17]  Miriam Reiner,et al.  Multimodal Virtual Environments: Response Times, Attention, and Presence , 2006, PRESENCE: Teleoperators and Virtual Environments.

[18]  J. Mattingley,et al.  Phasic alerting of neglect patients overcomes their spatial deficit in visual awareness , 1998, Nature.

[19]  T. Nef,et al.  Perception and Performance on a Virtual Reality Cognitive Stimulation for Use in the Intensive Care Unit: A Non-randomized Trial in Critically Ill Patients , 2019, Front. Med..

[20]  K. Heilman,et al.  Neglect and Related Disorders , 1984, Seminars in neurology.

[21]  T. Nef,et al.  Attentional reorienting triggers spatial asymmetries in a search task with cross-modal spatial cueing , 2018, PloS one.

[22]  Klaus-Peter Hoffmann,et al.  Springer handbook of medical technology , 2011 .