Enhanced Attention Using Head-mounted Virtual Reality

Some evidence suggests that experiencing a given scenario using virtual reality (VR) may engage greater attentional resources than experiencing the same scenario on a 2D computer monitor. However, the underlying neural processes associated with these VR-related effects, especially those pertaining to current consumer-friendly head-mounted displays of virtual reality (HMD-VR), remain unclear. Here, two experiments were conducted to compare task performance and EEG-based neural metrics captured during a perceptual discrimination task presented on two different viewing platforms. Forty participants (20–25 years old) completed this task using both an HMD-VR and traditional computer monitor in a within-group, randomized design. Although Experiment I (n = 20) was solely behavioral in design, Experiment II (n = 20) utilized combined EEG recordings to interrogate the neural correlates underlying potential performance differences across platforms. These experiments revealed that (1) there was no significant difference in the amount of arousal measured between platforms and (2) selective attention abilities in HMD-VR environment were enhanced from both a behavioral and neural perspective. These findings suggest that the allocation of attentional resources in HMD-VR may be superior to approaches more typically used to assess these abilities (e.g., desktop/laptop/tablet computers with 2D screens).

[1]  W. Chung,et al.  Characterizing cognitive control abilities in children with 16p11.2 deletion using adaptive ‘video game' technology: a pilot study , 2016, Translational psychiatry.

[2]  J. Whyte Attention and arousal: basic science aspects. , 1992, Archives of physical medicine and rehabilitation.

[3]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[4]  Carrie Heater,et al.  Being There: The Subjective Experience of Presence , 1992, Presence: Teleoperators & Virtual Environments.

[5]  Holger Regenbrecht,et al.  Real and Illusory Interactions Enhance Presence in Virtual Environments , 2002, Presence: Teleoperators & Virtual Environments.

[6]  David A. Ziegler,et al.  Differential Impact of Interference on Internally- and Externally-Directed Attention , 2018, Scientific Reports.

[7]  Vytautas Abromavicius,et al.  Detecting sense of presence changes in EEG spectrum during perception of immersive audiovisual content , 2017, 2017 Open Conference of Electrical, Electronic and Information Sciences (eStream).

[8]  H. Levin A Compendium of Neuropsychological Tests: Administration, Norms, and Commentary , 1993 .

[9]  Lai-Sang Young,et al.  Orientation Selectivity from Very Sparse LGN Inputs in a Comprehensive Model of Macaque V1 Cortex , 2016, The Journal of Neuroscience.

[10]  M. Posner,et al.  Orienting of Attention* , 1980, The Quarterly journal of experimental psychology.

[11]  Francisco Rebelo,et al.  Can Virtual Reality Increase Emotional Responses (Arousal and Valence)? A Pilot Study , 2014, HCI.

[12]  S. Makeig Auditory event-related dynamics of the EEG spectrum and effects of exposure to tones. , 1993, Electroencephalography and clinical neurophysiology.

[13]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[14]  Steven M. LaValle,et al.  Head tracking for the Oculus Rift , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Adam Gazzaley,et al.  Exploring the Potential of the iPad and Xbox Kinect for Cognitive Science Research. , 2015, Games for health journal.

[16]  Camarin E. Rolle,et al.  A pilot study to determine the feasibility of enhancing cognitive abilities in children with sensory processing dysfunction , 2017, PloS one.

[17]  Bing Li,et al.  Cognitive intervention for persons with mild cognitive impairment: A meta-analysis , 2011, Ageing Research Reviews.

[18]  Joaquin A. Anguera,et al.  Reconciling the influence of task-set switching and motor inhibition processes on stop signal after-effects , 2013, Front. Psychol..

[19]  G.G. Robertson,et al.  Three views of virtual reality: nonimmersive virtual reality , 1993, Computer.

[20]  E. Tan,et al.  The emotional and cognitive effect of immersion in film viewing , 2010 .

[21]  O. Selnes A Compendium of Neuropsychological Tests , 1991, Neurology.

[22]  J. Polich Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[23]  S Murray Sherman,et al.  Thalamus plays a central role in ongoing cortical functioning , 2016, Nature Neuroscience.

[24]  Henrik M. Peperkorn,et al.  The impact of perception and presence on emotional reactions: a review of research in virtual reality , 2015, Front. Psychol..

[25]  K. Newell,et al.  Modulation of cortical activity in 2D versus 3D virtual reality environments: an EEG study. , 2015, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  Jeremy N. Bailenson,et al.  How Immersive Is Enough? A Meta-Analysis of the Effect of Immersive Technology on User Presence , 2016 .

[27]  Thierry Pun,et al.  DEAP: A Database for Emotion Analysis ;Using Physiological Signals , 2012, IEEE Transactions on Affective Computing.

[28]  C. Eriksen,et al.  Effects of noise letters upon the identification of a target letter in a nonsearch task , 1974 .

[29]  Dennis Proffitt,et al.  Quantifying immersion in virtual reality , 1997, SIGGRAPH.

[30]  Jakki O. Bailey,et al.  Immersive Virtual Reality and the Developing Child , 2017 .

[31]  R. Barry,et al.  A review of electrophysiology in attention-deficit/hyperactivity disorder: I. Qualitative and quantitative electroencephalography , 2003, Clinical Neurophysiology.

[32]  Joel S. Warm,et al.  Vigilance Requires Hard Mental Work and Is Stressful , 2008, Hum. Factors.

[33]  Jason Jerald,et al.  Scene-motion- and latency-perception thresholds for head-mounted displays , 2009 .

[34]  Jeremy N. Bailenson,et al.  Immersive Virtual Reality Field Trips Facilitate Learning About Climate Change , 2018, Front. Psychol..

[35]  Laurel J Buxbaum,et al.  Assessment of spatial attention and neglect with a virtual wheelchair navigation task , 2008, Journal of clinical and experimental neuropsychology.

[36]  Michael J. Singer,et al.  Measuring Presence in Virtual Environments: A Presence Questionnaire , 1998, Presence.

[37]  K. Lange,et al.  Training of attention functions in children with attention deficit hyperactivity disorder , 2011, Attention deficit and hyperactivity disorders.

[38]  Dong Pyo Jang,et al.  Attention Enhancement System using virtual reality and EEG biofeedback , 2002, Proceedings IEEE Virtual Reality 2002.

[39]  Aaron Marcus,et al.  Design, User Experience, and Usability. User Experience Design for Diverse Interaction Platforms and Environments , 2014, Lecture Notes in Computer Science.

[40]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[41]  Nadia Magnenat-Thalmann,et al.  An EEG-based Evaluation for Comparing the Sense of Presence between Virtual and Physical Environments , 2018, CGI 2018.

[42]  Adam Gazzaley,et al.  Enhancing Spatial Attention and Working Memory in Younger and Older Adults , 2017, Journal of Cognitive Neuroscience.

[43]  J. Coull Neural correlates of attention and arousal: insights from electrophysiology, functional neuroimaging and psychopharmacology , 1998, Progress in Neurobiology.

[44]  Patrice L. Weiss,et al.  Virtual Reality Provides Leisure Time Opportunities for Young Adults with Physical and Intellectual Disabilities , 2003, Cyberpsychology Behav. Soc. Netw..

[45]  Bruce D. McCandliss,et al.  Testing the Efficiency and Independence of Attentional Networks , 2002, Journal of Cognitive Neuroscience.

[46]  B. Mineo,et al.  Engagement with Electronic Screen Media Among Students with Autism Spectrum Disorders , 2009, Journal of autism and developmental disorders.

[47]  Miho Nakajima,et al.  Thalamic control of functional cortical connectivity , 2017, Current Opinion in Neurobiology.

[48]  Hsiu-Chi Hsu,et al.  Novel Upper-Limb Rehabilitation System Based on Attention Technology for Post-Stroke Patients: A Preliminary Study , 2018, IEEE Access.

[49]  Eddy J. Davelaar,et al.  Frontal Alpha Oscillations and Attentional Control: A Virtual Reality Neurofeedback Study , 2017, Neuroscience.

[50]  Camarin E. Rolle,et al.  Video game training enhances cognitive control in older adults , 2013, Nature.

[51]  Adam Gazzaley,et al.  The Distracted Mind: Ancient Brains in a High-Tech World , 2016 .

[52]  M. Posner,et al.  Attention and the detection of signals. , 1980, Journal of experimental psychology.

[53]  C. Neuper,et al.  Cortical correlate of spatial presence in 2D and 3D interactive virtual reality: an EEG study. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.