Augmenting VR/AR Applications with EEG/EOG Monitoring and Oculo-Vestibular Recoupling

Head-mounted virtual reality and augmented reality displays a.k.a. VR/AR goggles created a revolutionary multimedia genre that is seeking ever-broadening applications and novel natural human interfaces. Adding neuromonitoring and neurofeedback to this genre is expected to introduce a new dimension to user interaction with the cyber-world. This study presents the development of a Neuromonitoring VR/AR Goggle armed with electroence-phalo-gram and electrooculogram sensors, programmable milli-Ampere current stimulators and wireless fog/cloud computing support. Beside of its potential use in mitigating cybersickness, this device may have potential applications in augmented cognition ranging from feedback-controlled perceptual training to on-line learning and virtual social interactions. A prototype of the device has been made from a Samsung Gear VR for S6. This study explains its technical design to ensure precision data sampling, synchronous event marking, real-time signal processing and big data cloud computing support. This study also demonstrates the effective-ness in measuring the event-related potentials during a visual oddball experiment.

[1]  Michael J Cevette,et al.  Oculo-vestibular recoupling using galvanic vestibular stimulation to mitigate simulator sickness. , 2012, Aviation, space, and environmental medicine.

[2]  Evangelos Bekiaris,et al.  Using EEG spectral components to assess algorithms for detecting fatigue , 2009, Expert Syst. Appl..

[3]  Hsiao-Ching She,et al.  On-line synchronous scientific argumentation learning: Nurturing students' argumentation ability and conceptual change in science context , 2010, Comput. Educ..

[4]  Yu-Te Wang,et al.  Pervasive brain monitoring and data sharing based on multi-tier distributed computing and linked data technology , 2014, Front. Hum. Neurosci..

[5]  Hans-Werner Gellersen,et al.  Toward Mobile Eye-Based Human-Computer Interaction , 2010, IEEE Pervasive Computing.

[6]  Armin Haller,et al.  Semantic Sensor Network Ontology , 2017 .

[7]  D E Stannard,et al.  Grand illusions. , 1986, Reviews in American history.

[8]  J. Decety,et al.  The functional architecture of human empathy. , 2004, Behavioral and cognitive neuroscience reviews.

[9]  R. Schleicher,et al.  Blinks and saccades as indicators of fatigue in sleepiness warners: looking tired? , 2022 .

[10]  Tzyy-Ping Jung,et al.  Eye movements predict students' computer-based assessment performance of physics concepts in different presentation modalities , 2014, Comput. Educ..

[11]  T. Jung,et al.  Developing an EEG-based on-line closed-loop lapse detection and mitigation system , 2014, Front. Neurosci..

[12]  Martin J. McKeown,et al.  Noisy Galvanic Vestibular Stimulation Modulates the Amplitude of EEG Synchrony Patterns , 2013, PloS one.

[13]  Yuan-Pin Lin,et al.  EEG-Based Emotion Recognition in Music Listening , 2010, IEEE Transactions on Biomedical Engineering.

[14]  S. Makeig,et al.  Mining event-related brain dynamics , 2004, Trends in Cognitive Sciences.

[15]  Joseph J. LaViola,et al.  A discussion of cybersickness in virtual environments , 2000, SGCH.

[16]  T. Sejnowski,et al.  Estimating alertness from the EEG power spectrum , 1997, IEEE Transactions on Biomedical Engineering.

[17]  Eric Klinenberg.  Inside the Box , 2002 .