Brain-Based Computer Interfaces in Virtual Reality

Virtual Reality (VR) research is accelerating the development of inexpensive real-time Brain Computer Interface (BCI). Hardware improvements that increase the capability of Virtual Reality displays and Brain Computer wearable sensors have made possible several new software frameworks for developers to use and create applications combining BCI and VR. It also enables multiple sensory pathways for communications with a larger sized data to users' brains. The intersections of these two research paths are accelerating both fields and will drive the needs for an energy-aware infrastructure to support the wider local bandwidth demands in the mobile cloud. In this paper, we complete a survey on BCI in VR from various perspectives, including Electroencephalogram (EEG)-based BCI models, machine learning, and current active platforms. Based on our investigations, the main findings of this survey highlights three major development trends of BCI, which are entertainment, VR, and cloud computing.

[1]  Keke Gai,et al.  Phase-Change Memory Optimization for Green Cloud with Genetic Algorithm , 2015, IEEE Transactions on Computers.

[2]  Robertas Damasevicius,et al.  A Prototype SSVEP Based Real Time BCI Gaming System , 2016, Comput. Intell. Neurosci..

[3]  Klaus Gramann,et al.  Mobile Brain/Body Imaging (MoBI) of Physical Interaction with Dynamically Moving Objects , 2016, Front. Hum. Neurosci..

[4]  Min Chen,et al.  SA-EAST , 2017, ACM Trans. Embed. Comput. Syst..

[5]  Keke Gai,et al.  Dynamic energy-aware cloudlet-based mobile cloud computing model for green computing , 2016, J. Netw. Comput. Appl..

[6]  Klaus-Robert Müller,et al.  Spatio-spectral filters for improving the classification of single trial EEG , 2005, IEEE Transactions on Biomedical Engineering.

[7]  E. Gratton,et al.  Measurement of brain activity by near-infrared light. , 2005, Journal of biomedical optics.

[8]  Kensuke Shimizu,et al.  Virtual reality feedback environment for brain computer interface paradigm using tactile and bone-conduction auditory modality paradigms , 2014, 2014 Joint 7th International Conference on Soft Computing and Intelligent Systems (SCIS) and 15th International Symposium on Advanced Intelligent Systems (ISIS).

[9]  Maud Marchal,et al.  The Mind-Mirror: See your brain in action in your head using EEG and augmented reality , 2014, 2014 IEEE Virtual Reality (VR).

[10]  Tiffany Barnes,et al.  Astrojumper: motivating children with autism to exercise using a VR game , 2010, CHI Extended Abstracts.

[11]  M Congedo,et al.  Classification of movement intention by spatially filtered electromagnetic inverse solutions , 2006, Physics in medicine and biology.

[12]  Scott Makeig,et al.  BCILAB: a platform for brain–computer interface development , 2013, Journal of neural engineering.

[13]  Sahibsingh A. Dudani.  The Distance-Weighted k-Nearest-Neighbor Rule , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[14]  Keke Gai,et al.  Electronic Health Record Error Prevention Approach Using Ontology in Big Data , 2015, 2015 IEEE 17th International Conference on High Performance Computing and Communications, 2015 IEEE 7th International Symposium on Cyberspace Safety and Security, and 2015 IEEE 12th International Conference on Embedded Software and Systems.

[15]  Antoine Gaume,et al.  Towards cognitive brain-computer interfaces : real-time monitoring of visual processing and control using electroencephalography , 2016 .

[16]  Robert Oostenveld,et al.  MATLAB-Based Tools for BCI Research , 2010, Brain-Computer Interfaces.

[17]  Guillaume Gibert,et al.  OpenViBE: An Open-Source Software Platform to Design, Test, and Use BrainComputer Interfaces in Real and Virtual Environments , 2010, PRESENCE: Teleoperators and Virtual Environments.

[18]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[19]  Ziqiang Zhu,et al.  Empower VR Art and AR Book with Spatial Interaction , 2016, 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct).

[20]  Keke Gai,et al.  Spoofing-Jamming Attack Strategy Using Optimal Power Distributions in Wireless Smart Grid Networks , 2017, IEEE Transactions on Smart Grid.

[21]  Keke Gai,et al.  Towards Cloud Computing: A Literature Review on Cloud Computing and Its Development Trends , 2012, 2012 Fourth International Conference on Multimedia Information Networking and Security.

[22]  Maria Beatriz Carmo,et al.  Mobile Solution for Brain Visualization Using Augmented and Virtual Reality , 2016, 2016 20th International Conference Information Visualisation (IV).

[23]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[24]  G Pfurtscheller,et al.  Using time-dependent neural networks for EEG classification. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  Simon J. Büchner,et al.  Gaze behaviour during space perception and spatial decision making , 2011, Psychological Research.

[26]  Gert Pfurtscheller,et al.  Brain-computer interface: a new communication device for handicapped persons , 1993 .

[27]  J. H. Bertera,et al.  Eye movements and the span of the effective stimulus in visual search , 2000, Perception & psychophysics.

[28]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[29]  Anatole Lécuyer,et al.  Playing with Senses in VR: Alternate Perceptions Combining Vision and Touch , 2017, IEEE Computer Graphics and Applications.

[30]  Keke Gai,et al.  Privacy-Preserving Adaptive Multi-channel Communications Under Timing Constraints , 2016, 2016 IEEE International Conference on Smart Cloud (SmartCloud).

[31]  Andrés Fraguela,et al.  Inverse electroencephalography for cortical sources , 2005 .

[32]  Keke Gai,et al.  Intelligent cryptography approach for secure distributed big data storage in cloud computing , 2017, Inf. Sci..

[33]  Bofeng Zhang,et al.  A General Framework of Brain-Computer Interface with Visualization and Virtual Reality Feedback , 2009, 2009 Eighth IEEE International Conference on Dependable, Autonomic and Secure Computing.

[34]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.