Enjoy driving from thought in a virtual city

Virtual reality (VR) technology allows users to communicate or interact with a virtual artifact in an immersive simulated environment. Most of the existing virtual reality platform uses standard input devices such as a keyboard and mouse, or through multimodal devices such as a wired glove. In this paper, a novel electroencephalo-graph (EEG) based virtual driving (EEG-VD) prototype is proposed, investigated, and designed. Users can enjoy driving a virtual car in a simulated and realistic city only through brain signals. User's EEG signals are obtained, analyzed, and recognized into control commands, which are used to control a virtual car in a three-dimensional (3D) city environment. The paradigm display of P300 in the proposed EEG-VD system is embedded in the display of VR, to realize closely combination of VR and P300. This guarantees the verisimilitude of the system. In addition, asynchronous BCI paradigm based on P300 signals used in the proposed EEG-VD system realizes a high degree of freedom, which can offer appropriate number of control instructions. In order to verify the effectiveness and performance of the designed EEG-VD system, eight volunteers are asked to drive the car in the 3D city. The experiment result shows that the accuracy of P300 recognition rate is larger than 90%. Most of the users (62.5%) can drive the car without any collisions in the first virtual environment, and all users can drive the car without any collisions in the second virtual environment. The designed system can not only be used as a tool to train a subject of BCI but also be used as a game for enjoying life. Potentially, the system can promote the research of BCI applications.

[1]  Mark W. Scerbo,et al.  The Efficacy of a Medical Virtual Reality Simulator for Training Phlebotomy , 2006, Hum. Factors.

[2]  David J. C. MacKay,et al.  Bayesian Interpolation , 1992, Neural Computation.

[3]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[4]  Maria Virvou,et al.  On the usability and likeability of virtual reality games for education: The case of VR-ENGAGE , 2008, Comput. Educ..

[5]  Changyin Sun,et al.  Adaptive sliding mode control for re-entry attitude of near space hypersonic vehicle based on backstepping design , 2015, IEEE/CAA Journal of Automatica Sinica.

[6]  Maureen K. Holden,et al.  Virtual Environments for Motor Rehabilitation: Review , 2005, Cyberpsychology Behav. Soc. Netw..

[7]  N. Magnenat-Thalmann,et al.  Social Robots and Virtual Humans as Assistive Tools for Improving Our Quality of Life , 2014, 2014 5th International Conference on Digital Home.

[8]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[9]  Gert Pfurtscheller,et al.  Walking from thought , 2006, Brain Research.

[10]  E. A. Attree,et al.  Training in virtual environments: transfer to real world tasks and equivalence to real task training , 2000, Ergonomics.

[11]  Liqing Zhang,et al.  EEG-based asynchronous BCI control of a car in 3D virtual reality environments , 2009 .

[12]  John R. Smith,et al.  Steady-State VEP-Based Brain-Computer Interface Control in an Immersive 3D Gaming Environment , 2005, EURASIP J. Adv. Signal Process..

[13]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[14]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[15]  Girish Chowdhary,et al.  Off-policy reinforcement learning with Gaussian processes , 2014, IEEE/CAA Journal of Automatica Sinica.

[16]  Jacquelyn Ford Morie,et al.  Human Emotional State and its Relevance for Military VR Training , 2005 .

[17]  Michitaka Hirose,et al.  A pilot study on virtual camera control via Steady-State VEP in immersing virtual environments , 2008 .

[18]  Feng Li,et al.  A Hybrid Brain-Computer Interface-Based Mail Client , 2013, Comput. Math. Methods Medicine.

[19]  J D Bayliss,et al.  A virtual reality testbed for brain-computer interface research. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[20]  F. Lotte,et al.  Self-Paced Brain-Computer Interaction with Virtual Worlds: A Quantitative and Qualitative Study "Out of the Lab" , 2008 .

[21]  Weixin Xie,et al.  Two implementations of marginal distribution Bayes filter for nonlinear Gaussian models , 2015 .

[22]  Robert V. Kenyon,et al.  Training in virtual and real environments , 1995, Annals of Biomedical Engineering.

[23]  Long Zhang,et al.  Forward and backward least angle regression for nonlinear system identification , 2015, Autom..

[24]  Feng Li,et al.  Discrimination Between Control and Idle States in Asynchronous SSVEP-Based Brain Switches: A Pseudo-Key-Based Approach , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Zhijun Zhang,et al.  Human–Robot Interaction by Understanding Upper Body Gestures , 2014, PRESENCE: Teleoperators and Virtual Environments.