Combined Lateral and Longitudinal Control of EEG Signals-Based Brain-Controlled Vehicles

Using brain signals rather than limbs to control a vehicle may not only help persons with disabilities to acquire driving ability, but also provide healthy persons with a new alternative way to drive. In this paper, we propose a combined lateral and longitudinal control system for electroencephalogram (EEG) signals-based brain-controlled vehicles (BCVs). The proposed system is designed by integrating a user interface, a brain–computer interface (BCI), a control interface model, a lateral controller, and a longitudinal controller. We conduct driver-and-hardware-in-the-loop experiments under two control conditions (i.e., the brain- and manual-control conditions) with different subjects and three driving tests (i.e., the lane-changing, path-selection, and car-following tests). Experimental results show the feasibility of using brain signals to continuously perform both the lateral and longitudinal control of a vehicle. This study not only promotes the development of BCVs, but also provides some insights on how to apply BCIs in conjunction with assistant controllers to control other dynamic systems.

[1]  E. Camacho,et al.  Generalized Predictive Control , 2007 .

[2]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[3]  Zhong-Ping Jiang,et al.  Data-Driven Shared Steering Control of Semi-Autonomous Vehicles , 2019, IEEE Transactions on Human-Machine Systems.

[4]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  Shangkai Gao,et al.  A practical VEP-based brain-computer interface. , 2006, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[6]  Liuping Wang,et al.  Model Predictive Control System Design and Implementation Using MATLAB , 2009 .

[7]  P SomanK.,et al.  A Brief Survey on Autonomous Vehicle Possible Attacks, Exploits and Vulnerabilities , 2018, ArXiv.

[8]  J. Christian Gerdes,et al.  Shared Steering Control Using Safe Envelopes for Obstacle Avoidance and Vehicle Stability , 2016, IEEE Transactions on Intelligent Transportation Systems.

[9]  Yili Liu,et al.  Using a Head-up Display-Based Steady-State Visually Evoked Potential Brain–Computer Interface to Control a Simulated Vehicle , 2014, IEEE Transactions on Intelligent Transportation Systems.

[10]  Yang Yu,et al.  Toward brain-actuated car applications: Self-paced control with a motor imagery-based brain-computer interface , 2016, Comput. Biol. Medicine.

[11]  Helge J. Ritter,et al.  2009 Special Issue: The MindGame: A P300-based brain-computer interface game , 2009 .

[12]  Raúl Rojas,et al.  Semi-autonomous Car Control Using Brain Computer Interfaces , 2012, IAS.

[13]  G Pfurtscheller,et al.  Toward a hybrid brain–computer interface based on imagined movement and visual attention , 2010, Journal of neural engineering.

[14]  Toshihisa Tanaka,et al.  A comparison study of visually stimulated brain-computer and eye-tracking interfaces. , 2017, Journal of neural engineering.

[15]  Vinay Jayaram,et al.  Task-induced frequency modulation features for brain-computer interfacing , 2017, Journal of neural engineering.

[16]  Luzheng Bi,et al.  EEG Signals-Based Longitudinal Control System for a Brain-Controlled Vehicle , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[18]  Brendan Z. Allison,et al.  How Many People Could Use an SSVEP BCI? , 2012, Front. Neurosci..

[19]  Ruzena Bajcsy,et al.  Semiautonomous Vehicular Control Using Driver Modeling , 2014, IEEE Transactions on Intelligent Transportation Systems.

[20]  Xingyu Wang,et al.  Discriminative Feature Extraction via Multivariate Linear Regression for SSVEP-Based BCI , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[22]  Erich E. Sutter,et al.  The brain response interface: communication through visually-induced electrical brain responses , 1992 .

[23]  Feng Wan,et al.  Alpha neurofeedback training improves SSVEP-based BCI performance , 2016, Journal of neural engineering.

[24]  Michael Bensch,et al.  Design and Implementation of a P300-Based Brain-Computer Interface for Controlling an Internet Browser , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[26]  J. Masdeu,et al.  Human Cerebral Activation during Steady-State Visual-Evoked Responses , 2003, The Journal of Neuroscience.

[27]  Jianqiang Wang,et al.  Model Predictive Multi-Objective Vehicular Adaptive Cruise Control , 2011, IEEE Transactions on Control Systems Technology.

[28]  Yili Liu,et al.  A Brain–Computer Interface-Based Vehicle Destination Selection System Using P300 and SSVEP Signals , 2015, IEEE Transactions on Intelligent Transportation Systems.

[29]  Dean J. Krusienski,et al.  Optimization of Checkerboard Spatial Frequencies for Steady-State Visual Evoked Potential Brain–Computer Interfaces , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[30]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[31]  J. Kleim,et al.  Principles of experience-dependent neural plasticity: implications for rehabilitation after brain damage. , 2008, Journal of speech, language, and hearing research : JSLHR.

[32]  Yili Liu,et al.  A Head-Up Display-Based P300 Brain–Computer Interface for Destination Selection , 2013, IEEE Transactions on Intelligent Transportation Systems.

[33]  C. Herrmann Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[34]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.