Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials

BackgroundPeople with severe disabilities, e.g. due to neurodegenerative disease, depend on technology that allows for accurate wheelchair control. For those who cannot operate a wheelchair with a joystick, brain-computer interfaces (BCI) may offer a valuable option. Technology depending on visual or auditory input may not be feasible as these modalities are dedicated to processing of environmental stimuli (e.g. recognition of obstacles, ambient noise). Herein we thus validated the feasibility of a BCI based on tactually-evoked event-related potentials (ERP) for wheelchair control. Furthermore, we investigated use of a dynamic stopping method to improve speed of the tactile BCI system.MethodsPositions of four tactile stimulators represented navigation directions (left thigh: move left; right thigh: move right; abdomen: move forward; lower neck: move backward) and N = 15 participants delivered navigation commands by focusing their attention on the desired tactile stimulus in an oddball-paradigm.ResultsParticipants navigated a virtual wheelchair through a building and eleven participants successfully completed the task of reaching 4 checkpoints in the building. The virtual wheelchair was equipped with simulated shared-control sensors (collision avoidance), yet these sensors were rarely needed.ConclusionWe conclude that most participants achieved tactile ERP-BCI control sufficient to reliably operate a wheelchair and dynamic stopping was of high value for tactile ERP classification. Finally, this paper discusses feasibility of tactile ERPs for BCI based wheelchair control.

[1]  E. John,et al.  Evoked-Potential Correlates of Stimulus Uncertainty , 1965, Science.

[2]  E Donchin,et al.  Discriminant analysis in average evoked response studies: the study of single trial data. , 1969, Electroencephalography and clinical neurophysiology.

[3]  E. Donchin,et al.  Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. , 1988, Electroencephalography and clinical neurophysiology.

[4]  J. VanSwearingen,et al.  Measuring fatigue related to facial muscle function. , 1995, Archives of physical medicine and rehabilitation.

[5]  G. Pfurtscheller,et al.  EEG-based discrimination between imagination of right and left hand movement. , 1997, Electroencephalography and clinical neurophysiology.

[6]  G. Pfurtscheller,et al.  Motor imagery activates primary sensorimotor area in humans , 1997, Neuroscience Letters.

[7]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[8]  L. Viollet,et al.  Evoked Potentials in Spinal Muscular Atrophy , 2003, Journal of child neurology.

[9]  G. Pfurtscheller,et al.  How many people are able to operate an EEG-based brain-computer interface (BCI)? , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[11]  N. Birbaumer,et al.  BCI2000: a general-purpose brain-computer interface (BCI) system , 2004, IEEE Transactions on Biomedical Engineering.

[12]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[13]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[14]  Christa Neuper,et al.  Walking by Thinking: The Brainwaves Are Crucial, Not the Muscles! , 2006, PRESENCE: Teleoperators and Virtual Environments.

[15]  Gert Pfurtscheller,et al.  Walking from thought , 2006, Brain Research.

[16]  José del R. Millán,et al.  Non-Invasive Brain Computer Interface for Mental Control of a Simulated Wheelchair , 2006 .

[17]  Niels Birbaumer,et al.  fMRI Brain-Computer Interface: A Tool for Neuroscientific Research and Treatment , 2007, Comput. Intell. Neurosci..

[18]  F. Babiloni,et al.  Multimodal stimulation for a P300-based BCI , 2007 .

[19]  José del R. Millán,et al.  Context-Based Filtering for Assisted Brain-Actuated Wheelchair Driving , 2007, Comput. Intell. Neurosci..

[20]  L. Cohen,et al.  Brain–computer interfaces: communication and restoration of movement in paralysis , 2007, The Journal of physiology.

[21]  Gernot R. Müller-Putz,et al.  Self-Paced (Asynchronous) BCI Control of a Wheelchair in Virtual Environments: A Case Study with a Tetraplegic , 2007, Comput. Intell. Neurosci..

[22]  G. Vanacker,et al.  Adaptive Shared Control of a Brain-Actuated Simulated Wheelchair , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[23]  Febo Cincotti,et al.  Vibrotactile Feedback for Brain-Computer Interface Operation , 2007, Comput. Intell. Neurosci..

[24]  J. Polich.  Updating P300: An integrative theory of P3a and P3b , 2007, Clinical Neurophysiology.

[25]  Kyuwan Choi,et al.  Control of a Wheelchair by Motor Imagery in Real Time , 2008, IDEAL.

[26]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[27]  Miguel Castelo-Branco,et al.  Visual P300-based BCI to steer a wheelchair: A Bayesian approach , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Intelligent Data Engineering and Automated Learning – IDEAL 2008 , 2008, Lecture Notes in Computer Science.

[29]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[30]  A. Lenhardt,et al.  An Adaptive P300-Based Online Brain–Computer Interface , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  J. Wolpaw,et al.  A P300-based brain–computer interface for people with amyotrophic lateral sclerosis , 2008, Clinical Neurophysiology.

[32]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[33]  Cuntai Guan,et al.  Asynchronous P300-Based Brain--Computer Interfaces: A Computational Approach With Statistical Models , 2008, IEEE Transactions on Biomedical Engineering.

[34]  E. W. Sellers,et al.  Toward enhanced P300 speller performance , 2008, Journal of Neuroscience Methods.

[35]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[36]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  E. Sellers,et al.  How many people are able to control a P300-based brain–computer interface (BCI)? , 2009, Neuroscience Letters.

[38]  Iñaki Iturrate,et al.  A Noninvasive Brain-Actuated Wheelchair Based on a P300 Neurophysiological Protocol and Automated Navigation , 2009, IEEE Transactions on Robotics.

[39]  Vera Kaiser,et al.  BCI Applications for People with Disabilities: Defining User Needs and User Requirements , 2009 .

[40]  Marieke E. Thurlings,et al.  EEG-Based Navigation from a Human Factors Perspective , 2010, Brain-Computer Interfaces.

[41]  José del R. Millán,et al.  The role of shared-control in BCI-based telepresence , 2010, 2010 IEEE International Conference on Systems, Man and Cybernetics.

[42]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[43]  Jan B. F. van Erp,et al.  A Tactile P300 Brain-Computer Interface , 2010, Front. Neurosci..

[44]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[45]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[46]  Benjamin Blankertz,et al.  Two-dimensional auditory p300 speller with predictive text system , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[47]  Anne-Marie Brouwer,et al.  A tactile P 300 brain-computer interface , 2010 .

[48]  Febo Cincotti,et al.  Tactile, Visual, and Bimodal P300s: Could Bimodal P300s Boost BCI Performance? , 2010 .

[49]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[50]  Shangkai Gao,et al.  An online brain–computer interface using non-flashing visual evoked potentials , 2010, Journal of neural engineering.

[51]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[52]  Sazali Yaacob,et al.  Asynchronous brain machine interface-based control of a wheelchair. , 2011, Advances in experimental medicine and biology.

[53]  Febo Cincotti,et al.  Asynchronous P300-Based Brain-Computer Interface to Control a Virtual Environment: Initial Tests on End Users , 2011, Clinical EEG and neuroscience.

[54]  Benjamin Blankertz,et al.  Performance optimization of ERP-based BCIs using dynamic stopping , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  F Babiloni,et al.  P300-based brain–computer interface for environmental control: an asynchronous approach , 2011, Journal of neural engineering.

[56]  A. Kübler,et al.  Flashing characters with famous faces improves ERP-based brain–computer interface performance , 2011, Journal of neural engineering.

[57]  José del R. Millán,et al.  Vision-Based Shared Control for a BCI Wheelchair , 2011 .

[58]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[59]  M. Tangermann,et al.  Listen, You are Writing! Speeding up Online Spelling with a Dynamic Auditory BCI , 2011, Front. Neurosci..

[60]  Xingyu Wang,et al.  An adaptive P300-based control system , 2011, Journal of neural engineering.

[61]  Wolfgang Rosenstiel,et al.  Neural mechanisms of brain–computer interface control , 2011, NeuroImage.

[62]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[63]  Huosheng Hu,et al.  A Self-Paced Motor Imagery Based Brain-Computer Interface for Robotic Wheelchair Control , 2011, Clinical EEG and neuroscience.

[64]  Donatella Mattia,et al.  A Brain-Computer Interface as Input Channel for a Standard Assistive Technology Software , 2011, Clinical EEG and neuroscience.

[65]  C Neuper,et al.  A comparison of three brain–computer interfaces based on event-related desynchronization, steady state visual evoked potentials, or a hybrid approach using both signals , 2011, Journal of neural engineering.

[66]  J. W. Minett,et al.  Optimizing the P300-based brain–computer interface: current status, limitations and future directions , 2011, Journal of neural engineering.

[67]  A. Kübler,et al.  ERPs contributing to classification in the ”P300” BCI , 2011 .

[68]  Febo Cincotti,et al.  Out of the frying pan into the fire--the P300-based BCI faces real-world challenges. , 2011, Progress in brain research.

[69]  O. Bai,et al.  Electroencephalography (EEG)-Based Brain–Computer Interface (BCI): A 2-D Virtual Wheelchair Control Based on Event-Related Desynchronization/Synchronization and State Control , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[70]  Tobias Kaufmann,et al.  Spelling is Just a Click Away – A User-Centered Brain–Computer Interface Including Auto-Calibration and Predictive Text Entry , 2012, Front. Neurosci..

[71]  Yael Arbel,et al.  BCIs that use P300 Event Related Potentials , 2012 .

[72]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..

[73]  Jonathan R. Wolpaw,et al.  Brain–Computer InterfacesPrinciples and Practice , 2012 .

[74]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[75]  Benjamin Blankertz,et al.  Control-display mapping in brain–computer interfaces , 2012, Ergonomics.

[76]  G R Müller-Putz,et al.  Toward smarter BCIs: extending BCIs through hybridization and intelligent control , 2012, Journal of neural engineering.

[77]  Anton Nijholt,et al.  Towards Practical Brain-Computer Interfaces: Bridging the Gap from Research to Real-World Applications , 2012 .

[78]  K. Müller,et al.  Psychological predictors of SMR-BCI performance , 2012, Biological Psychology.

[79]  Javier Minguez,et al.  A Telepresence Mobile Robot Controlled With a Noninvasive Brain–Computer Interface , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[80]  Tobias Kaufmann,et al.  User Centred Design in BCI Development , 2012 .

[81]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[82]  Febo Cincotti,et al.  Hybrid-P300 BCI: Usability Testing by Severely Motor-restricted End-Users , 2013 .

[83]  Reza Fazel-Rezai.  Brain-Computer Interface Systems - Recent Progress and Future Prospects , 2013 .

[84]  Andrzej Cichocki,et al.  Whether generic model works for rapid ERP-based BCI calibration , 2013, Journal of Neuroscience Methods.

[85]  Stefan Haufe,et al.  Optimizing event-related potential based brain-computer interfaces: a systematic evaluation of dynamic stopping methods. , 2013, Journal of neural engineering.

[86]  A. Kübler,et al.  Face stimuli effectively prevent brain–computer interface inefficiency in patients with neurodegenerative disease , 2013, Clinical Neurophysiology.

[87]  Niels Birbaumer,et al.  Training effects of multiple auditory BCI sessions , 2013 .

[88]  Mário Sarcinelli-Filho,et al.  Commanding a robotic wheelchair with a high-frequency steady-state visual evoked potential based brain-computer interface. , 2013, Medical engineering & physics.

[89]  Tobias Kaufmann,et al.  Comparison of tactile, auditory, and visual modality for brain-computer interface use: a case study with a patient in the locked-in state , 2013, Front. Neurosci..

[90]  José del R. Millán,et al.  Feel the BCI vibe – vibrotactile BCI feedback , 2013 .

[91]  Tobias Kaufmann,et al.  A User Centred Approach for Bringing BCI Controlled Applications to End-Users , 2013 .