Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials

In order to allow severely disabled people who cannot move their arms and legs to steer an automated wheelchair, this work proposes the combination of a non-invasive EEG-based human-robot interface and an autonomous navigation system that safely executes the issued commands. The robust classification of steady-state visual evoked potentials in brain activity allows for the seamless projection of qualitative directional navigation commands onto a frequently updated route graph representation of the environment. The deduced metrical target locations are navigated to by the application of an extended version of the well-established nearness diagram navigation method. The applicability of the system proposed is demonstrated by a real-world pilot study in which eight out of nine untrained subjects successfully navigated an automated wheelchair, requiring only some ten minutes of preparation.

[1]  Nils J. Nilsson,et al.  A Formal Basis for the Heuristic Determination of Minimum Cost Paths , 1968, IEEE Trans. Syst. Sci. Cybern..

[2]  M. Bureau,et al.  Non-Invasive, Wireless and Universal Interface for the Control of Peripheral Devices by Means of Head Movements , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[3]  Benjamin Blankertz,et al.  THE BERLIN BRAIN-COMPUTER INTERFACE PRESENTS THE NOVEL MENTAL TYPEWRITER HEX-O-SPELL , 2006 .

[4]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[5]  M. Slater,et al.  Control of a Smart Home with a Brain-Computer Interface , 2008 .

[6]  Alfons Schuster.  Robust Intelligent Systems , 2008 .

[7]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[8]  S. P. Levine,et al.  Voice control of a powered wheelchair , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  José del R. Millán,et al.  Non-Invasive Brain Computer Interface for Mental Control of a Simulated Wheelchair , 2006 .

[10]  Marina L. Gavrilova,et al.  Two Algorithms for Computing the Euclidean Distance Transform , 2001, Int. J. Image Graph..

[11]  D. Regan.  Human brain electrophysiology: Evoked potentials and evoked magnetic fields in science and medicine , 1989 .

[12]  U. Frese,et al.  Applying a 3DOF Orientation Tracker as a Human-Robot Interface for Autonomous Wheelchairs , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[13]  Cuntai Guan,et al.  Controlling a wheelchair using a BCI with low information transfer rate , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[14]  Alberto Elfes,et al.  Using occupancy grids for mobile robot perception and navigation , 1989, Computer.

[15]  Wolfram Burgard,et al.  Improved Techniques for Grid Mapping With Rao-Blackwellized Particle Filters , 2007, IEEE Transactions on Robotics.

[16]  R. Simpson.  Smart wheelchairs: A literature review. , 2005, Journal of rehabilitation research and development.

[17]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[18]  Javier Minguez,et al.  A "divide and conquer" strategy based on situations to achieve reactive collision avoidance in troublesome scenarios , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[19]  C. Herrmann.  Human EEG responses to 1–100 Hz flicker: resonance phenomena in visual cortex and their potential correlation to cognitive phenomena , 2001, Experimental Brain Research.

[20]  Xiaorong Gao,et al.  Design and implementation of a brain-computer interface with high transfer rates , 2002, IEEE Transactions on Biomedical Engineering.

[21]  Axel Lankenau,et al.  Smart Wheelchairs - State of the Art in an Emerging Market , 2000, Künstliche Intell..

[22]  Bernd Krieg-Brückner,et al.  Modelling Route Instructions for Robust Human-Robot Interaction on Navigation Tasks , 2008, Int. J. Softw. Informatics.

[23]  Thomas Röfer,et al.  GermanTeam 2001 , 2001, RoboCup.

[24]  Ettore Lettich,et al.  Ten Percent Electrode System for Topographic Studies of Spontaneous and Evoked EEG Activities , 1985 .

[25]  Christian Mandel,et al.  Robot Navigation based on the Mapping of Coarse Qualitative Route Descriptions to Route Graphs , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Alberto Elfes,et al.  Occupancy grids: a probabilistic framework for robot perception and navigation , 1989 .

[27]  Till Mossakowski,et al.  Specification of an Ontology for Route Graphs , 2004, Spatial Cognition.

[28]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[29]  Javier Minguez,et al.  Nearness diagram (ND) navigation: collision avoidance in troublesome scenarios , 2004, IEEE Transactions on Robotics and Automation.

[30]  A. Graser,et al.  Brain-Computer Interface for high-level control of rehabilitation robotic systems , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[31]  R. Silberstein,et al.  Steady-state visual evoked potentials and travelling waves , 2000, Clinical Neurophysiology.

[32]  Gernot R. Müller-Putz,et al.  Control of an Electrical Prosthesis With an SSVEP-Based BCI , 2008, IEEE Transactions on Biomedical Engineering.

[33]  A. Graser,et al.  Spelling with Steady-State Visual Evoked Potentials , 2007, 2007 3rd International IEEE/EMBS Conference on Neural Engineering.

[34]  A. Graser,et al.  Low level control in a semi-autonomous rehabilitation robotic system via a Brain-Computer Interface , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.