A BCI-controlled robotic assistant for quadriplegic people in domestic and professional life

In this paper, a Brain-Computer Interface (BCI) control approach for the assistive robotic system FRIEND is presented. The objective of the robot is to assist elderly and persons with disabilities in their daily and professional life activities. FRIEND is presented here from an architectural point of view, that is, as an overall robotic device that includes many subareas of research, such as human-robot interaction, perception, object manipulation and path planning, robotic safety, and so on. The integration of the hardware and software components is described relative to the interconnections between the various elements of FRIEND and the approach used for human-machine interaction. Since the robotic system is intended to be used especially by patients suffering from a high degree of disability (e.g., patients which are quadriplegic, have muscle diseases or serious paralysis due to strokes, or any other diseases with similar consequences for their independence), an alternative non-invasive BCI has been investigated. The FRIEND-BCI paradigm is explained within the overall structure of the robot. The capabilities of the robotic system are demonstrated in three support scenarios, one that deals with Activities of daily living (ADL) and two that are taking place in a rehabilitation workshop. The proposed robot was clinically evaluated through different tests that directly measure task execution time and hardware performance, as well as the acceptance of robot by end-users.

[1]  Klaus-Robert Müller,et al.  Playing Pinball with non-invasive BCI , 2008, NIPS.

[2]  Antonio Bicchi,et al.  Safety for Physical Human-Robot Interaction , 2008, Springer Handbook of Robotics.

[3]  G. Schalk,et al.  Evolution of brain-computer interfaces : going beyond classic motor physiology , 2009 .

[4]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[5]  J. Wolpaw,et al.  Patients with ALS can use sensorimotor rhythms to operate a brain-computer interface , 2005, Neurology.

[6]  Axel Gräser,et al.  A RRT based path planning algorithm for Rehabilitation robots , 2010, ISR/ROBOTIK.

[7]  Katherine M. Tsui,et al.  Performance Evaluation Methods for Assistive Robotic Technology , 2009 .

[8]  Ivan Volosyak,et al.  Evaluation of the Bremen SSVEP based BCI in real world conditions , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[9]  Christa Neuper,et al.  Motor imagery and EEG-based control of spelling devices and neuroprostheses. , 2006, Progress in brain research.

[10]  Oliver Prenzel.  Process model for the development of semi-autonomous service robots , 2009 .

[11]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[12]  A. Graser,et al.  Brain-Computer Interface for high-level control of rehabilitation robotic systems , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[13]  R. Silberstein,et al.  Steady-state visual evoked potentials and travelling waves , 2000, Clinical Neurophysiology.

[14]  Maria Klara Wolters,et al.  Leveraging large data sets for user requirements analysis , 2011, ASSETS.

[15]  Jonathan R Wolpaw,et al.  Brain–computer interface systems: progress and prospects , 2007, Expert review of medical devices.

[16]  Chao Wang,et al.  System-controlled user interaction within the service robotic control architecture MASSiVE , 2007, Robotica.

[17]  Christian Mandel,et al.  Navigating a smart wheelchair with a brain-computer interface interpreting steady-state visual evoked potentials , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Mel Slater,et al.  Brain-computer interfaces for goal orientated control of a virtual smart home environment , 2009, 2009 4th International IEEE/EMBS Conference on Neural Engineering.

[19]  Dong-Soo Kwon,et al.  Integration of a Rehabilitation Robotic System (KARES II) with Human-Friendly Man-Machine Interaction Units , 2004, Auton. Robots.

[20]  Raj Madhavan,et al.  Benchmarking and standardization of intelligent robotic systems , 2009, 2009 International Conference on Advanced Robotics.

[21]  Brian P. Gerkey,et al.  Sharing Software with ROS [ROS Topics] , 2010, ICRA 2010.

[22]  B. Allison,et al.  BCI Demographics: How Many (and What Kinds of) People Can Use an SSVEP BCI? , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[23]  Yijun Wang,et al.  Brain-Computer Interfaces Based on Visual Evoked Potentials , 2008, IEEE Engineering in Medicine and Biology Magazine.

[24]  Rainer Nordmann,et al.  Brain-controlled finite state machine for wheelchair navigation , 2008, Assets '08.

[25]  C. Leroux,et al.  Intuitive human interaction with an arm robot for severely handicapped people - A One Click Approach , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[26]  R. Simpson.  Smart wheelchairs: A literature review. , 2005, Journal of rehabilitation research and development.

[27]  Ivan Volosyak,et al.  Multiple Channel Detection of Steady-State Visual Evoked Potentials for Brain-Computer Interfaces , 2007, IEEE Transactions on Biomedical Engineering.

[28]  Xiaorong Gao,et al.  A BCI-based environmental controller for the motion-disabled. , 2003, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[29]  Ivan Volosyak,et al.  STEADY-STATE VISUAL EVOKED POTENTIAL RESPONSE - IMPACT OF THE TIME SEGMENT LENGTH , 2010 .

[30]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[31]  Kazuo Tanaka,et al.  Electroencephalogram-based control of an electric wheelchair , 2005, IEEE Transactions on Robotics.

[32]  Oliver Lang,et al.  A FRIEND for assisting handicapped people , 2001, IEEE Robotics Autom. Mag..

[33]  Alexander Verl,et al.  Care-O-bot® 3 - creating a product vision for service robot applications by integrating design and technology , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Katherine M. Tsui,et al.  Human-in-the-Loop Control of an Assistive Robot Arm , 2006 .

[35]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[36]  A. Graser,et al.  Low level control in a semi-autonomous rehabilitation robotic system via a Brain-Computer Interface , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[37]  Sorin M. Grigorescu.  Robust Machine Vision for Service Robotics , 2010 .