Assistive robot operated via P300-based brain computer interface

In this paper we present an architecture for the operation of an assistive robot finally aimed at allowing users with severe motion disabilities to perform manipulation tasks that may help in daily-life operations. The robotic system, based on a lightweight robot manipulator, receives high level commands from the user through a Brain-Computer Interface based on P300 paradigm. The motion of the manipulator is controlled relying on a closed loop inverse kinematic algorithm that simultaneously manages multiple set-based and equality-based tasks. The software architecture is developed relying on widely used frameworks to operate BCIs and robots (namely, BCI2000 for the operation of the BCI and ROS for the control of the manipulator) integrating control, perception and communication modules developed for the application at hand. Preliminary experiments have been conducted to show the potentialities of the developed architecture.

[1]  M. Bergamasco,et al.  A New Gaze-BCI-Driven Control of an Upper Limb Exoskeleton for Rehabilitation in Real-World Tasks , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[2]  Helge Ritter,et al.  Using a cVEP-Based Brain-Computer Interface to Control a Virtual Agent , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Helen Hoenig,et al.  Does assistive technology substitute for personal assistance among the disabled elderly? , 2003, American journal of public health.

[4]  Kristin Ytterstad Pettersen,et al.  Set-Based Tasks within the Singularity-Robust Multiple Task-Priority Inverse Kinematics Framework: General Formulation, Stability Analysis, and Experimental Results , 2016, Front. Robot. AI.

[5]  José del R. Millán,et al.  Towards Independence: A BCI Telepresence Robot for People With Severe Motor Disabilities , 2015, Proceedings of the IEEE.

[6]  Oscar Déniz-Suárez,et al.  A comparison of face and facial feature detectors based on the Viola–Jones general object detection framework , 2011, Machine Vision and Applications.

[7]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[8]  Wolfram Burgard,et al.  New Perspectives on Neuroengineering and Neurotechnologies: NSF-DFG Workshop Report , 2016, IEEE Transactions on Biomedical Engineering.

[9]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[10]  Mahesh M. Goyani,et al.  A literature survey on Facial Expression Recognition using Global Features , 2013 .

[11]  T. Martin McGinnity,et al.  EEG-Based Mobile Robot Control Through an Adaptive Brain–Robot Interface , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[12]  Kristin Ytterstad Pettersen,et al.  Stability analysis for set-based control within the singularity-robust multiple task-priority inverse kinematics framework , 2015, 2015 54th IEEE Conference on Decision and Control (CDC).

[13]  Gianluca Antonelli,et al.  The null-space-based behavioral control for autonomous robotic systems , 2008, Intell. Serv. Robotics.

[14]  Yili Liu,et al.  EEG-Based Brain-Controlled Mobile Robots: A Survey , 2013, IEEE Transactions on Human-Machine Systems.

[15]  Wolfram Burgard,et al.  An autonomous robotic assistant for drinking , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[16]  Javier Minguez,et al.  A Telepresence Mobile Robot Controlled With a Noninvasive Brain–Computer Interface , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[17]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[18]  Dennis J. McFarland,et al.  Brain-Computer Interface Operation of Robotic and Prosthetic Devices , 2008, Computer.

[19]  Brendan Z. Allison,et al.  P300 brain computer interface: current challenges and emerging trends , 2012, Front. Neuroeng..