Assistive Robot Arm Controlled by a P300-based Brain Machine Interface for Daily Activities

This work proposes an assistive system for everyday activities composed by a brain machine interface (BMI) based on P300 to choose a predefined task, a robot arm to perform the chosen task, and a stereo vision subsystem developed with two cameras for object recognition and coordinates calculation. The system was tested with eight healthy subjects; its results were greater BMI accuracies, lower 3D coordinates calculation error, and lower task execution time than similar systems. However, it should be tested with disabled subjects to provide more reliable end-user results. Regardless, this system is suitable to assist healthy subjects for performing reaching task to grasp objects in daily activities, and the intuitive interface would be useful for disabled subjects.

[1]  Trieu Phat Luu,et al.  Brain–machine interfaces for controlling lower-limb powered robotic systems , 2018, Journal of neural engineering.

[2]  José del R. Millán,et al.  Brain-Controlled Wheelchairs: A Robotic Architecture , 2013, IEEE Robotics & Automation Magazine.

[3]  M. Fornage,et al.  Heart Disease and Stroke Statistics—2017 Update: A Report From the American Heart Association , 2017, Circulation.

[4]  Shingo Shimoda,et al.  A Synergetic Brain-Machine Interfacing Paradigm for Multi-DOF Robot Control , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[5]  Wei Li,et al.  Comparative Study of SSVEP- and P300-Based Models for the Telepresence Control of Humanoid Robots , 2015, PloS one.

[6]  S. Kranz.  Upper Extremity Function in Stroke Subjects: Relationships between the International Classification of Functioning, Disability, and Health Domains , 2012 .

[7]  Milan Simic,et al.  EEG-Based BCI Control Schemes for Lower-Limb Assistive-Robots , 2018, Front. Hum. Neurosci..

[8]  Touradj Ebrahimi,et al.  An efficient P300-based brain–computer interface for disabled subjects , 2008, Journal of Neuroscience Methods.

[9]  Mitsuhiro Hayashibe,et al.  Immersive Virtual Reality Feedback in a Brain Computer Interface for Upper Limb Rehabilitation , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[10]  C Grozea,et al.  On the feasibility of using motor imagery EEG-based brain–computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up , 2012, Spinal Cord.

[11]  Brice Rebsamen,et al.  A brain controlled wheelchair to navigate in familiar environments. , 2010, IEEE transactions on neural systems and rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[12]  Axel Gräser,et al.  A BCI-controlled robotic assistant for quadriplegic people in domestic and professional life , 2011, Robotica.

[13]  Gianluca Antonelli,et al.  Assistive robot operated via P300-based brain computer interface , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).