Indoor Navigation for Assistive Robots using EEG Signals as Feedback

Assistive robots are used by various individuals with medical disabilities to help with tasks such as movement. A subset of these individuals are patients with the locked-in syndrome; these patients cannot communicate with a robot through traditional means, such as with a joystick. This work designs a navigation scheme which allows for an assistive robot to be controlled by patients suffering locked-in syndrome, thus allowing the patient to move about their environment. Navigation is accomplished using an algorithm that combines autonomous robot movement and communicated commands from the patient. To bridge the communication gap between the patient and robot, naturally occurring error-related potentials are used. These ERPs can be used to establish communication between the patient and robot without relying on the patient interacting with physical stimuli, such as a keyboard or joystick. The commands communicated to the robot comes in the form of a binary: correct or incorrect command in response to the movements of the robot at an intersection in a structured building. While more complicated commands can be classified from event-realted potentials (ERPs), such as directional movement, this simple command allows for fast reliable classifications and responses. To make up for the lack of complexity from patient commands, the robot is leveraged to handle tasks such as wall avoidance, while a navigation algorithm is designed to minimize the inputs required by the user when taking a commonly traveled path. The benefits of using a semi-controlled robot for navigation vs a fully autonomous robot is compared in terms of the time taken to discover and navigate an initial path to a destination. This work serves as a proof of concept for the proposed semi-autonomous navigation scheme to validate future work into the proposed design.

[1]  Stevo Bozinovski,et al.  Brain–Computer Interface in Europe: the thirtieth anniversary , 2019 .

[2]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[3]  Ricardo Chavarriaga,et al.  Decoding fast-paced error-related potentials in monitoring protocols , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  S. Bozinovski,et al.  Mobile Robot Trajectory Control: From Fixed Rails to Direct Bioelectric Control , 1990, Proceedings of the IEEE International Workshop on Intelligent Motion Control.

[5]  K. Lafleur,et al.  Quadcopter control in three-dimensional space using a noninvasive motor imagery-based brain–computer interface , 2013, Journal of neural engineering.

[6]  James M. Conrad,et al.  Classification of Error Related Potentials using Convolutional Neural Networks , 2019, 2019 9th International Conference on Cloud Computing, Data Science & Engineering (Confluence).

[7]  Wolfram Burgard,et al.  Guess What I Attend: Interface-Free Object Selection Using Brain Signals , 2018, 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[8]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces: a 10 year update , 2018, Journal of neural engineering.

[9]  Ricardo Chavarriaga,et al.  Errare machinale est: the use of error-related potentials in brain-machine interfaces , 2014, Front. Neurosci..

[10]  José del R. Millán,et al.  Error-Related EEG Potentials Generated During Simulated Brain–Computer Interaction , 2008, IEEE Transactions on Biomedical Engineering.

[11]  M. Grabois,et al.  Locked-in syndrome: a review of 139 cases. , 1986, Stroke.

[12]  Joseph DelPreto,et al.  Correcting robot mistakes in real time using EEG signals , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Klas Ihme,et al.  Error-related EEG patterns during tactile human-machine interaction , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[14]  J. Wolpaw,et al.  Brain-computer communication: unlocking the locked in. , 2001, Psychological bulletin.

[15]  Gordon Cheng,et al.  A neuro-based method for detecting context-dependent erroneous robot action , 2016, 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids).

[16]  M. Abdelguerfi,et al.  Introduction 1.2 Parallel Database Systems 1.2.1 Computation Model 2 1.2 Parallel Database Systems Introduction Select * from Employee, Department Where (employee.dept_no @bullet Department.dept_no) and (employee.position = "manager") (a) Sql Request 1.2.2 Engineering Model , 2022 .

[17]  Tonio Ball,et al.  Deep learning with convolutional neural networks for decoding and visualization of EEG pathology , 2017, 2017 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[18]  James M. Conrad,et al.  A survey of brain computer interfaces and their applications , 2014, IEEE SOUTHEASTCON 2014.

[19]  Iñaki Iturrate,et al.  EEG single-trial classification of visual, auditive and vibratory feedback potentials in Brain-Computer Interfaces , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Francisco Bonin-Font,et al.  Visual Navigation for Mobile Robots: A Survey , 2008, J. Intell. Robotic Syst..

[21]  Roland Siegwart,et al.  Article in Press Robotics and Autonomous Systems ( ) – Robotics and Autonomous Systems Brain-coupled Interaction for Semi-autonomous Navigation of an Assistive Robot , 2022 .

[22]  Leonardo S. Mattos,et al.  Does tactile feedback enhance single-trial detection of error-related eeg potentials? , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[23]  R Chavarriaga,et al.  EEG-based decoding of error-related brain activity in a real-world driving task , 2015, Journal of neural engineering.

[24]  R Chavarriaga,et al.  Learning From EEG Error-Related Potentials in Noninvasive Brain-Computer Interfaces , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  William Harwin,et al.  Devices for assisting manipulation: a summary of user task priorities , 1994 .

[27]  S. Bozinovski,et al.  Using EEG alpha rhythm to control a mobile robot , 1988, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[29]  V. Sinha,et al.  Event-related potential: An overview , 2009, Industrial psychiatry journal.

[30]  Fumitoshi Matsuno,et al.  A Novel EOG/EEG Hybrid Human–Machine Interface Adopting Eye Movements and ERPs: Application to Robot Control , 2015, IEEE Transactions on Biomedical Engineering.

[31]  George K. Matsopoulos,et al.  Classification of Error-Related Negativity (ERN) and Positivity (Pe) potentials using kNN and Support Vector Machines , 2011, Comput. Biol. Medicine.

[32]  B. Geethanjali,et al.  Head Movement Based Assist System for Physically Challenged , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[33]  Shuicheng Yan,et al.  Parallel convolutional-linear neural network for motor imagery classification , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).