A Synergetic Brain-Machine Interfacing Paradigm for Multi-DOF Robot Control

This paper proposes a novel brain-machine interfacing (BMI) paradigm for control of a multijoint redundant robot system. Here, the user would determine the direction of end-point movement of a 3-degrees of freedom (DOF) robot arm using motor imagery electroencephalography signal with co-adaptive decoder (adaptivity between the user and the decoder) while a synergetic motor learning algorithm manages a peripheral redundancy in multi-DOF joints toward energy optimality through tacit learning. As in human motor control, torque control paradigm is employed for a robot to be adaptive to the given physical environment. The dynamic condition of the robot arm is taken into consideration by the learning algorithm. Thus, the user needs to only think about the end-point movement of the robot arm, which allows simultaneous multijoints control by BMI. The support vector machine-based decoder designed in this paper is adaptive to the changing mental state of the user. Online experiments reveals that the users successfully reach their targets with an average decoder accuracy of over 75% in different end-point load conditions.

[1]  M. Kawato,et al.  Formation and control of optimal trajectory in human multijoint arm movement , 1989, Biological Cybernetics.

[2]  Remco R. Bouckaert,et al.  Choosing Between Two Learning Algorithms Based on Calibrated Tests , 2003, ICML.

[3]  D. N. Tibarewala,et al.  EEG controlled remote robotic system from motor imagery classification , 2012, 2012 Third International Conference on Computing, Communication and Networking Technologies (ICCCNT'12).

[4]  Eric Leuthardt,et al.  An EEG-based brain computer interface for rehabilitation and restoration of hand control following stroke using ipsilateral cortical physiology , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[6]  S. Coyle,et al.  Brain–computer interfaces: a review , 2003 .

[7]  Daniel J. Barrett,et al.  SSH, The Secure Shell: The Definitive Guide , 2001 .

[8]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[9]  Brian Y. Hwang,et al.  Brain-computer interfaces: military, neurosurgical, and ethical perspective. , 2010, Neurosurgical focus.

[10]  José Carlos Príncipe,et al.  Coadaptive Brain–Machine Interface via Reinforcement Learning , 2009, IEEE Transactions on Biomedical Engineering.

[11]  Horst Bischof,et al.  Toward Self-Paced Brain–Computer Communication: Navigation Through Virtual Worlds , 2008, IEEE Transactions on Biomedical Engineering.

[12]  Yuanqing Li,et al.  A Hybrid Brain Computer Interface to Control the Direction and Speed of a Simulated or Real Wheelchair , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  John W. Krakauer,et al.  Independent learning of internal models for kinematic and dynamic control of reaching , 1999, Nature Neuroscience.

[14]  Dennis J. McFarland,et al.  Brain-Computer Interface Operation of Robotic and Prosthetic Devices , 2008, Computer.

[15]  D. Liberati,et al.  Brain Computer Interfacing , 2007 .

[16]  C. Neuper,et al.  Combining Brain–Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges , 2010, Front. Neurosci..

[17]  D. Wolpert,et al.  Internal models in the cerebellum , 1998, Trends in Cognitive Sciences.

[18]  N. Chumerin,et al.  Designing a brain-computer interface controlled video-game using consumer grade EEG hardware , 2012, 2012 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[19]  Dennis J. McFarland,et al.  Brain–computer interfaces for communication and control , 2002, Clinical Neurophysiology.

[20]  Zhan Li,et al.  Muscle Fatigue Tracking with Evoked EMG via Recurrent Neural Network: Toward Personalized Neuroprosthetics , 2014, IEEE Computational Intelligence Magazine.

[21]  Ethem Alpaydin,et al.  Introduction to Machine Learning (Adaptive Computation and Machine Learning) , 2004 .

[22]  R. McN. Alexander,et al.  A minimum energy cost hypothesis for human arm trajectories , 1997, Biological Cybernetics.

[23]  Amit Konar,et al.  Motor imagery, P300 and error-related EEG-based robot arm movement control for rehabilitation purpose , 2014, Medical & Biological Engineering & Computing.

[24]  T.M. McGinnity,et al.  Comparative Analysis of Spectral Approaches to Feature Extraction for EEG-Based Motor Imagery Classification , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  A. Al-Ani,et al.  Brain-Computer Interface Analysis using Continuous Wavelet Transform and Adaptive Neuro-Fuzzy Classifier , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Hidenori Kimura,et al.  Adaptability of Tacit Learning in Bipedal Locomotion , 2013, IEEE Transactions on Autonomous Mental Development.

[27]  Shingo Shimoda,et al.  Synergetic motor control paradigm for optimizing energy efficiency of multijoint reaching via tacit learning , 2014, Front. Comput. Neurosci..

[28]  Peng Hu,et al.  Experiment study of the relation between motion complexity and event-related desynchronization/synchronization , 2005, Proceedings. 2005 First International Conference on Neural Interface and Control, 2005..

[29]  Eric O. Postma,et al.  Dimensionality Reduction: A Comparative Review , 2008 .

[30]  Amit Konar,et al.  Interval type-2 fuzzy logic based multiclass ANFIS algorithm for real-time EEG based movement control of a robot arm , 2015, Robotics Auton. Syst..

[31]  Reinhold Scherer,et al.  A Co-Adaptive Brain-Computer Interface for End Users with Severe Motor Impairment , 2014, PloS one.

[32]  James A. Bucklew,et al.  Support vector machine techniques for nonlinear equalization , 2000, IEEE Trans. Signal Process..

[33]  Damien Coyle,et al.  Games, Gameplay, and BCI: The State of the Art , 2013, IEEE Transactions on Computational Intelligence and AI in Games.

[34]  Alexander Rm,et al.  A minimum energy cost hypothesis for human arm trajectories. , 1997 .

[35]  Rajesh P. N. Rao,et al.  Brain-Computer Interfacing , 2010 .

[36]  K. S. Jaichandar,et al.  Telepresence by deploying an avatar robot with brain-robot interfacing , 2012, 2012 7th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[37]  Dario Farina,et al.  Editorial: Biosignal processing and computational methods to enhance sensory motor neuroprosthetics , 2015, Front. Neurosci..

[38]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  Jun Nakanishi,et al.  Operational Space Control: A Theoretical and Empirical Comparison , 2008, Int. J. Robotics Res..

[40]  R. Scherer,et al.  Online co-adaptive brain-computer interfacing: Preliminary results in individuals with spinal cord injury , 2013, 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER).

[41]  M. Nuttin,et al.  A brain-actuated wheelchair: Asynchronous and non-invasive Brain–computer interfaces for continuous control of robots , 2008, Clinical Neurophysiology.

[42]  Ajith Pasqual,et al.  Online classification of imagined hand movement using a consumer grade EEG device , 2013, 2013 IEEE 8th International Conference on Industrial and Information Systems.

[43]  Mikhail Belkin,et al.  Laplacian Eigenmaps for Dimensionality Reduction and Data Representation , 2003, Neural Computation.

[44]  Rajesh P. N. Rao,et al.  Probabilistic co-adaptive brain–computer interfacing , 2013, Journal of neural engineering.

[45]  J. Zygierewicz,et al.  Asynchronous BCI Based on Motor Imagery With Automated Calibration and Neurofeedback Training , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[46]  Jaeseung Jeong,et al.  Toward Brain-Actuated Humanoid Robots: Asynchronous Direct Control Using an EEG-Based BCI , 2012, IEEE Transactions on Robotics.

[47]  Nathan E. Bunderson.  Real-Time Control of an Interactive Impulsive Virtual Prosthesis , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  T. Martin McGinnity,et al.  EEG-based continuous control of a game using a 3 channel motor imagery BCI: BCI game , 2011, 2011 IEEE Symposium on Computational Intelligence, Cognitive Algorithms, Mind, and Brain (CCMB).

[49]  J. Wolpaw,et al.  Brain–computer interfaces in neurological rehabilitation , 2008, The Lancet Neurology.

[50]  José del R. Millán,et al.  Noninvasive brain-actuated control of a mobile robot by human EEG , 2004, IEEE Transactions on Biomedical Engineering.

[51]  Stefan Schaal,et al.  Learning to Control in Operational Space , 2008, Int. J. Robotics Res..

[52]  F A Mussa-Ivaldi,et al.  Computations underlying the execution of movement: a biological perspective. , 1991, Science.

[53]  I K Fodor,et al.  A Survey of Dimension Reduction Techniques , 2002 .

[54]  Liqing Zhang,et al.  Bilateral adaptation and neurofeedback for brain computer interface system , 2010, Journal of Neuroscience Methods.

[55]  German Castellanos-Dominguez,et al.  Motor imagery classification using feature relevance analysis: An Emotiv-based BCI system , 2014, 2014 XIX Symposium on Image, Signal Processing and Artificial Vision.

[56]  Gary E. Birch,et al.  Comparison of Evaluation Metrics in Classification Applications with Imbalanced Datasets , 2008, 2008 Seventh International Conference on Machine Learning and Applications.

[57]  D. N. Tibarewala,et al.  A differential evolution based energy trajectory planner for artificial limb control using motor imagery EEG signal , 2014, Biomed. Signal Process. Control..

[58]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[59]  宇野 洋二,et al.  Formation and control of optimal trajectory in human multijoint arm movement : minimum torque-change model , 1988 .