Detection of movement intention using EEG in a human-robot interaction environment

Introduction : This paper presents a detection method for upper limb movement intention as part of a brain-machine interface using EEG signals, whose final goal is to assist disabled or vulnerable people with activities of daily living. Methods EEG signals were recorded from six naive healthy volunteers while performing a motor task. Every volunteer remained in an acoustically isolated recording room. The robot was placed in front of the volunteers such that it seemed to be a mirror of their right arm, emulating a Brain Machine Interface environment. The volunteers were seated in an armchair throughout the experiment, outside the reaching area of the robot to guarantee safety. Three conditions are studied: observation, execution, and imagery of right arm’s flexion and extension movements paced by an anthropomorphic manipulator robot. The detector of movement intention uses the spectral F test for discrimination of conditions and uses as feature the desynchronization patterns found on the volunteers. Using a detector provides an objective method to acknowledge for the occurrence of movement intention. Results When using four realizations of the task, detection rates ranging from 53 to 97% were found in five of the volunteers when the movement was executed, in three of them when the movement was imagined, and in two of them when the movement was observed. Conclusions Detection rates for movement observation raises the question of how the visual feedback may affect the performance of a working brain-machine interface, posing another challenge for the upcoming interface implementation. Future developments will focus on the improvement of feature extraction and detection accuracy for movement intention using EEG data.

[1]  Mark Hallett,et al.  Exploration of computational methods for classification of movement intention during human voluntary movement from single trial EEG , 2007, Clinical Neurophysiology.

[2]  G Pfurtscheller,et al.  Discrimination between phase-locked and non-phase-locked event-related EEG activity. , 1995, Electroencephalography and clinical neurophysiology.

[3]  C. J. Tierra-Criollo,et al.  The addition of functional task-oriented mental practice to conventional physical therapy improves motor skills in daily functions after stroke , 2013, Brazilian journal of physical therapy.

[4]  M. Hallett,et al.  Prediction of human voluntary movement before it occurs , 2011, Clinical Neurophysiology.

[5]  Andrés Úbeda,et al.  Visual evoked potential-based brain-machine interface applications to assist disabled people , 2012, Expert Syst. Appl..

[6]  Bruno Vilhena Adorno,et al.  ASSISTANCE TASK USING A MANIPULATOR ROBOT AND USER KINEMATICS FEEDBACK , 2013 .

[7]  J. Millán,et al.  Detection of self-paced reaching movement intention from EEG signals , 2012, Front. Neuroeng..

[8]  Brendan Z. Allison,et al.  A hybrid ERD/SSVEP BCI for continuous simultaneous two dimensional cursor control , 2012, Journal of Neuroscience Methods.

[9]  Miguel A L Nicolelis,et al.  Seeking the neural code. , 2006, Scientific American.

[10]  Bin He,et al.  Relationship between speed and EEG activity during imagined and executed hand movements , 2010, Journal of neural engineering.

[11]  M. Hallett,et al.  Classifying EEG signals preceding right hand, left hand, tongue, and right foot movements and motor imageries , 2008, Clinical Neurophysiology.

[12]  Cyril R. Pernet,et al.  Misconceptions in the use of the General Linear Model applied to functional MRI: a tutorial for junior neuro-imagers , 2014, Front. Neurosci..

[13]  B. Kotchoubey,et al.  Event-related potentials, cognition, and behavior: A biological approach , 2006, Neuroscience & Biobehavioral Reviews.

[14]  C. J. Tierra-Criollo,et al.  Objective Response Detection in an Electroencephalogram During Somatosensory Stimulation , 2000, Annals of Biomedical Engineering.

[15]  J. Millán,et al.  Single trial prediction of self-paced reaching directions from EEG signals , 2014, Front. Neurosci..

[16]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[17]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[18]  Hubert Cecotti,et al.  Spelling with non-invasive Brain–Computer Interfaces – Current and future trends , 2011, Journal of Physiology-Paris.

[19]  A. Doud,et al.  Continuous Three-Dimensional Control of a Virtual Helicopter Using a Motor Imagery Based Brain-Computer Interface , 2011, PloS one.

[20]  C. J. Tierra-Criollo,et al.  Magnitude Squared of Coherence to Detect Imaginary Movement , 2009, EURASIP J. Adv. Signal Process..

[21]  M. Behrmann,et al.  Parietal cortex and attention , 2004, Current Opinion in Neurobiology.

[22]  G Pfurtscheller,et al.  Separability of EEG signals recorded during right and left motor imagery using adaptive autoregressive parameters. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[23]  E. J. Tehovnik,et al.  Transfer of information by BMI , 2013, Neuroscience.

[24]  E. P. Lana,et al.  An ERD/ERS analysis of the relation between human arm and robot manipulator movements , 2013, 2013 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[25]  Klaus-Robert Müller,et al.  Enhanced Performance by a Hybrid Nirs–eeg Brain Computer Interface , 2022 .

[26]  C. Nam,et al.  Event-related (De)synchronization (ERD/ERS) during motor imagery tasks: Implications for brain–computer interfaces , 2011 .

[27]  Antonio Fernando Catelli Infantosi,et al.  A Statistical Test for Evaluating the Event-Related Synchronization/Desynchronization and its Potential use in Brain-Computer-Interfaces , 2007 .

[28]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces to restore motor function and probe neural circuits , 2003, Nature Reviews Neuroscience.

[29]  Mads Jochumsen,et al.  Comparison of Features for Movement Prediction from Single-Trial Movement-Related Cortical Potentials in Healthy Subjects and Stroke Patients , 2015, Comput. Intell. Neurosci..

[30]  R. Ward,et al.  EMG and EOG artifacts in brain computer interface systems: A survey , 2007, Clinical Neurophysiology.

[31]  D. Farina,et al.  A brain–computer interface for single-trial detection of gait initiation from movement related cortical potentials , 2015, Clinical Neurophysiology.

[32]  B. Allison,et al.  The effects of self-movement, observation, and imagination on mu rhythms and readiness potentials (RP's): toward a brain-computer interface (BCI). , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[33]  D. Farina,et al.  Detection of movement intention from single-trial movement-related cortical potentials , 2011, Journal of neural engineering.

[34]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[35]  N. Birbaumer,et al.  The Influence of Psychological State and Motivation on Brain–Computer Interface Performance in Patients with Amyotrophic Lateral Sclerosis – a Longitudinal Study , 2010, Front. Neuropharma..

[36]  Brendan Z. Allison,et al.  The Hybrid BCI , 2010, Frontiers in Neuroscience.

[37]  Gabriel Curio,et al.  Quasi-movements: A novel motor–cognitive phenomenon , 2008, Neuropsychologia.

[38]  A. Fuchs,et al.  Cortical and cerebellar activity of the human brain during imagined and executed unimanual and bimanual action sequences: a functional MRI study. , 2003, Brain research. Cognitive brain research.

[39]  Eduardo Serrano,et al.  Characterization of a clinical olfactory test with an artificial nose , 2011, Front. Neuroeng..

[40]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[41]  G. Pfurtscheller,et al.  ‘Thought’ – control of functional electrical stimulation to restore hand grasp in a patient with tetraplegia , 2003, Neuroscience Letters.

[42]  Tzyy-Ping Jung,et al.  Combining ERPs and EEG spectral features for decoding intended movement direction , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[43]  C. J. Tierra-Criollo,et al.  Functional Connectivity during Elbow Movements: Comparison between Motor and Non-motor Task , 2015 .

[44]  S. Narayanamoorthy,et al.  The Intelligence of Dual Simplex Method to Solve Linear Fractional Fuzzy Transportation Problem , 2015, Comput. Intell. Neurosci..

[45]  Marcia Kilchenman O'Malley,et al.  Detecting movement intent from scalp EEG in a novel upper limb robotic rehabilitation system for stroke , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.