Android Feedback-Based Training Modulates Sensorimotor Rhythms During Motor Imagery

EEG-based brain computer interface (BCI) systems have demonstrated potential to assist patients with devastating motor paralysis conditions. However, there is great interest in shifting the BCI trend toward applications aimed at healthy users. Although BCI operation depends on technological factors (i.e., EEG pattern classification algorithm) and human factors (i.e., how well the person can generate good quality EEG patterns), it is the latter that is least investigated. In order to control a motor imagery-based BCI, users need to learn to modulate their sensorimotor brain rhythms by practicing motor imagery using a classical training protocol with an abstract visual feedback. In this paper, we investigate a different BCI training protocol using a human-like android robot (Geminoid HI-2) to provide realistic visual feedback. The proposed training protocol addresses deficiencies of the classical approach and takes the advantage of body-abled user capabilities. Experimental results suggest that android feedback-based BCI training improves the modulation of sensorimotor rhythms during motor imagery task. Moreover, we discuss how the influence of body ownership transfer illusion toward the android might have an effect on the modulation of event-related desynchronization/synchronization activity.

[1]  Shuichi Nishio,et al.  Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators , 2013, Scientific Reports.

[2]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[3]  G. Rizzolatti,et al.  Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study , 2001, The European journal of neuroscience.

[4]  Michael S. Lazar,et al.  Spatial patterns underlying population differences in the background EEG , 2005, Brain Topography.

[5]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[6]  Akio Kimura,et al.  Change in brain activity through virtual reality-based brain-machine communication in a chronic tetraplegic subject with muscular dystrophy , 2010, BMC Neuroscience.

[7]  Anatole Lécuyer,et al.  Combining BCI with Virtual Reality: Towards New Applications and Improved BCI , 2012 .

[8]  Shuichi Nishio,et al.  Body Ownership Transfer to Teleoperated Android Robot , 2012, ICSR.

[9]  J. Peters,et al.  Closing the sensorimotor loop: haptic feedback facilitates decoding of motor imagery , 2011, Journal of neural engineering.

[10]  G. Rizzolatti,et al.  Activation of human primary motor cortex during action observation: a neuromagnetic study. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Shuichi Nishio,et al.  Effect of biased feedback on motor imagery learning in BCI-teleoperation system , 2014, Front. Syst. Neurosci..

[12]  N. Birbaumer,et al.  Brain-computer communication: self-regulation of slow cortical potentials for verbal communication. , 2001, Archives of physical medicine and rehabilitation.

[13]  Christian Mühl,et al.  Flaws in current human training protocols for spontaneous Brain-Computer Interfaces: lessons learned from instructional design , 2013, Front. Hum. Neurosci..

[14]  Christa Neuper,et al.  Neurofeedback Training for BCI Control , 2009 .

[15]  Wolfgang Rosenstiel,et al.  Neural mechanisms of brain–computer interface control , 2011, NeuroImage.

[16]  Gert Pfurtscheller,et al.  EEG-based Brain-Computer Interface Using Subject-Specific Spatial Filters , 1999, IWANN.

[17]  Michitaka Hirose,et al.  Brain-Computer Interfaces, Virtual Reality, and Videogames , 2008, Computer.

[18]  Klaus-Robert Müller,et al.  Neurophysiological predictor of SMR-based BCI performance , 2010, NeuroImage.

[19]  G. Pfurtscheller,et al.  Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG. , 2005, Brain research. Cognitive brain research.

[20]  Vilayanur S. Ramachandran,et al.  EEG evidence for mirror neuron activity during the observation of human and robot actions: Toward an analysis of the human qualities of interactive robots , 2007, Neurocomputing.

[21]  Tzyy-Ping Jung,et al.  Real-time modeling and 3D visualization of source dynamics and connectivity using wearable EEG , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Ad Aertsen,et al.  Review of the BCI Competition IV , 2012, Front. Neurosci..

[23]  M. Grosse-Wentrup,et al.  Biased feedback in brain-computer interfaces , 2010, Journal of NeuroEngineering and Rehabilitation.

[24]  Brendan Z. Allison,et al.  Could Anyone Use a BCI? , 2010, Brain-Computer Interfaces.

[25]  G. R. Muller,et al.  Clinical application of an EEG-based brain–computer interface: a case study in a patient with severe motor impairment , 2003, Clinical Neurophysiology.

[26]  W. A. Sarnacki,et al.  Electroencephalographic (EEG) control of three-dimensional movement , 2010, Journal of neural engineering.

[27]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[28]  J. Wolpaw,et al.  Brain-Computer Interfaces: Principles and Practice , 2012 .

[29]  Gert Pfurtscheller,et al.  Motor imagery and direct brain-computer communication , 2001, Proc. IEEE.

[30]  V. Caggiano,et al.  Proprioceptive Feedback and Brain Computer Interface (BCI) Based Neuroprostheses , 2012, PloS one.

[31]  S. Ainsworth DeFT: A Conceptual Framework for Considering Learning with Multiple Representations. , 2006 .

[32]  Antonio Frisoli,et al.  Illusory perception of arm movement induced by visuo-proprioceptive sensory stimulation and controlled by motor imagery , 2012, 2012 IEEE Haptics Symposium (HAPTICS).

[33]  G. Pfurtscheller,et al.  Motor imagery and action observation: Modulation of sensorimotor brain rhythms during mental control of a brain–computer interface , 2009, Clinical Neurophysiology.

[34]  L. Zollo,et al.  Augmentation-related brain plasticity , 2014, Front. Syst. Neurosci..