BMI control of a third arm for multitasking

A brain-machine interface allowed participants to do a task with a robotic arm while performing a different task with their own arms. Brain-machine interface (BMI) systems have been widely studied to allow people with motor paralysis conditions to control assistive robotic devices that replace or recover lost function but not to extend the capabilities of healthy users. We report an experiment in which healthy participants were able to extend their capabilities by using a noninvasive BMI to control a human-like robotic arm and achieve multitasking. Experimental results demonstrate that participants were able to reliably control the robotic arm with the BMI to perform a goal-oriented task while simultaneously using their own arms to do a different task. This outcome opens possibilities to explore future human body augmentation applications for healthy people that not only enhance their capability to perform a particular task but also extend their physical capabilities to perform multiple tasks simultaneously.

[1]  R. Dolan,et al.  Threatening a rubber hand that you feel is yours elicits a cortical anxiety response , 2007, Proceedings of the National Academy of Sciences.

[2]  W Pieter Medendorp,et al.  Parietofrontal circuits in goal‐oriented behaviour , 2011, The European journal of neuroscience.

[3]  Luciano Boquete,et al.  Induced gamma band activity from EEG as a possible index of training-related brain plasticity in motor tasks , 2017, PloS one.

[4]  Rabab K. Ward,et al.  Comparing Different Classifiers in Sensory Motor Brain Computer Interfaces , 2015, PloS one.

[5]  Jonathan D. Cohen,et al.  Rubber hands ‘feel’ touch that eyes see , 1998, Nature.

[6]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[7]  Wanderley Cardoso Celeste,et al.  Human–machine interface based on muscular and brain signals applied to a robotic wheelchair , 2007 .

[8]  Jerry E. Pratt,et al.  The RoboKnee: an exoskeleton for enhancing strength and endurance during walking , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[9]  H. Harry Asada,et al.  Bio-Artificial Synergies for Grasp Posture Control of Supernumerary Robotic Fingers , 2014, Robotics: Science and Systems.

[10]  Matthias M. Müller,et al.  Induced gamma band responses: an early marker of memory encoding and retrieval , 2004, Neuroreport.

[11]  H. L. Oestreicher,et al.  Principles and practice of bionics , 1970 .

[12]  E Donchin,et al.  The mental prosthesis: assessing the speed of a P300-based brain-computer interface. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[13]  David M. Santucci,et al.  Learning to Control a Brain–Machine Interface for Reaching and Grasping by Primates , 2003, PLoS biology.

[14]  Michael D'Zmura,et al.  Decoding Attentional Orientation from EEG Spectra , 2009, HCI.

[15]  H. Harry Asada,et al.  Dynamic analysis and state estimation for wearable robotic limbs subject to human-induced disturbances , 2013, 2013 IEEE International Conference on Robotics and Automation.

[16]  C. Neuper,et al.  Sensorimotor rhythm-based brain–computer interface training: the impact on motor cortical responsiveness , 2011, Journal of neural engineering.

[17]  S. Bentin,et al.  Dissociated neural mechanisms for face detection and configural encoding: evidence from N170 and induced gamma-band oscillation effects. , 2007, Cerebral cortex.

[18]  Pascal Fries,et al.  Visual stimulus eccentricity affects human gamma peak frequency , 2013, NeuroImage.

[19]  L. Zollo,et al.  Augmentation-related brain plasticity , 2014, Front. Syst. Neurosci..

[20]  Shuichi Nishio,et al.  Body Ownership Transfer to Teleoperated Android Robot , 2012, ICSR.

[21]  H. Harry Asada,et al.  Bracing the human body with supernumerary Robotic Limbs for physical assistance and load reduction , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Mason Bretan,et al.  A Robotic Prosthesis for an Amputee Drummer , 2016, ArXiv.

[23]  Shuichi Nishio,et al.  Humanlike robot hands controlled by brain activity arouse illusion of ownership in operators , 2013, Scientific Reports.

[24]  Toshiyuki Kondo,et al.  Modulation of event-related desynchronization during kinematic and kinetic hand movements , 2014, Journal of NeuroEngineering and Rehabilitation.

[25]  Shuichi Nishio,et al.  Effect of social interaction on Body Ownership Transfer to teleoperated android , 2013, 2013 IEEE RO-MAN.

[26]  K. Reinikainen,et al.  Selective attention enhances the auditory 40-Hz transient response in humans , 1993, Nature.

[27]  Shuichi Nishio,et al.  Body Ownership Transfer to a Teleoperated Android , 2013 .

[28]  Federico Parietti,et al.  Demonstration-based control of supernumerary robotic limbs , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Carlo Menon,et al.  EEG Classification of Different Imaginary Movements within the Same Limb , 2015, PloS one.

[30]  Matthias M. Müller,et al.  Oscillatory brain activity dissociates between associative stimulus content in a repetition priming task in the human EEG. , 2004, Cerebral cortex.

[31]  J. Hartigan,et al.  The Dip Test of Unimodality , 1985 .

[32]  Shuichi Nishio,et al.  Effect of biased feedback on motor imagery learning in BCI-teleoperation system , 2014, Front. Syst. Neurosci..