Brain-machine interfacing control of whole-body humanoid motion

We propose to tackle in this paper the problem of controlling whole-body humanoid robot behavior through non-invasive brain-machine interfacing (BMI), motivated by the perspective of mapping human motor control strategies to human-like mechanical avatar. Our solution is based on the adequate reduction of the controllable dimensionality of a high-DOF humanoid motion in line with the state-of-the-art possibilities of non-invasive BMI technologies, leaving the complement subspace part of the motion to be planned and executed by an autonomous humanoid whole-body motion planning and control framework. The results are shown in full physics-based simulation of a 36-degree-of-freedom humanoid motion controlled by a user through EEG-extracted brain signals generated with motor imagery task.

[1]  John L. Prince,et al.  Discussion and Future Work , 1994 .

[2]  B. Faverjon,et al.  A local based approach for path planning of manipulators with a high number of degrees of freedom , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[3]  Thomas Brandt,et al.  Real versus imagined locomotion: A [18F]-FDG PET-fMRI comparison , 2010, NeuroImage.

[4]  Kazuhito Yokoi,et al.  Dynamic simulator for humanoids using constraint-based method with static friction , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[5]  Rajesh P. N. Rao,et al.  An adaptive brain-computer interface for humanoid robot control , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[6]  Fumitoshi Matsuno,et al.  EOG/ERP hybrid human-machine interface for robot control , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Rajesh P. N. Rao,et al.  Control of a humanoid robot by a noninvasive brain–computer interface in humans , 2008, Journal of neural engineering.

[8]  K. Kubota,et al.  Cortical Mapping of Gait in Humans: A Near-Infrared Spectroscopic Topography Study , 2001, NeuroImage.

[9]  Wojciech Samek,et al.  Transferring Subspaces Between Subjects in Brain--Computer Interfacing , 2012, IEEE Transactions on Biomedical Engineering.

[10]  Patrik Vuilleumier,et al.  The influence of individual motor imagery ability on cerebral recruitment during gait imagery , 2014, Human brain mapping.

[11]  Kazuhito Yokoi,et al.  Reactive biped walking control for a collision of a swinging foot on uneven terrain , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[12]  Atsuo Takanishi,et al.  Landing Pattern Modification Method with Predictive Attitude and Compliance Control to Deal with Uneven Terrain , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Masayuki Inaba,et al.  Dynamically-Stable Motion Planning for Humanoid Robots , 2002, Auton. Robots.

[14]  Abderrahmane Kheddar,et al.  Static multi-contact inverse problem for multiple humanoid robots and manipulated objects , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[15]  Andrei Herdt,et al.  Online Walking Motion Generation with Automatic Footstep Placement , 2010, Adv. Robotics.

[16]  Yasuharu Koike,et al.  Reconstruction of flexor and extensor muscle activities from electroencephalography cortical currents , 2012, NeuroImage.

[17]  Timothy Bretl,et al.  Motion Planning for Legged Robots on Varied Terrain , 2008, Int. J. Robotics Res..

[18]  Rajesh P. N. Rao,et al.  Cortical activity during motor execution, motor imagery, and imagery-based online feedback , 2010, Proceedings of the National Academy of Sciences.

[19]  Helge J. Ritter,et al.  A hybrid brain interface for a humanoid robot assistant , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Abderrahmane Kheddar,et al.  Multi-contact stances planning for multiple agents , 2011, 2011 IEEE International Conference on Robotics and Automation.

[21]  Eiichi Yoshida,et al.  Task-driven Support Polygon Reshaping for Humanoids , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[22]  Katsu Yamane,et al.  Synthesizing animations of human manipulation tasks , 2004, ACM Trans. Graph..

[23]  Jean-Rémy Chardonnet,et al.  Interactive Dynamic Simulator for Multibody Systems , 2012, Int. J. Humanoid Robotics.

[24]  Masayuki Inaba,et al.  Footstep planning among obstacles for biped robots , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[25]  Jun Morimoto,et al.  Brain-controlled exoskeleton robot for BMI rehabilitation , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[26]  Abderrahmane Kheddar,et al.  Using brain-computer interface to steer a humanoid robot , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[27]  Jonathan R Wolpaw,et al.  Control of a two-dimensional movement signal by a noninvasive brain-computer interface in humans. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Rajesh P. N. Rao,et al.  A Hierarchical Architecture for Adaptive Brain-Computer Interfacing , 2011, IJCAI.

[29]  H. Ritter,et al.  Asynchronous, parallel on-line classification of P300 and ERD for an efficient hybrid BCI , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[30]  Klaus-Robert Müller,et al.  A regularized discriminative framework for EEG analysis with application to brain–computer interface , 2010, NeuroImage.

[31]  Kazuhito Yokoi,et al.  Whole-Body Locomotion, Manipulation and Reaching for Humanoids , 2008, MIG.

[32]  Atsuo Takanishi,et al.  Development of a biped walking robot adapting to a horizontally uneven surface , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[33]  Hun-ok Lim,et al.  Development of a biped walking robot , 2007, 2007 International Conference on Control, Automation and Systems.

[34]  Kazuyuki Aihara,et al.  Classifying matrices with a spectral regularization , 2007, ICML '07.

[35]  J. Chestnutt,et al.  Planning Biped Navigation Strategies in Complex Environments , 2003 .

[36]  Abderrahmane Kheddar,et al.  Using a multi-objective controller to synthesize simulated humanoid robot motion with changing contact configurations , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Abderrahmane Kheddar,et al.  Humanoid Robot Locomotion and Manipulation Step Planning , 2012, Adv. Robotics.