Teleoperation of a 7 DOF humanoid robot arm using human arm accelerations and EMG signals

We present our work on tele-operating a complex humanoid robot with the help of bio-signals collected from the operator. The frameworks (for robot vision, collision avoidance and machine learning), developed in our lab, allow for a safe interaction with the environment, when combined. This even works with noisy control signals, such as, the operator’s hand acceleration and their electromyography (EMG) signals. These bio-signals are used to execute equivalent actions (such as, reaching and grasping of objects) on the 7 DOF arm.

[1]  Roberto Merletti,et al.  Electromyography. Physiology, engineering and non invasive applications , 2005 .

[2]  Maria Bualat,et al.  Surface Telerobotics: Development and Testing of a Crew Controlled Planetary Rover System , 2013 .

[3]  Jürgen Leitner,et al.  Cartesian Genetic Programming for Image Processing , 2013 .

[4]  Nikolaos G. Tsagarakis,et al.  iCub: the design and realization of an open humanoid platform for cognitive and neuroscience research , 2007, Adv. Robotics.

[5]  Jürgen Leitner,et al.  Learning visual object detection and localisation using icVision , 2013, BICA 2013.

[6]  Thomas B. Sheridan,et al.  Telerobotics, Automation, and Human Supervisory Control , 2003 .

[7]  F. Mohd-Yasin,et al.  Techniques of EMG signal analysis: detection, processing, classification and applications , 2006, Biological Procedures Online.

[8]  James U. Korein,et al.  Robotics , 2018, IBM Syst. J..

[9]  A. Stoica,et al.  Decoding static and dynamic arm and hand gestures from the JPL BioSleeve , 2013, 2013 IEEE Aerospace Conference.

[10]  Jürgen Leitner,et al.  icVision: A modular vision system for cognitive robotics research , 2012 .

[11]  L. Petrinovich,et al.  Feedback of Speech Muscle Activity during Silent Reading: Rapid Extinction , 1966, Science.

[12]  B. Bluethmann,et al.  The Human Exploration Telerobotics project: Objectives, approach, and testing , 2012, 2012 IEEE Aerospace Conference.

[13]  Thomas B. Sheridan,et al.  Telerobotics , 1989, Autom..

[14]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[15]  Robert O. Ambrose,et al.  Robonaut 2 - The first humanoid robot in space , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[17]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[18]  Jürgen Leitner,et al.  Transferring spatial perception between robots operating in a shared workspace , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Luigi Galvani,et al.  De viribus electricitatis in motu musculari , 1967 .

[20]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[21]  Jürgen Leitner,et al.  Mars terrain image classification using Cartesian genetic programming , 2012 .

[22]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[23]  Silvestro Micera,et al.  On the Shared Control of an EMG-Controlled Prosthetic Hand: Analysis of User–Prosthesis Interaction , 2008, IEEE Transactions on Robotics.

[24]  Jürgen Leitner,et al.  The Modular Behavioral Environment for Humanoids and other Robots (MoBeE) , 2012, ICINCO.

[25]  Giorgio Metta,et al.  YARP: Yet Another Robot Platform , 2006 .