Toward a Human-Machine Interface Based on Electrical Impedance Tomography for Robotic Manipulator Control

In this study, we proposed a novel human-machine interface (HMI) for robotic manipulator control. The specific target was to adjust the impedance coefficients of the robot controller in real time by measuring the human forearm muscle contractions. We firstly designed a HMI system. Different from the frequently used sEMG technologies, the interface in our study could detect muscle morphological changes within the skin by the electrical impedance tomography (EIT). The sensing front-end was a soft elastic fabric band which was compatible to different arm shapes. With the specific designed sensing hardware and the re-construction algorithms, EIT images indicating forearm muscle shapes were obtained. We then designed a hybrid positon/impedance controller on a UR5 with the impedance coefficients being tuned in real time by the grasp force estimation. A sigmoid regression algorithm was used to map the EIT images to the grasp forces. After implementation of the whole system, two experiments were carried out. The first experiment was the off-line grasp force estimation. With the 1:1 cross validation, an average R2 of $0.83 \pm 0.04$ and an average of the relative root mean square error (RRMSE) of $0.31 \pm 0.10$ across 5 subjects were yielded. The second experiment was the real-time robot control. Trajectory tracking task with dynamic uncertainties were investigated and grasp forces were estimated in real-time. With higher muscle contraction levels, smaller position errors were observed and shorter time was needed to return to the expected trajectory when there were external disturbances. The results proved the feasibility of the new approach on human-robot interaction tasks. Future endeavours will be made to get more promising results.

[1]  Yang Zhang,et al.  Advancing Hand Gesture Recognition with High Resolution Electrical Impedance Tomography , 2016, UIST.

[2]  Arash Ajoudani,et al.  Transferring Human Impedance Regulation Skills to Robots , 2015, Springer Tracts in Advanced Robotics.

[3]  L. V. Valen,et al.  Human Anatomy , 1899, Nature.

[4]  Tadej Petric,et al.  Teaching robots to cooperate with humans in dynamic manipulation tasks based on multi-modal human-in-the-loop approach , 2014, Auton. Robots.

[5]  Keehoon Kim,et al.  Tele-operation system with reliable grasping force estimation to compensate for the time-varying sEMG feature , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Andy Adler,et al.  Electrical Impedance Tomography: Tissue Properties to Image Measures , 2017, IEEE Transactions on Biomedical Engineering.

[7]  Arash Ajoudani,et al.  A Human–Robot Co-Manipulation Approach Based on Human Sensorimotor Information , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[8]  Cheng Fang,et al.  A DMPs-Based Framework for Robot Learning and Generalization of Humanlike Variable Impedance Skills , 2018, IEEE/ASME Transactions on Mechatronics.

[9]  Xingguang Duan,et al.  Interaction Control for Manipulator with compliant end-effector based on hybrid position-force control , 2017, 2017 IEEE International Conference on Mechatronics and Automation (ICMA).

[10]  Dario Farina,et al.  High-Density Electromyography and Motor Skill Learning for Robust Long-Term Control of a 7-DoF Robot Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[11]  Richard H. Bayford,et al.  Towards a High Accuracy Wearable Hand Gesture Recognition System Using EIT , 2018, 2018 IEEE International Symposium on Circuits and Systems (ISCAS).

[12]  Panagiotis K. Artemiadis,et al.  A Learning Scheme for Reach to Grasp Movements: On EMG-Based Interfaces Using Task Specific Motion Decoding Models , 2013, IEEE Journal of Biomedical and Health Informatics.

[13]  Todd A. Kuiken,et al.  The Effects of Electrode Size and Orientation on the Sensitivity of Myoelectric Pattern Recognition Systems to Electrode Shift , 2011, IEEE Transactions on Biomedical Engineering.

[14]  Samia Nefti-Meziani,et al.  A Quantitative Evaluation of Drive Pattern Selection for Optimizing EIT-Based Stretchable Sensors , 2017, Sensors.

[15]  Andy Adler,et al.  Electrical impedance tomography: regularized imaging and contrast detection , 1996, IEEE Trans. Medical Imaging.

[16]  Steffen Leonhardt,et al.  Chest electrical impedance tomography examination, data analysis, terminology, clinical use and recommendations: consensus statement of the TRanslational EIT developmeNt stuDy group , 2016, Thorax.

[17]  J.W. Sensinger,et al.  Adaptive Pattern Recognition of Myoelectric Signals: Exploration of Conceptual Framework and Practical Algorithms , 2009, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  William R B Lionheart,et al.  Uses and abuses of EIDORS: an extensible software base for EIT , 2006, Physiological measurement.

[19]  Rieko Osu,et al.  CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm , 2008, The Journal of Neuroscience.

[20]  Alessandra Pedrocchi,et al.  Robustness and Reliability of Synergy-Based Myocontrol of a Multiple Degree of Freedom Robotic Arm , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Manuel G. Catalano,et al.  Simplifying Telerobotics: Wearability and Teleimpedance Improves Human-Robot Interactions in Teleoperation , 2018, IEEE Robotics & Automation Magazine.

[22]  Andy Adler,et al.  Impact of Model Shape Mismatch on Reconstruction Quality in Electrical Impedance Tomography , 2012, IEEE Transactions on Medical Imaging.

[23]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[24]  Enhao Zheng,et al.  Identification of the relationships between noncontact capacitive sensing signals and continuous grasp forces: Preliminary study , 2018, Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Enhao Zheng,et al.  Forearm Motion Recognition With Noncontact Capacitive Sensing , 2018, Front. Neurorobot..

[26]  Nikolaos G. Tsagarakis,et al.  Towards multi-modal intention interfaces for human-robot co-manipulation , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  C. Castellini,et al.  Using Ultrasound Images of the Forearm to Predict Finger Positions , 2012, IEEE Transactions on Neural Systems and Rehabilitation Engineering.