Real-Time Upper Limb Motion Estimation From Surface Electromyography and Joint Angular Velocities Using an Artificial Neural Network for Human–Machine Cooperation

A current challenge with human-machine cooperation systems is to estimate human motions to facilitate natural cooperation and safety of the human. It is a logical approach to estimate the motions from their sources (skeletal muscles); thus, we employed surface electromyography (SEMG) to estimate body motions. In this paper, we investigated a cooperative manipulation control by an upper limb motion estimation method using SEMG and joint angular velocities. The SEMG signals from five upper limb muscles and angular velocities of the limb joints were used to approximate the flexion-extension of the limb in the 2-D sagittal plane. The experimental results showed that the proposed estimation method provides acceptable performance of the motion estimation [normalized root mean square error (NRMSE) <;0.15, correlation coefficient (CC) >;0.9] under the noncontact condition. From the analysis of the results, we found the necessity of the angular velocity input and estimation error feedback due to physical contact. Our results suggest that the estimation method can be useful for a natural human-machine cooperation control.

[1]  Rong Song,et al.  Using recurrent artificial neural network model to estimate voluntary elbow torque in dynamic situations , 2005, Medical and Biological Engineering and Computing.

[2]  Kazuhiro Kosuge,et al.  Mobile robot helper , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[3]  Toshiyuki Kondo,et al.  Estimation of forearm movement from EMG signal and application to prosthetic hand control , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[4]  Joel C. Perry,et al.  Real-Time Myoprocessors for a Neural Controlled Powered Exoskeleton Arm , 2006, IEEE Transactions on Biomedical Engineering.

[5]  Panagiotis K. Artemiadis,et al.  Assessment of muscle fatigue using a probabilistic framework for an EMG-based robot control scenario , 2008, 2008 8th IEEE International Conference on BioInformatics and BioEngineering.

[6]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[7]  Nilanjan Sarkar,et al.  EMG-based high level human-robot interaction system for people with disability , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[8]  Carlo J. De Luca,et al.  The Use of Surface Electromyography in Biomechanics , 1997 .

[9]  Charles C. Kemp,et al.  Human-Robot Interaction for Cooperative Manipulation: Handing Objects to One Another , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Shin Ishii,et al.  Virtual Force/Tactile Sensors for Interactive Machines Using the User's Biological Signals , 2008, Adv. Robotics.

[11]  T. Kondo,et al.  Upper-limb impedance adjustment mechanism for dynamic environments , 2004, SICE 2004 Annual Conference.

[12]  P Madeleine,et al.  Mechanomyography and electromyography force relationships during concentric, isometric and eccentric contractions. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[13]  Terence D Sanger,et al.  Bayesian filtering of myoelectric signals. , 2007, Journal of neurophysiology.

[14]  Antonio Bicchi,et al.  An atlas of physical human-robot interaction , 2008 .

[15]  R. Kirsch,et al.  EMG-based prediction of shoulder and elbow kinematics in able-bodied and spinal cord injured individuals. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[16]  Jianbo Su,et al.  Basic Behavior Acquisition with Multisensor Integration for a Robot System , 2009, Adv. Robotics.

[17]  Vincenzo Lippiello,et al.  Human-robot interaction control using force and vision , 2007 .

[18]  P. Dario,et al.  Control of multifunctional prosthetic hands by processing the electromyographic signal. , 2002, Critical reviews in biomedical engineering.

[19]  T. Kuo,et al.  Isokinetic elbow joint torques estimation from surface EMG and joint kinematic data: using an artificial neural network model. , 1999, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[20]  Z. Zenn Bien,et al.  Multi sensors-based approach for intention reading with soft computing techniques , 2003, The 12th IEEE International Conference on Fuzzy Systems, 2003. FUZZ '03..

[21]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[22]  Dana Kulic,et al.  Pre-collision safety strategies for human-robot interaction , 2007, Auton. Robots.

[23]  E. Clancy,et al.  Influence of smoothing window length on electromyogram amplitude estimates , 1998, IEEE Transactions on Biomedical Engineering.

[24]  W Herzog,et al.  Dynamic muscle force predictions from EMG: an artificial neural network approach. , 1999, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[25]  Jung Kim,et al.  A New Surface Electromyography Amplitude Estimation Method , 2009 .

[26]  David G. Lloyd,et al.  A real-time EMG-driven virtual arm , 2002, Comput. Biol. Medicine.

[27]  P. Dario,et al.  Artificial neural network model of the mapping between electromyographic activation and trajectory patterns in free-arm movements , 2003, Medical and Biological Engineering and Computing.

[28]  Kazuhiro Kosuge,et al.  Manipulator for Man-Robot Cooperation , 1995 .

[29]  T. Housh,et al.  Mechanomyographic and electromyographic responses to eccentric and concentric isokinetic muscle actions of the biceps brachii , 1998, Muscle & nerve.

[30]  Günter Hommel,et al.  A Human--Exoskeleton Interface Utilizing Electromyography , 2008, IEEE Transactions on Robotics.

[31]  Guruprasad Madhavan,et al.  Electromyography: Physiology, Engineering and Non-Invasive Applications , 2005, Annals of Biomedical Engineering.

[32]  Yoky Matsuoka,et al.  Prosthetics, exoskeletons, and rehabilitation [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[33]  Jacob Rosen,et al.  Performances of Hill-Type and Neural Network Muscle Models - Toward a Myosignal-Based Exoskeleton , 1999, Comput. Biomed. Res..

[34]  Rajesh P. N. Rao,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. 1 Online Electromyographic Control of a Robotic , 2022 .

[35]  D. Feng,et al.  IEEE transactions on information technology in biomedicine: special issue on advances in clinical and health-care knowledge management , 2005 .

[36]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[37]  Yasuharu Koike,et al.  Estimation of dynamic joint torques and trajectory formation from surface electromyography signals using a neural network model , 1995, Biological Cybernetics.

[38]  Homayoon Kazerooni,et al.  Human-robot interaction via the transfer of power and information signals , 1990, IEEE Trans. Syst. Man Cybern..

[39]  Panagiotis K. Artemiadis,et al.  EMG-Based Control of a Robot Arm Using Low-Dimensional Embeddings , 2010, IEEE Transactions on Robotics.

[40]  Jörg Krüger,et al.  Robust control of force-coupled human-robot-interaction in assembly processes , 2008 .

[41]  R.F. Weir,et al.  The Optimal Controller Delay for Myoelectric Prostheses , 2007, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  P. Cavanagh,et al.  Electromechanical delay in human skeletal muscle under concentric and eccentric contractions , 1979, European Journal of Applied Physiology and Occupational Physiology.

[43]  P. Komi,et al.  Electromechanical delay in skeletal muscle under normal movement conditions. , 1979, Acta physiologica Scandinavica.

[44]  Hyun K. Kim,et al.  Estimation of Multijoint Stiffness Using Electromyogram and Artificial Neural Network , 2009, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[45]  Roberto Merletti,et al.  Electromyography. Physiology, engineering and non invasive applications , 2005 .

[46]  Yoky Matsuoka,et al.  Prosthetics, Exoskeletons, and Rehabilitation Now and for the Future , 2007 .

[47]  Panagiotis K. Artemiadis,et al.  An EMG-Based Robot Control Scheme Robust to Time-Varying EMG Signal Features , 2010, IEEE Transactions on Information Technology in Biomedicine.

[48]  Kevin B. Englehart,et al.  A robust, real-time control scheme for multifunction myoelectric control , 2003, IEEE Transactions on Biomedical Engineering.

[49]  Jeha Ryu,et al.  Safe physical human robot interaction-past, present and future , 2008 .