Controlling exoskeletons with EMG signals and a biomechanical body model

This work presents a control system for exoskeletons that ut ilizes electrical signals from the muscles as the main means of information transporta ti n between the human operator and the exoskeleton. Those signals are picked up from the skin on top of selected mu scles and reflect the activation of the observed muscle. They are evaluated by a so phi ticated but simplified biomechanical model of the human body to derive the desired a ction of the operator. A support action is computed in accordance to the desired act ion and is executed by the exoskeleton. The biomechanical model fuses results from different biome chanical and biomedical research groups and performs a sensible simplification considering the intended application. It contains parameters which reflect properti es of the human operator and his or her current body state. A calibration algorithm for th ose parameters is presented which relies exclusively on sensors mounted on the exoskele ton, and provides deep inside into the mechanisms of the model. An exoskeleton for the knee joint support was designed and co structed to verify the model and investigate the interaction between the human operator and the machine in experiments with force support during everyday movement s. Those results are also presented here.

[1]  K. Kuribayashi,et al.  A discrimination system using neural network for EMG-controlled prostheses , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[2]  Konstantin Kondak,et al.  Control and online computation of stable movement for biped robots , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[3]  David G. Lloyd,et al.  A real-time EMG-driven virtual arm , 2002, Comput. Biol. Medicine.

[4]  Frederic Martini,et al.  Fundamentals of Anatomy and Physiology , 1997 .

[5]  X. Beristain Essentials of neural science and behavior , 1996 .

[6]  Panagiotis K. Artemiadis,et al.  Teleoperation of a robot manipulator using EMG signals and a position tracker , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Homayoon Kazerooni,et al.  The Berkeley Lower Extremity Exoskeleton , 2006, FSR.

[8]  Konstantin Kondak,et al.  Online calibration of the EMG to force relationship , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  Miomir Vukobratović,et al.  Biped Locomotion: Dynamics, Stability, Control and Application , 1990 .

[10]  E. Vos,et al.  Electromechanical delay in the vastus lateralis muscle during dynamic isometric contractions , 1990, European Journal of Applied Physiology and Occupational Physiology.

[11]  R.Fff. Weir,et al.  A heuristic fuzzy logic approach to EMG pattern recognition for multifunctional prosthesis control , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Toshio Tsuji,et al.  EMG pattern classification for a prosthetic forearm with three degrees of freedom , 1992, [1992] Proceedings IEEE International Workshop on Robot and Human Communication.

[13]  H. Hermens,et al.  European recommendations for surface electromyography: Results of the SENIAM Project , 1999 .

[14]  John Rasmussen,et al.  Evaluation of lower extremity musculo-skeletal model using sit-to-stand movement. , 2003 .

[15]  G. Gini,et al.  An EMG-controlled exoskeleton for hand rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[16]  Mu-Seong Mun,et al.  A real-time EMG pattern recognition based on linear-nonlinear feature projection for multifunction myoelectric hand , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[17]  D. Lloyd,et al.  An EMG-driven musculoskeletal model to estimate muscle forces and knee joint moments in vivo. , 2003, Journal of biomechanics.

[18]  J. Nielsen How we Walk: Central Control of Muscle Activity during Human Walking , 2003, The Neuroscientist : a review journal bringing neurobiology, neurology and psychiatry.

[19]  Yoshiyuki Sankai,et al.  Power assist method for HAL-3 estimating operator's intention based on motion information , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[20]  Adam Zoss,et al.  On the mechanical design of the Berkeley Lower Extremity Exoskeleton (BLEEX) , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  P. Bonato,et al.  An EMG-position controlled system for an active ankle-foot prosthesis: an initial experimental study , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[22]  Toshio Fukuda,et al.  An exoskeletal robot for human shoulder joint motion assist , 2003 .

[23]  Jacob Rosen,et al.  A myosignal-based powered exoskeleton system , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[24]  H. Woltring Myocybernetic control models of skeletal muscle—Characteristics and applications , 1983 .

[25]  Keitaro Naruse,et al.  Study for control of a power assist device. Development of an EMG based controller considering a human model , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[26]  Toshio Tsuji,et al.  A human-assisting manipulator teleoperated by EMG signals and arm motions , 2003, IEEE Trans. Robotics Autom..

[27]  Günter Hommel,et al.  Calibration of an EMG-Based Body Model with six Muscles to control a Leg Exoskeleton , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[28]  Hidetoshi Suzuki,et al.  A muscle suit for the upper body: development of a new shoulder mechanism , 2005, IEEE Workshop on Advanced Robotics and its Social Impacts, 2005..

[29]  Kazuhiro Kosuge,et al.  Control of Wearable Walking Support System Based on Human-Model and GRF , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  M. Jeannerod The neural and behavioural organization of goal-directed movements , 1990, Psychological Medicine.

[31]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[32]  Shi Zhou,et al.  Electromechanical delay in isometric muscle contractions evoked by voluntary, reflex and electrical stimulation , 2004, European Journal of Applied Physiology and Occupational Physiology.

[33]  A. Huxley,et al.  The variation in isometric tension with sarcomere length in vertebrate muscle fibres , 1966, The Journal of physiology.

[34]  H. Devries MUSCLES ALIVE-THEIR FUNCTIONS REVEALED BY ELECTROMYOGRAPHY , 1976 .

[35]  Yoshiyuki Sankai,et al.  Power assist control for walking aid with HAL-3 based on EMG and impedance adjustment around knee joint , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[36]  R. Maughan,et al.  Strength and cross‐sectional area of human skeletal muscle. , 1983, The Journal of physiology.

[37]  N. Manning,et al.  The human arm kinematics and dynamics during daily activities - toward a 7 DOF upper limb powered exoskeleton , 2005, ICAR '05. Proceedings., 12th International Conference on Advanced Robotics, 2005..

[38]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[39]  Jacob Rosen,et al.  Performances of Hill-Type and Neural Network Muscle Models - Toward a Myosignal-Based Exoskeleton , 1999, Comput. Biomed. Res..

[40]  George I. Zahalak,et al.  Modeling Muscle Mechanics (and Energetics) , 1990 .

[41]  Gerwin Schalk,et al.  A brain–computer interface using electrocorticographic signals in humans , 2004, Journal of neural engineering.

[42]  T. Buchanan,et al.  A model of load sharing between muscles and soft tissues at the human knee during static tasks. , 1996, Journal of biomechanical engineering.

[43]  Han-Pang Huang,et al.  Development of a myoelectric discrimination system for a multi-degree prosthetic hand , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[44]  Xiaopeng Liu,et al.  Development of a lower extremity exoskeleton for human performance enhancement , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[45]  Yoshiyuki Sankai,et al.  Control method of robot suit HAL working as operator's muscle using biological and dynamical information , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Stefan Silbernagl,et al.  Taschenatlas der Physiologie , 1991 .

[47]  Daniel P. Ferris,et al.  An ankle-foot orthosis powered by artificial pneumatic muscles. , 2005, Journal of applied biomechanics.

[48]  K.J. Kyriakopoulos,et al.  Teleoperation of a Robot Arm in 2D Catching Movements using EMG Signals and a Bio-inspired Motion Law , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[49]  Ian D. Walker,et al.  Myoelectric teleoperation of a complex robotic hand , 1996, IEEE Trans. Robotics Autom..

[50]  D.S. Andreasen,et al.  Exoskeleton with EMG based active assistance for rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[51]  Toshio Fukuda,et al.  An exoskeleton for human elbow and forearm motion assist , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[52]  R. Norman,et al.  Mechanically corrected EMG for the continuous estimation of erector spinae muscle loading during repetitive lifting , 2004, European Journal of Applied Physiology and Occupational Physiology.

[53]  Yoshiyuki Sankai,et al.  The natural frequency-based power assist control for lower body with HAL-3 , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[54]  Thomas Schlegl Compensation of discrete contact state errors in multi-fingered manipulation , 2003, Proceedings 2003 IEEE International Symposium on Computational Intelligence in Robotics and Automation. Computational Intelligence in Robotics and Automation for the New Millennium (Cat. No.03EX694).

[55]  K.H. Low,et al.  Development and preliminary study of the NTU lower extremity exoskeleton , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[56]  Jerry E. Pratt,et al.  The RoboKnee: an exoskeleton for enhancing strength and endurance during walking , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[57]  K N An,et al.  Determination of muscle orientations and moment arms. , 1984, Journal of biomechanical engineering.

[58]  M. F.,et al.  Bibliography , 1985, Experimental Gerontology.

[59]  Martin Buss,et al.  A discrete-continuous control approach to dextrous manipulation , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[60]  P. Cavanagh,et al.  Electromechanical delay in human skeletal muscle under concentric and eccentric contractions , 1979, European Journal of Applied Physiology and Occupational Physiology.

[61]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[62]  Sherif E Hussein,et al.  Intention detection using a neuro-fuzzy EMG classifier. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[63]  Daniel P. Ferris,et al.  Powered lower limb orthoses for gait rehabilitation. , 2005, Topics in spinal cord injury rehabilitation.

[64]  Y. Sankai,et al.  Power assist method based on phase sequence driven by interaction between human and robot suit , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[65]  Günter Hommel,et al.  TORQUE CONTROL OF AN EXOSKELETAL KNEE WITH EMG SIGNALS , .

[66]  K. Kondak,et al.  Control Algorithm for Stable Walking of Biped Robots , 2003 .

[67]  Lihua Huang,et al.  Hybrid Control of the Berkeley Lower Extremity Exoskeleton (BLEEX) , 2006, Int. J. Robotics Res..

[68]  Y. Matsuoka,et al.  Neuromuscular strategies for dynamic finger movements: a robotic approach , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[69]  G.S. Sawicki,et al.  Powered lower limb orthoses: applications in motor adaptation and rehabilitation , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[70]  K. Manal,et al.  A one-parameter neural activation to muscle activation model: estimating isometric joint moments from electromyograms. , 2003, Journal of biomechanics.

[71]  D. Winter,et al.  A comparison of three muscle pennation assumptions and their effect on isometric and isotonic force. , 1991, Journal of biomechanics.

[72]  Homayoon Kazerooni,et al.  Exoskeletons for human power augmentation , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[73]  Paul Lukowicz,et al.  Sensing muscle activities with body-worn sensors , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[74]  Martin Buss,et al.  Hybrid closed-loop control of robotic hand regrasping , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[75]  Jack M. Winters,et al.  Modeling Musculoskeletal Movement Systems: Joint and Body Segmental Dynamics, Musculoskeletal Actuation, and Neuromuscular Control , 1990 .

[76]  Lihua Huang,et al.  On the Control of the Berkeley Lower Extremity Exoskeleton (BLEEX) , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[77]  F.E. Zajac,et al.  An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures , 1990, IEEE Transactions on Biomedical Engineering.

[78]  K. R. Wheeler Device control using gestures sensed from EMG , 2003, Proceedings of the 2003 IEEE International Workshop on Soft Computing in Industrial Applications, 2003. SMCia/03..

[79]  K.-R. Muller,et al.  The Berlin brain-computer interface: EEG-based communication without subject training , 2006, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[80]  Y. Kakazu,et al.  Development of wearable exoskeleton power assist system for lower back support , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[81]  Kazuhiro Kosuge,et al.  Realizing model-based wearable antigravity muscles support with dynamics terms , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[82]  M.M. Moore,et al.  Real-world applications for brain-computer interface technology , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[83]  F. K. Lam,et al.  Fuzzy EMG classification for prosthesis control. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[84]  R. Kirsch,et al.  EMG-based prediction of shoulder and elbow kinematics in able-bodied and spinal cord injured individuals. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[85]  Bruce C. Wheeler,et al.  EMG feature evaluation for movement control of upper extremity prostheses , 1995 .

[86]  Günter Hommel,et al.  Predicting the intended motion with EMG signals for an exoskeleton orthosis controller , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[87]  Yoshiyuki Sankai,et al.  Power Assist System HAL-3 for Gait Disorder Person , 2002, ICCHP.

[88]  M. Ishii,et al.  Stand alone wearable power assisting suit - sensing and control systems , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[89]  J H Blok,et al.  Surface EMG models: properties and applications. , 2000, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[90]  Blake Hannaford,et al.  Hill-Based Model as a Myoprocessor for a Neural Controlled Powered Exoskeleton Arm - Parameters Optimization , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[91]  J.C. Perry,et al.  Design of a 7 Degree-of-Freedom Upper-Limb Powered Exoskeleton , 2006, The First IEEE/RAS-EMBS International Conference on Biomedical Robotics and Biomechatronics, 2006. BioRob 2006..

[92]  T. Nakamura,et al.  Realizing a posture-based wearable antigravity muscles support system for lower extremities , 2005, 9th International Conference on Rehabilitation Robotics, 2005. ICORR 2005..

[93]  Nikolaos G. Tsagarakis,et al.  Development and Control of a ‘Soft-Actuated’ Exoskeleton for Use in Physiotherapy and Training , 2003, Auton. Robots.

[94]  Yoshiyuki Sankai,et al.  Power assist control for leg with HAL-3 based on virtual torque and impedance adjustment , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[95]  D J McFarland,et al.  Brain-computer interface research at the Wadsworth Center. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[96]  Yoshiyuki Sankai,et al.  Comfortable power assist control method for walking aid by HAL-3 , 2002, IEEE International Conference on Systems, Man and Cybernetics.

[97]  J. Winters Hill-Based Muscle Models: A Systems Engineering Perspective , 1990 .

[98]  Sadao Kawamura,et al.  Development of an 8 DOF robotic orthosis for assisting human upper limb motion , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[99]  Yoky Matsuoka,et al.  Comparison of control strategies for an EMG controlled orthotic exoskeleton for the hand , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.