Non-linear control strategies for musculoskeletal robots

Recently, focus has shifted to more human-friendly robots, especially in the field of service or rehabilitation robotics, where research aims at bringing robots into increasingly unstructured environments. Here, humans still outperform robots in almost every aspect. One way towards this goal is to mimic more and more of the mechanisms of the human musculoskeletal system. These so called musculoskeletal robots incorporate compliant antagonistic actuation in a biologically inspired skeleton. Furthermore, complex joints like spherical joints and multi-articular muscles are realized. In the last decade impressive musculoskeletal robots have been developed, where the focus was mainly on constructing working prototypes. However, the field of controlling such robots has made very little progress, so far. Reasons for this are manifold, starting from unavailable sensor modalities, due to novel skeletal structures, to the difficulties in modeling the interaction of the muscles with the skeleton. In this work, (1) a generic model for the class of musculoskeletal robots was derived by extending standard models for robot dynamics, (2) several non-linear control strategies were developed and (3) a robotic arm was constructed to evaluate the novel control approaches. Non-linear controllers derived in this work include feedback linearization, which is also the main control technique used for tendon-driven robots and was therefore extended to be applied to the characteristics of musculoskeletal robots. Furthermore, a novel control law, based on Dynamic Surface Control (DSC), which is an extension to backstepping, was developed. In contrast to previously used techniques, the systematic approach of backstepping provides a method to obtain a cascade of controllers without neglecting the dynamics of the low-level control laws, hence providing provably stable closed-loop behavior. This scheme was further extended by adaptive neural network control to compensate for unmodeled dynamics such as friction. The dynamic model, incorporated by the different controllers utilizes a standard rigid body model of the skeleton which was extended to support spherical joints. In the presence of complex joint types and muscles that wrap around skeletal structures, analytic models of the mapping between the joint and the muscle space are extremely complex to obtain. To overcome this issue machine learning techniques were applied to attain the muscle kinematics. The different control laws were evaluated on a physical robotic platform which was specifically developed to cover the control challenges of the class of musculoskeletal robots. Hence it comprises a spherical shoulder joint and a revolute elbow joint. Actuation was realized by several uni-articular muscles and a bi-articular muscle spanning both joints. Results obtained on this platform show that it is possible to achieve stable closed-loop behavior, where the novel control laws developed in this work yield improved trajectory tracking performance, compared to existing approaches.

[1]  Oskar von Stryk,et al.  Detailed dynamics modeling of BioBiped's monoarticular and biarticular tendon-driven actuation system , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Junichi Urata,et al.  Design methodology for the thorax and shoulder of human mimetic musculoskeletal humanoid Kenshiro -a thorax structure with rib like surface - , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Masayuki Inaba,et al.  Development of musculoskeletal humanoid Kotaro , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[4]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[5]  Daniel J. Inman,et al.  Engineering Mechanics: Statics , 1998 .

[6]  Masayuki Inaba,et al.  Development of musculoskeletal humanoid kenzoh with mechanical compliance changeable tendons by nonlinear spring unit , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[7]  Gianluca Palli Model and control of tendon actuated robots , 2007 .

[8]  Alin Albu-Schäffer,et al.  Safety Evaluation of Physical Human-Robot Interaction via Crash-Testing , 2007, Robotics: Science and Systems.

[9]  Alin Albu-Schäffer,et al.  Dynamic modelling and control of variable stiffness actuators , 2010, 2010 IEEE International Conference on Robotics and Automation.

[10]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[11]  Alois Knoll,et al.  Anthrob - A printed anthropomimetic robot , 2013, 2013 13th IEEE-RAS International Conference on Humanoid Robots (Humanoids).

[12]  Robert Platt,et al.  Applied joint-space torque and stiffness control of tendon-driven fingers , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[13]  Rob Knight,et al.  The Anthropomimetic Principle , 2006 .

[14]  Shuzhi Sam Ge,et al.  Adaptive friction compensation of servo mechanisms , 2001, Int. J. Syst. Sci..

[15]  Darwin G. Caldwell,et al.  Control of pneumatic muscle actuators , 1995 .

[16]  Stephen C. Jacobsen,et al.  Design of the Utah/M.I.T. Dextrous Hand , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[17]  A G Fel'dman [On the functional tuning of the nervous system in movement control or preservation of stationary pose. II. Adjustable parameters in muscles]. , 1966, Biofizika.

[18]  Alois Knoll,et al.  Distributed control for an anthropomimetic robot , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Alois Knoll,et al.  Towards anthropomimetic robotics: Development, simulation, and control of a musculoskeletal torso , 2013 .

[20]  Dan Wang,et al.  Neural network-based adaptive dynamic surface control for a class of uncertain nonlinear systems in strict-feedback form , 2005, IEEE Transactions on Neural Networks.

[21]  Sethu Vijayakumar,et al.  Adaptive Optimal Feedback Control with Learned Internal Dynamics Models , 2010, From Motor Learning to Interaction Learning in Robots.

[22]  M. Bobbert,et al.  The unique action of bi-articular muscles in complex movements. , 1987, Journal of anatomy.

[23]  F. Bekes,et al.  Motion control of a tendon-based parallel manipulator using optimal tension distribution , 2004, IEEE/ASME Transactions on Mechatronics.

[24]  Chi-Sang Poon,et al.  Internal models in sensorimotor integration: perspectives from adaptive control theory , 2005, Journal of neural engineering.

[25]  Rob Knight,et al.  ECCE1: The first of a series of anthropomimetic musculoskeletal upper torsos , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[26]  Hitoshi Kino,et al.  Basic study of biarticular muscle's effect on muscular internal force control based on physiological hypotheses , 2009, 2009 IEEE International Conference on Robotics and Automation.

[27]  Patrizio Tomei,et al.  A method to design adaptive controllers for flexible joint robots , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[28]  Masayuki Inaba,et al.  The design and control of the flexible spine of a fully tendon-driven humanoid "Kenta" , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Vladimir M. Zatsiorsky,et al.  Kinetics of Human Motion , 2002 .

[30]  脇元 修一,et al.  IEEE International Conference on Robotics and Automation (ICRA) におけるフルードパワー技術の研究動向 , 2011 .

[31]  Alois Knoll,et al.  CALIPER: A universal robot simulation framework for tendon-driven robots , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[32]  Yasuo Kuniyoshi,et al.  Athlete Robot with applied human muscle activation patterns for bipedal running , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[33]  Hitoshi Kino,et al.  Iterative learning control for a redundant musculoskeletal arm: Acquisition of adequate internal force , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  J. Laidlaw,et al.  ANATOMY OF THE HUMAN BODY , 1967, The Ulster Medical Journal.

[35]  Shuzhi Sam Ge,et al.  Direct adaptive NN control of a class of nonlinear systems , 2002, IEEE Trans. Neural Networks.

[36]  Stefan Schaal,et al.  2008 Special Issue: Reinforcement learning of motor skills with policy gradients , 2008 .

[37]  Fumiya Iida,et al.  New Robotics: Design Principles for Intelligent Systems , 2005, Artificial Life.

[38]  Ricardo G. Sanfelice,et al.  Quaternion-Based Hybrid Control for Robust Global Attitude Tracking , 2011, IEEE Transactions on Automatic Control.

[39]  John J. Craig,et al.  Articulated hands: Force control and kinematic issues , 1981 .

[40]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[41]  Masayuki Inaba,et al.  Pedaling by a redundant musculo-skeletal humanoid robot , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..

[42]  A. Schwab,et al.  HOW TO DRAW EULER ANGLES AND UTILIZE EULER PARAMETERS , 2006 .

[43]  Alois Knoll,et al.  Physics-based modeling of an anthropomimetic robot , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[44]  Alin Albu-Schäffer,et al.  A globally stable state feedback controller for flexible joint robots , 2001, Adv. Robotics.

[45]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[46]  Katsu Yamane,et al.  Robot Kinematics and Dynamics for Modeling the Human Body , 2007, ISRR.

[47]  Koh Hosoda,et al.  Anthropomorphic Muscular–Skeletal Robotic Upper Limb for Understanding Embodied Intelligence , 2012, Adv. Robotics.

[48]  Jing Na,et al.  Adaptive neural dynamic surface control for servo systems with unknown dead-zone , 2011 .

[49]  Frank L. Lewis,et al.  Reinforcement learning and optimal adaptive control: An overview and implementation examples , 2012, Annu. Rev. Control..

[50]  O.-E. Fjellstad,et al.  Quaternion feedback regulation of underwater vehicles , 1994, 1994 Proceedings of IEEE International Conference on Control and Applications.

[51]  Andreas Steininger,et al.  The design of a fail-silent processing node for the predictable hard real-time system MARS , 1993, Distributed Syst. Eng..

[52]  Sadao Kawamura,et al.  High-speed manipulation by using parallel wire-driven robots , 2000, Robotica.

[53]  Hiroaki Kobayashi,et al.  Adaptive neural network control of tendon-driven mechanisms with elastic tendons , 2003, Autom..

[54]  Owen Holland,et al.  Controlling an Anthropomimetic Robot: A Preliminary Investigation , 2007, ECAL.

[55]  Anuradha M. Annaswamy,et al.  Robust Adaptive Control , 1984, 1984 American Control Conference.

[56]  Guido Herrmann,et al.  Practical implementation of a neural network controller in a hard disk drive , 2005, IEEE Transactions on Control Systems Technology.

[57]  Weiping Li,et al.  Adaptive manipulator control a case study , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[58]  Ryo Kurazume,et al.  Iterative learning control for a musculoskeletal arm: Utilizing multiple space variables to improve the robustness , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[59]  Koichi Koganezawa,et al.  Stiffness control of multi-DOF joint , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[60]  Dean Karnopp,et al.  Computer simulation of stick-slip friction in mechanical dynamic systems , 1985 .

[61]  Stephen C. Jacobsen,et al.  Antagonistic control of a tendon driven manipulator , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[62]  Alois Knoll,et al.  Calibration of a physics-based model of an anthropomimetic robot using Evolution Strategies , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Rogelio Lozano,et al.  Global tracking controllers for flexible-joint manipulators: a comparative study , 1995, Autom..

[64]  Carlos Canudas de Wit,et al.  Friction Models and Friction Compensation , 1998, Eur. J. Control.

[65]  Masayuki Inaba,et al.  Lower thigh design of detailed musculoskeletal humanoid “Kenshiro” , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[66]  G. J. van Ingen Schenau,et al.  Role of Mono- and Biarticular Muscles in Explosive Movements , 1984, International journal of sports medicine.

[67]  B. Pasik-Duncan,et al.  Adaptive Control , 1996, IEEE Control Systems.

[68]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[69]  Yasuo Kuniyoshi,et al.  Mowgli: A Bipedal Jumping and Landing Robot with an Artificial Musculoskeletal System , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[70]  Donald Goldfarb,et al.  A numerically stable dual method for solving strictly convex quadratic programs , 1983, Math. Program..

[71]  Sethu Vijayakumar,et al.  Learning impedance control of antagonistic systems based on stochastic optimization principles , 2011, Int. J. Robotics Res..

[72]  Phillip J. McKerrow,et al.  Introduction to robotics , 1991 .

[73]  Paul J. Werbos,et al.  Backpropagation Through Time: What It Does and How to Do It , 1990, Proc. IEEE.

[74]  Andre Gaschler Visual Motion Capturing for Kinematic Model Estimation of a Humanoid Robot , 2011, DAGM-Symposium.

[75]  Hitoshi Kino,et al.  Iterative Learning Scheme for a Redundant Musculoskeletal Arm: Task Space Learning with Joint and Muscle Redundancies , 2010, BWCCA.

[76]  Suguru Arimoto,et al.  On control of reaching movements for musculo-skeletal redundant arm model , 2009 .

[77]  Jan Peters,et al.  Noname manuscript No. (will be inserted by the editor) Policy Search for Motor Primitives in Robotics , 2022 .

[78]  Jin S. Lee,et al.  Control of flexible joint robot system by backstepping design approach , 1997, Proceedings of International Conference on Robotics and Automation.

[79]  Swaroop Darbha,et al.  Dynamic surface control for a class of nonlinear systems , 2000, IEEE Trans. Autom. Control..

[80]  Oskar von Stryk,et al.  Investigation of safety in human-robot-interaction for a series elastic, tendon-driven robot arm , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[81]  Oussama Khatib,et al.  The control of kinematically constrained shoulder complexes: physiological and humanoid examples , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[82]  Alois Knoll,et al.  A scalable joint-space controller for musculoskeletal robots with spherical joints , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[83]  D. Gentry Steele,et al.  The Anatomy and Biology of the Human Skeleton , 1988 .

[84]  Hong Liu,et al.  Multisensory five-finger dexterous hand: The DLR/HIT Hand II , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[85]  Alin Albu-Schäffer,et al.  A Unified Passivity-based Control Framework for Position, Torque and Impedance Control of Flexible Joint Robots , 2007, Int. J. Robotics Res..

[86]  Mark W. Spong,et al.  Adaptive control of flexible joint manipulators: Comments on two papers , 1995, Autom..

[87]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[88]  Alexander Verl,et al.  The QuadHelix-Drive - An improved rope actuator for robotic applications , 2010, 2010 IEEE International Conference on Robotics and Automation.

[89]  Masayuki Inaba,et al.  An advanced musculoskeletal humanoid Kojiro , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[90]  Shuzhi Sam Ge,et al.  Direct adaptive neural network control of robots , 1996, Int. J. Syst. Sci..

[91]  Jung-Ha Kim,et al.  Stiffness control of the coupled tendon-driven robot hand , 1993, Proceedings of IEEE Systems Man and Cybernetics Conference - SMC.

[92]  Tomaso A. Poggio,et al.  Extensions of a Theory of Networks for Approximation and Learning , 1990, NIPS.

[93]  Christian Schmaler Extracting the Muscle Jacobian for Anthropomimetic Robot Control using Machine Learning , 2013 .

[94]  Roland Siegwart,et al.  The hand of the DLR Hand Arm System: Designed for interaction , 2012, Int. J. Robotics Res..

[95]  G. Oriolo,et al.  Robotics: Modelling, Planning and Control , 2008 .

[96]  Ian D. Walker,et al.  Task-space tracking control of robot manipulators via quaternion feedback , 2004, IEEE Transactions on Robotics and Automation.

[97]  Stephen P. DeWeerth,et al.  Biologically Inspired Joint Stiffness Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[98]  Martin Otter,et al.  Modeling and Simulating the Efficiency of Gearboxes and of Planetary Gearboxes , 2002 .

[99]  Anders Green,et al.  Social and collaborative aspects of interaction with a service robot , 2003, Robotics Auton. Syst..

[100]  Gerd Hirzinger,et al.  Feedback linearization and simultaneous stiffness-position control of robots with antagonistic actuated joints , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[101]  Alin Albu-Schaffer,et al.  Adaptive friction compensation in trajectory tracking control of DLR medical robots with elastic joints , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[102]  Owen Holland,et al.  Biologically Inspired Control of a Compliant Anthropomimetic Robot , 2010 .

[103]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[104]  P. Rochat Self-perception and action in infancy , 1998, Experimental Brain Research.

[105]  Robert Platt,et al.  Decoupled torque control of tendon-driven fingers with tension management , 2013, Int. J. Robotics Res..

[106]  P. Wolfe THE SIMPLEX METHOD FOR QUADRATIC PROGRAMMING , 1959 .

[107]  Veljko Potkonjak,et al.  Control Of Compliant Anthropomimetic Robot Joint , 2011 .

[108]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[109]  Slobodan N. Vukosavic Modeling and Supplying DC Machines , 2013 .

[110]  J. W. Humberston Classical mechanics , 1980, Nature.

[111]  A. Albu-Schäffer Regelung von Robotern mit elastischen Gelenken am Beispiel der DLR-Leichtbauarme , 2002 .

[112]  Masayuki Inaba,et al.  Joint proprioception acquisition strategy based on joints-muscles topological maps for musculoskeletal humanoids , 2010, 2010 IEEE International Conference on Robotics and Automation.

[113]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[114]  Yasuo Kuniyoshi,et al.  Biomechanical Approach to Open-Loop Bipedal Running with a Musculoskeletal Athlete Robot , 2012, Adv. Robotics.

[115]  Nesa L'abbe Wu,et al.  Linear programming and extensions , 1981 .

[116]  M. McCall,et al.  Rigid Body Dynamics , 2008 .

[117]  Alin Albu-Schäffer,et al.  On the Passivity-Based Impedance Control of Flexible Joint Robots , 2008, IEEE Transactions on Robotics.

[118]  R. Pfeifer,et al.  Self-Organization, Embodiment, and Biologically Inspired Robotics , 2007, Science.

[119]  Lin Tian,et al.  Robust adaptive control of flexible joint robots with joint torque feedback , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.

[120]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[121]  Alois Knoll,et al.  Computed muscle control for an anthropomimetic elbow joint , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[122]  Hiroaki Kobayashi,et al.  On Tendon-Driven Robotic Mechanisms with Redundant Tendons , 1998, Int. J. Robotics Res..

[123]  V. Arnold Mathematical Methods of Classical Mechanics , 1974 .

[124]  Scott L Delp,et al.  Generating dynamic simulations of movement using computed muscle control. , 2003, Journal of biomechanics.

[125]  Suguru Arimoto,et al.  Human-like movements of robotic arms with redundant DOFs: virtual spring-damper hypothesis to tackle the Bernstein problem , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[126]  R. A. Brooks,et al.  Intelligence without Representation , 1991, Artif. Intell..

[127]  Hong Liu,et al.  Experimental study on impedance control for the five-finger dexterous robot hand DLR-HIT II , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[128]  B. Anderson,et al.  Digital control of dynamic systems , 1981, IEEE Transactions on Acoustics, Speech, and Signal Processing.

[129]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[130]  Jin Bae Park,et al.  Adaptive Dynamic Surface Control for Stabilization of Parametric Strict-Feedback Nonlinear Systems With Unknown Time Delays , 2007, IEEE Transactions on Automatic Control.

[131]  W. H. Young On Classes of Summable Functions and their Fourier Series , 1912 .