Learning to push and learning to move: the adaptive control of contact forces

To be successful at manipulating objects one needs to apply simultaneously well controlled movements and contact forces. We present a computational theory of how the brain may successfully generate a vast spectrum of interactive behaviors by combining two independent processes. One process is competent to control movements in free space and the other is competent to control contact forces against rigid constraints. Free space and rigid constraints are singularities at the boundaries of a continuum of mechanical impedance. Within this continuum, forces and motions occur in “compatible pairs” connected by the equations of Newtonian dynamics. The force applied to an object determines its motion. Conversely, inverse dynamics determine a unique force trajectory from a movement trajectory. In this perspective, we describe motor learning as a process leading to the discovery of compatible force/motion pairs. The learned compatible pairs constitute a local representation of the environment's mechanics. Experiments on force field adaptation have already provided us with evidence that the brain is able to predict and compensate the forces encountered when one is attempting to generate a motion. Here, we tested the theory in the dual case, i.e., when one attempts at applying a desired contact force against a simulated rigid surface. If the surface becomes unexpectedly compliant, the contact point moves as a function of the applied force and this causes the applied force to deviate from its desired value. We found that, through repeated attempts at generating the desired contact force, subjects discovered the unique compatible hand motion. When, after learning, the rigid contact was unexpectedly restored, subjects displayed after effects of learning, consistent with the concurrent operation of a motion control system and a force control system. Together, theory and experiment support a new and broader view of modularity in the coordinated control of forces and motions.

[1]  J. Lackner,et al.  Rapid adaptation to Coriolis force perturbations of arm trajectory. , 1994, Journal of neurophysiology.

[2]  J. Kalaska,et al.  Motor cortex neural correlates of output kinematics and kinetics during isometric-force and arm-reaching tasks. , 2005, Journal of neurophysiology.

[3]  J. Kelso,et al.  Learning as change of coordination dynamics: theory and experiment. , 1992, Journal of motor behavior.

[4]  M Kawato,et al.  Internal models for motor control. , 2007, Novartis Foundation symposium.

[5]  Reza Shadmehr,et al.  Learned dynamics of reaching movements generalize from dominant to nondominant arm. , 2003, Journal of neurophysiology.

[6]  Neville Hogan,et al.  Dealing with constraints: a biomechanical approach , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[7]  R A Scheidt,et al.  Learning to move amid uncertainty. , 2001, Journal of neurophysiology.

[8]  R. Shadmehr,et al.  Interacting Adaptive Processes with Different Timescales Underlie Short-Term Motor Learning , 2006, PLoS biology.

[9]  L. Jones,et al.  Perception of force and weight: theory and research. , 1986, Psychological bulletin.

[10]  H. Gomi,et al.  Task-Dependent Viscoelasticity of Human Multijoint Arm and Its Spatial Characteristics for Interaction with Environments , 1998, The Journal of Neuroscience.

[11]  F. Mussa-Ivaldi,et al.  The motor system does not learn the dynamics of the arm by rote memorization of past experience. , 1997, Journal of neurophysiology.

[12]  James H Stuhmiller,et al.  The metabolic cost of force generation. , 2003, Medicine and science in sports and exercise.

[13]  S. Kurdak,et al.  Contraction duration affects metabolic energy cost and fatigue in skeletal muscle. , 1998, American journal of physiology. Endocrinology and metabolism.

[14]  Reza Shadmehr,et al.  Quantifying Generalization from Trial-by-Trial Behavior of Adaptive Systems that Learn with Basis Functions: Theory and Experiments in Human Motor Control , 2003, The Journal of Neuroscience.

[15]  Bruno Siciliano,et al.  Parallel Force/Position Control of Robot Manipulators , 1996 .

[16]  S. Andreassen,et al.  Regulation of soleus muscle stiffness in premammillary cats: intrinsic and reflex components. , 1981, Journal of neurophysiology.

[17]  M. Kringelbach Learning to Change , 2004, PLoS biology.

[18]  W. Rymer,et al.  Muscle stiffness during transient and continuous movements of cat muscle: perturbation characteristics and physiological relevance , 1994, IEEE Transactions on Biomedical Engineering.

[19]  E Bizzi,et al.  Motor learning by field approximation. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[20]  A Melendez-Calderon,et al.  Force Field Adaptation Can Be Learned Using Vision in the Absence of Proprioceptive Error , 2011, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[21]  Neville Hogan,et al.  Stability properties of human reaching movements , 2004, Experimental Brain Research.

[22]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation , 1984, 1984 American Control Conference.

[23]  E. Bizzi,et al.  Posture control and trajectory formation during arm movement , 1984, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  R. Andersen,et al.  Coding of intention in the posterior parietal cortex , 1997, Nature.

[25]  Mark W. Spong,et al.  Robot dynamics and control , 1989 .

[26]  Joanne Lymn,et al.  Learning on the move. , 2010, Nursing standard (Royal College of Nursing (Great Britain) : 1987).

[27]  J. McIntyre,et al.  Servo Hypotheses for the Biological Control of Movement. , 1993, Journal of motor behavior.

[28]  S. Scott,et al.  Random change in cortical load representation suggests distinct control of posture and movement , 2005, Nature Neuroscience.

[29]  T. Judkins,et al.  Visuo-proprioceptive interactions during adaptation of the human reach. , 2014, Journal of neurophysiology.

[30]  F A Mussa-Ivaldi,et al.  Adaptive representation of dynamics during learning of a motor task , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[31]  Loïc Damm,et al.  Physiological basis of limb-impedance modulation during free and constrained movements. , 2008, Journal of neurophysiology.

[32]  A Kemeny,et al.  Perception and reproduction of force direction in the horizontal plane. , 2003, Journal of neurophysiology.

[33]  Thenkurussi Kesavadas,et al.  Motor skill training assistance using haptic attributes , 2005, First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference.

[34]  Elizabeth Torres,et al.  Space-time separation during obstacle-avoidance learning in monkeys. , 2006, Journal of neurophysiology.

[35]  A. G. Feldman Once more on the equilibrium-point hypothesis (lambda model) for motor control. , 1986, Journal of motor behavior.

[36]  Rieko Osu,et al.  Endpoint Stiffness of the Arm Is Directionally Tuned to Instability in the Environment , 2007, The Journal of Neuroscience.

[37]  E. Bizzi,et al.  Controlling multijoint motor behavior. , 1987, Exercise and sport sciences reviews.

[38]  E. Bizzi,et al.  Neural, mechanical, and geometric factors subserving arm posture in humans , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[39]  Neville Hogan,et al.  The mechanics of multi-joint posture and movement control , 1985, Biological Cybernetics.

[40]  John F Kalaska,et al.  Parietal area 5 activity does not reflect the differential time-course of motor output kinetics during arm-reaching and isometric-force tasks. , 2006, Journal of neurophysiology.

[41]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[42]  L. Selen,et al.  Impedance Control Reduces Instability That Arises from Motor Noise , 2009, The Journal of Neuroscience.

[43]  R. Andersen,et al.  The posterior parietal cortex: Sensorimotor interface for the planning and online control of visually guided movements , 2006, Neuropsychologia.

[44]  John J. Craig,et al.  Hybrid position/force control of manipulators , 1981 .

[45]  Alin Albu-Schäffer,et al.  A versatile biomimetic controller for contact tooling and haptic exploration , 2012, 2012 IEEE International Conference on Robotics and Automation.

[46]  Lynette A. Jones,et al.  Force sensation in isometric contractions: a relative force effect , 1982, Brain Research.

[47]  F. Lacquaniti,et al.  Independent control of limb position and contact forces in cat posture. , 1994, Journal of neurophysiology.

[48]  R. Meyer,et al.  Energy cost of twitch and tetanic contractions of rat muscle estimated in situ by gated 31P NMR , 1993, NMR in biomedicine.

[49]  K. Lynch,et al.  The Separate Neural Control of Hand Movements and Contact Forces , 2009, The Journal of Neuroscience.

[50]  Benjamin K. Barry,et al.  Reflex responsiveness of a human hand muscle when controlling isometric force and joint position , 2007, Clinical Neurophysiology.

[51]  Alin Albu-Schäffer,et al.  Biomimetic motor behavior for simultaneous adaptation of force, impedance and trajectory in interaction tasks , 2010, 2010 IEEE International Conference on Robotics and Automation.

[52]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part I—Theory , 1985 .

[53]  P. van Donkelaar,et al.  Transcranial magnetic stimulation disrupts eye-hand interactions in the posterior parietal cortex. , 2000, Journal of neurophysiology.

[54]  P. Crago,et al.  Multijoint dynamics and postural stability of the human arm , 2004, Experimental Brain Research.

[55]  Larry W. Swanson The Motor System , 2011 .

[56]  Frans C T van der Helm,et al.  Sensory Weighting of Force and Position Feedback in Human Motor Control Tasks , 2009, The Journal of Neuroscience.

[57]  J. Kalaska,et al.  Changes in the temporal pattern of primary motor cortex activity in a directional isometric force versus limb movement task. , 1998, Journal of neurophysiology.

[58]  R. Schwartzman The Motor System , 2006 .

[59]  A. G. Feldman Once More on the Equilibrium-Point Hypothesis (λ Model) for Motor Control , 1986 .

[60]  M. Kawato,et al.  Impedance control balances stability with metabolically costly muscle activation. , 2004, Journal of neurophysiology.

[61]  David A. Abbink,et al.  A rigorous model of reflex function indicates that position and force feedback are flexibly tuned to position and force tasks , 2009, Experimental Brain Research.

[62]  N. Hogan,et al.  Impedance Control:An Approach to Manipulation,Parts I,II,III , 1985 .

[63]  Mitsuo Kawato,et al.  Equilibrium-Point Control Hypothesis Examined by Measured Arm Stiffness During Multijoint Movement , 1996, Science.

[64]  Lorenzo Sciavicco,et al.  The parallel approach to force/position control of robotic manipulators , 1993, IEEE Trans. Robotics Autom..

[65]  Elizabeth T Wilson,et al.  The influence of visual perturbations on the neural control of limb stiffness. , 2009, Journal of neurophysiology.

[66]  R. Scheidt,et al.  Reach adaptation and final position control amid environmental uncertainty after stroke. , 2007, Journal of neurophysiology.

[67]  D.J. Reinkensmeyer,et al.  Robot-enhanced motor learning: accelerating internal model formation during locomotion by transient dynamic amplification , 2005, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[68]  K. Adolph Learning to Move , 2008, Current directions in psychological science.

[69]  Francisco J Valero-Cuevas,et al.  Neural Control of Motion-to-Force Transitions with the Fingertip , 2008, The Journal of Neuroscience.

[70]  John Kenneth Salisbury,et al.  Haptic Feedback Enhances Force Skill Learning , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[71]  Tamar Flash,et al.  Arm Stiffness And Movement Adaptation To External Loads , 1991, Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society Volume 13: 1991.

[72]  M. Kawato,et al.  Adaptation to Stable and Unstable Dynamics Achieved By Combined Impedance Control and Inverse Dynamics Model , 2003 .