Impedance-Based Gaussian Processes for Modeling Human Motor Behavior in Physical and Non-Physical Interaction

Objective: Modeling of human motor intention plays an essential role in predictively controlling a robotic system in human–robot interaction tasks. In most machine learning techniques, human motor behavior is modeled as a generic stochastic process. However, the integration of a priori knowledge about underlying system structures can provide insights on otherwise unobservable intrinsic states that yield the superior prediction performance and increased generalization capabilities. Methods: We present a novel method for modeling human motor behavior that explicitly includes a neuroscientifically supported model of human motor control, in which the dynamics of the human arm are modeled by a mechanical impedance that tracks a latent desired trajectory. We adopt a Bayesian setting by defining Gaussian process (GP) priors for the impedance elements and the latent desired trajectory. This enables exploitation of a priori human arm impedance knowledge for regression of interaction forces through inference of a latent desired human trajectory. Results: The method is validated using simulated data, with particular focus on effects of GP prior parameterization and intention estimation capabilities. The superior prediction performance is shown with respect to a naive GP prior. An experiment with human participants evaluates generalization capabilities and effects of training data sparsity. Conclusion: We derive the correlations of an impedance-based GP model of human motor behavior that exploits a priori knowledge. Significance: The model effectively predicts interaction forces by inferring a latent desired human trajectory in previously observed as well as unobserved regions of the input space.

[1]  C. E. Clauser,et al.  Weight, volume, and center of mass of segments of the human body , 1969 .

[2]  Carl E. Rasmussen,et al.  Warped Gaussian Processes , 2003, NIPS.

[3]  Toshio Tsuji,et al.  Human hand impedance characteristics during maintained posture , 1995, Biological Cybernetics.

[4]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[5]  Guokun Zuo,et al.  Human hand impedance characteristics during reaching movements , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[6]  Joshua B. Tenenbaum,et al.  Structure Discovery in Nonparametric Regression through Compositional Kernel Search , 2013, ICML.

[7]  P. Crago,et al.  Multijoint dynamics and postural stability of the human arm , 2004, Experimental Brain Research.

[8]  Bernhard Schölkopf,et al.  Probabilistic Modeling of Human Movements for Intention Inference , 2012, Robotics: Science and Systems.

[9]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[10]  Mark L. Nagurka,et al.  Dynamic and loaded impedance components in the maintenance of human arm posture , 1993, IEEE Trans. Syst. Man Cybern..

[11]  Sandra Hirche,et al.  Risk-Sensitive Optimal Feedback Control for Haptic Assistance , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Grant D. Huang,et al.  Robot-assisted therapy for long-term upper-limb impairment after stroke. , 2010, The New England journal of medicine.

[13]  Shital S. Chiddarwar,et al.  Robot programming by demonstration using teleoperation through imitation , 2017, Ind. Robot.

[14]  Jan Babič,et al.  Unifying Speed-Accuracy Trade-Off and Cost-Benefit Trade-Off in Human Reaching Movements , 2017, Front. Hum. Neurosci..

[15]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[16]  D. Reinkensmeyer,et al.  Review of control strategies for robotic movement training after neurologic injury , 2009, Journal of NeuroEngineering and Rehabilitation.

[17]  Keng Peng Tee,et al.  A model of force and impedance in human arm movements , 2004, Biological Cybernetics.

[18]  H. Gomi,et al.  Task-Dependent Viscoelasticity of Human Multijoint Arm and Its Spatial Characteristics for Interaction with Environments , 1998, The Journal of Neuroscience.

[19]  Neil D. Lawrence,et al.  Sparse Convolved Gaussian Processes for Multi-output Regression , 2008, NIPS.

[20]  Sandra Hirche,et al.  Impedance-based Gaussian Processes for predicting human behavior during physical interaction , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[21]  David W. Franklin,et al.  Computational Mechanisms of Sensorimotor Control , 2011, Neuron.

[22]  Rieko Osu,et al.  The central nervous system stabilizes unstable dynamics by learning optimal impedance , 2001, Nature.

[23]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[24]  Harry van Zanten,et al.  Information Rates of Nonparametric Gaussian Process Methods , 2011, J. Mach. Learn. Res..

[25]  Agathe Girard,et al.  Dynamic systems identification with Gaussian processes , 2005 .

[26]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[27]  Michael Goldfarb,et al.  Modeling the human hand as it interacts with a telemanipulation system , 2005 .

[28]  Abderrahmane Kheddar,et al.  Motion learning and adaptive impedance for robot control during physical interaction with humans , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Yoshiyuki Tanaka,et al.  Task readiness impedance in human arm movements for virtual ball-catching task , 2003, IECON'03. 29th Annual Conference of the IEEE Industrial Electronics Society (IEEE Cat. No.03CH37468).

[30]  Mahdi Tavakoli,et al.  Measuring the dynamic impedance of the human arm without a force sensor , 2013, 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR).

[31]  Carl E. Rasmussen,et al.  Derivative Observations in Gaussian Process Models of Dynamic Systems , 2002, NIPS.

[32]  Daniel M. Wolpert,et al.  Making smooth moves , 2022 .

[33]  Pyung Hun Chang,et al.  Stochastic Estimation of Human Arm Impedance Using Robots With Nonlinear Frictions: An Experimental Validation , 2013, IEEE/ASME Transactions on Mechatronics.

[34]  Khairul Anam,et al.  Active Exoskeleton Control Systems: State of the Art , 2012 .

[35]  Tamio Arai,et al.  Human-robot cooperative manipulation with motion estimation , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[36]  Rieko Osu,et al.  CNS Learns Stable, Accurate, and Efficient Movements Using a Simple Algorithm , 2008, The Journal of Neuroscience.

[37]  Sylvain Miossec,et al.  Human motion in cooperative tasks: Moving object case study , 2009, 2008 IEEE International Conference on Robotics and Biomimetics.

[38]  Mitsuo Kawato,et al.  Human arm stiffness and equilibrium-point trajectory during multi-joint movement , 1997, Biological Cybernetics.

[39]  Murat Cenk Cavusoglu,et al.  Human-Arm-and-Hand-Dynamic Model With Variability Analyses for a Stylus-Based Haptic Interface , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[40]  Panagiotis K. Artemiadis,et al.  Human arm impedance: Characterization and modeling in 3D space , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Yoshiyuki Tanaka,et al.  Analysis of mechanical impedance in human arm movements using a virtual tennis system , 2004, Biological Cybernetics.

[42]  Sandra Hirche,et al.  Mean Square Prediction Error of Misspecified Gaussian Process Models , 2018, 2018 IEEE Conference on Decision and Control (CDC).

[43]  Aude Billard,et al.  Hand Impedance Measurements During Interactive Manual Welding With a Robot , 2015, IEEE Transactions on Robotics.

[44]  Clément Gosselin,et al.  Safe, Stable and Intuitive Control for Physical Human-Robot Interaction , 2009, 2009 IEEE International Conference on Robotics and Automation.

[45]  Stefan Schaal,et al.  Robot Programming by Demonstration , 2009, Springer Handbook of Robotics.

[46]  Vincent Q. Vu,et al.  A MULTIVARIATE GAUSSIAN PROCESS FACTOR MODEL FOR HAND SHAPE DURING REACH-TO-GRASP MOVEMENTS. , 2015, Statistica Sinica.

[47]  David J. Fleet,et al.  This article has been accepted for publication in a future issue of this journal, but has not been fully edited. Content may change prior to final publication. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE Gaussian Process Dynamical Model , 2007 .

[48]  Bruno Siciliano,et al.  Variable Impedance Control of Redundant Manipulators for Intuitive Human–Robot Physical Interaction , 2015, IEEE Transactions on Robotics.

[49]  Mitsuo Kawato,et al.  Internal models for motor control and trajectory planning , 1999, Current Opinion in Neurobiology.

[50]  Hendrik Van Brussel,et al.  Human-inspired robot assistant for fast point-to-point movements , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[51]  A. Goldberger,et al.  On the Exact Covariance of Products of Random Variables , 1969 .