Hybrid predictive dynamics: a new approach to simulate human motion

A new methodology, called hybrid predictive dynamics (HPD), is introduced in this work to simulate human motion. HPD is defined as an optimization-based motion prediction approach in which the joint angle control points are unknowns in the equations of motion. Some of these control points are bounded by the experimental data. The joint torque and ground reaction forces are calculated by an inverse algorithm in the optimization procedure. Therefore, the proposed method is able to incorporate motion capture data into the formulation to predict natural and subject-specific human motions. Hybrid predictive dynamics includes three procedures, and each is a sub-optimization problem. First, the motion capture data are transferred from Cartesian space into joint space by using optimization-based inverse kinematics (IK) methodology. Secondly, joint profiles obtained from IK are interpolated by B-spline control points by using an error-minimization algorithm. Third, boundaries are built on the control points to represent specific joint profiles from experiments, and these boundaries are used to guide the predicted human motion. To predict more accurate motion, the boundaries can also be built on the kinetic variables if the experimental data are available. The efficiency of the method is demonstrated by simulating a box-lifting motion. The proposed method takes advantage of both prediction and tracking capabilities simultaneously, so that HPD has more applications in human motion prediction, especially towards clinical applications.

[1]  M L Audu,et al.  A dynamic optimization technique for predicting muscle forces in the swing phase of gait. , 1987, Journal of biomechanics.

[2]  C. S. G. Lee,et al.  Robotics: Control, Sensing, Vision, and Intelligence , 1987 .

[3]  Lei Ren,et al.  Predictive modelling of human walking over a complete gait cycle. , 2007, Journal of biomechanics.

[4]  Oussama Khatib,et al.  Robot multiple contact control , 2008, Robotica.

[5]  Fan-Tien Cheng,et al.  Optimal force distribution in multilegged vehicles , 1999, Robotica.

[6]  Marcus G Pandy,et al.  Simultaneous prediction of muscle and contact forces in the knee during gait. , 2010, Journal of biomechanics.

[7]  Les S. Jennings,et al.  Performance objectives in human movement: A review and application to the stance phase of normal walking , 1989 .

[8]  David J Reinkensmeyer,et al.  Dynamic motion planning for the design of robotic gait rehabilitation. , 2005, Journal of biomechanical engineering.

[9]  Yildirim Hurmuzlu,et al.  Dynamics of Bipedal Gait: Part II—Stability Analysis of a Planar Five-Link Biped , 1993 .

[10]  Yujiang Xiang,et al.  Optimization‐based dynamic human walking prediction: One step formulation , 2009 .

[11]  Marcus G Pandy,et al.  Muscle and joint function in human locomotion. , 2010, Annual review of biomedical engineering.

[12]  Jeffrey A. Reinbolt,et al.  Design of patient-specific gait modifications for knee osteoarthritis rehabilitation , 2007, IEEE Transactions on Biomedical Engineering.

[13]  Yujiang Xiang,et al.  A validation framework for predictive human models , 2011 .

[14]  Bernard Brogliato,et al.  Modeling, stability and control of biped robots - a general framework , 2004, Autom..

[15]  F. Zajac,et al.  Contributions of the individual ankle plantar flexors to support, forward progression and swing initiation during walking. , 2001, Journal of biomechanics.

[16]  David E. Orin,et al.  Efficient formulation of the force-distribution equations for simple closed-chain robotic mechanisms , 1991, IEEE Trans. Syst. Man Cybern..

[17]  Guy Bessonnet,et al.  Optimal Gait Synthesis of a Seven-Link Planar Biped , 2004, Int. J. Robotics Res..

[18]  Yannick Aoustin,et al.  Optimal reference trajectories for walking and running of a biped robot , 2001, Robotica.

[19]  Yujiang Xiang,et al.  Generating Effective Whole-Body Motions of a Human-like Mechanism with Efficient ZMP Formulation , 2009, Int. J. Robotics Autom..

[20]  M. Damsgaard,et al.  Muscle recruitment by the min/max criterion -- a comparative numerical study. , 2001, Journal of biomechanics.

[21]  Yujiang Xiang,et al.  Optimization-based prediction of asymmetric human gait. , 2011, Journal of biomechanics.

[22]  Marko Ackermann,et al.  Optimality principles for model-based prediction of human gait. , 2010, Journal of biomechanics.

[23]  Karim Abdel-Malek,et al.  Dynamic motion planning of 3D human locomotion using gradient-based optimization. , 2008, Journal of biomechanical engineering.

[24]  Dimitris N. Metaxas,et al.  Human Motion Planning Based on Recursive Dynamics and Optimal Control Techniques , 2002 .

[25]  Rodney A. Brooks,et al.  Humanoid robots , 2002, CACM.

[26]  Yujiang Xiang,et al.  Optimal crashworthiness design of a spot-welded thin-walled hat section , 2006 .

[27]  A. Cappozzo,et al.  Pelvis and lower limb anatomical landmark calibration precision and its propagation to bone geometry and joint angles , 1999, Medical & Biological Engineering & Computing.

[28]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[29]  John M. Hollerbach,et al.  A Recursive Lagrangian Formulation of Maniputator Dynamics and a Comparative Study of Dynamics Formulation Complexity , 1980, IEEE Transactions on Systems, Man, and Cybernetics.

[30]  G. Sohl,et al.  A Recursive Multibody Dynamics and Sensitivity Algorithm for Branched Kinematic Chains , 2001 .

[31]  Peter Wriggers,et al.  Computational Contact Mechanics , 2002 .

[32]  Jasbir S. Arora,et al.  Introduction to Optimum Design , 1988 .

[33]  R. W. Toogood,et al.  Efficient robot inverse and direct dynamics algorithms using microcomputer based symbolic generation , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[34]  O. A. Elwakeil,et al.  Global optimization methods for engineering applications: A review , 1995 .

[35]  D W Moran,et al.  A computationally efficient method for solving the redundant problem in biomechanics. , 1995, Journal of biomechanics.

[36]  Guy Bessonnet,et al.  A Parametric Optimization Approach to Walking Pattern Synthesis , 2005, Int. J. Robotics Res..

[37]  Yujiang Xiang,et al.  Dynamic motion planning of overarm throw for a biped human multibody system , 2010 .

[38]  Yujiang Xiang,et al.  Optimization-based motion prediction of mechanical systems: sensitivity analysis , 2009 .

[39]  L. F. Frey Law,et al.  A theoretical approach for modeling peripheral muscle fatigue and recovery. , 2008, Journal of biomechanics.

[40]  J. Arora,et al.  An augmented Lagrangian optimization method for contact analysis problems, 1: formulation and algorithm , 2004 .

[41]  Scott L. Delp,et al.  A computational framework for simulating and analyzing human and animal movement , 2000, Comput. Sci. Eng..

[42]  Michael Damsgaard,et al.  A study of The Effects of Two Different Kinematical Analysis Methods on the Calculated Muscle Activities in an Inverse Dynamics-based Musculoskeletal Model of Gait , 2007 .

[43]  J. Arora,et al.  Several simultaneous formulations for transient dynamic response optimization: An evaluation , 2009 .

[44]  J. Arora,et al.  Human lifting simulation using a multi-objective optimization approach , 2010 .

[45]  Guy Bessonnet,et al.  Generating globally optimised sagittal gait cycles of a biped robot , 2003, Robotica.

[46]  Richard R Neptune,et al.  Biomechanics and muscle coordination of human walking: part II: lessons from dynamical simulations and clinical implications. , 2003, Gait & posture.

[47]  Yannick Aoustin,et al.  Design of a walking cyclic gait with single support phases and impacts for the locomotor system of a thirteen-link 3D biped using the parametric optimization , 2009 .

[48]  D R Pedersen,et al.  Direct comparison of muscle force predictions using linear and nonlinear programming. , 1987, Journal of biomechanical engineering.

[49]  A Leardini,et al.  Position and orientation in space of bones during movement: anatomical frame definition and determination. , 1995, Clinical biomechanics.

[50]  Gyung-Jin Park,et al.  A review of optimization of structures subjected to transient loads , 2006 .

[51]  Richard R Neptune,et al.  The effect of walking speed on muscle function and mechanical energetics. , 2008, Gait & posture.

[52]  Ajay Seth,et al.  Muscle contributions to propulsion and support during running. , 2010, Journal of biomechanics.

[53]  Yujiang Xiang,et al.  Physics-based modeling and simulation of human walking: a review of optimization-based and other approaches , 2010 .

[54]  C. Bottasso,et al.  A numerical procedure for inferring from experimental data the optimization cost functions using a multibody model of the neuro-musculoskeletal system , 2006 .

[55]  Yujiang Xiang,et al.  Enhanced optimisation-based inverse kinematics methodology considering joint discomfort , 2011 .

[56]  Qiong Wu,et al.  Synthesis of a complete sagittal gait cycle for a five-link biped robot , 2003, Robotica.

[57]  Frank Chongwoo Park,et al.  Newton-type algorithms for robot motion optimization , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[58]  YUJIANG XIANG,et al.  3D Human Lifting Motion Prediction with Different Performance Measures , 2012, Int. J. Humanoid Robotics.

[59]  Jasbir S. Arora,et al.  An Optimization-Based Methodology to Predict Digital Human Gait Motion , 2005 .

[60]  Guy Bessonnet,et al.  Energetic versus sthenic optimality criteria for gymnastic movement synthesis , 2006 .

[61]  Yoshihiko Nakamura,et al.  Making feasible walking motion of humanoid robots from human motion capture data , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[62]  R Cham,et al.  The impact of a systematic reduction in shoe-floor friction on heel contact walking kinematics-- A gait simulation approach. , 2010, Journal of biomechanics.

[63]  J. Arora,et al.  Alternative Formulations for Optimization-Based Human Gait Planning , 2007 .

[64]  Guy Bessonnet,et al.  Parametric-based dynamic synthesis of 3D-gait , 2009, Robotica.

[65]  Kazuhito Yokoi,et al.  Planning walking patterns for a biped robot , 2001, IEEE Trans. Robotics Autom..

[66]  Yujiang Xiang,et al.  Optimization-Based Dynamic Human Gait Prediction , 2011 .

[67]  David E. Orin,et al.  Optimal force distribution in multiple-chain robotic systems , 1991, IEEE Trans. Syst. Man Cybern..

[68]  Chong-Ho Choi,et al.  An effective trajectory generation method for bipedal walking , 2007, Robotics Auton. Syst..

[69]  Manoj Srinivasan,et al.  Computer optimization of a minimal biped model discovers walking and running , 2006, Nature.

[70]  R. Brand,et al.  The biomechanics and motor control of human gait: Normal, elderly, and pathological , 1992 .

[71]  Guy Bessonnet,et al.  Sagittal gait of a biped robot during the single support phase. Part 1: passive motion , 2001, Robotica.

[72]  Richard R Neptune,et al.  Biomechanics and muscle coordination of human walking. Part I: introduction to concepts, power transfer, dynamics and simulations. , 2002, Gait & posture.

[73]  Richard R Neptune,et al.  Modular control of human walking: a simulation study. , 2009, Journal of biomechanics.

[74]  Ronald R. Yager,et al.  Comments on "Textured Sets: An Approach to Aggregation Problems with Multiple Concerns" , 1981, IEEE Transactions on Systems, Man and Cybernetics.

[75]  Joo Hyun Kim,et al.  Concurrent motion planning and reaction load distribution for redundant dynamic systems under external holonomic constraints , 2011 .

[76]  Qian Wang,et al.  Review of formulations for structural and mechanical system optimization , 2005 .

[77]  Yujiang Xiang,et al.  Predictive simulation of human walking transitions using an optimization formulation , 2012 .

[78]  Lei Ren,et al.  Dynamic analysis of load carriage biomechanics during level walking. , 2005, Journal of biomechanics.

[79]  S. Delp,et al.  The influence of muscles on knee flexion during the swing phase of gait. , 1996, Journal of biomechanics.

[80]  Joo H. Kim,et al.  Predictive dynamics: an optimization-based novel approach for human motion simulation , 2010 .

[81]  Allison S Arnold,et al.  Muscular coordination of knee motion during the terminal-swing phase of normal gait. , 2007, Journal of biomechanics.

[82]  Yildirim Hurmuzlu,et al.  Generating pathological gait patterns via the use of robotic locomotion models , 2002 .

[83]  Christopher L Vaughan,et al.  Theories of bipedal walking: an odyssey. , 2003, Journal of biomechanics.

[84]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[85]  A. Kuo A simple model of bipedal walking predicts the preferred speed-step length relationship. , 2001, Journal of biomechanical engineering.

[86]  Joo Hyun Kim,et al.  Prediction and analysis of human motion dynamics performing various tasks , 2006 .

[87]  F. Zajac Muscle and tendon: properties, models, scaling, and application to biomechanics and motor control. , 1989, Critical reviews in biomedical engineering.

[88]  J. Denavit,et al.  A kinematic notation for lower pair mechanisms based on matrices , 1955 .

[89]  Anders Eriksson,et al.  Optimization in target movement simulations , 2008 .

[90]  Wen-Han Qian,et al.  A Fast Procedure for Optimizing Dynamic Force Distribution in Multifingered Grasping , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[91]  Yu Zheng,et al.  Fast Equilibrium Test and Force Distribution for Multicontact Robotic Systems , 2010 .

[92]  David E. Orin,et al.  Efficient algorithm for optimal force distribution-the compact-dual LP method , 1990, IEEE Trans. Robotics Autom..

[93]  Changjiu Zhou,et al.  Estimating Biped Gait Using Spline-Based Probability Distribution Function With Q-Learning , 2008, IEEE Transactions on Industrial Electronics.

[94]  M G Pandy,et al.  Computer modeling and simulation of human movement. , 2001, Annual review of biomedical engineering.

[95]  Jasbir S. Arora Formulating Design Problems as Optimization Problems , 2010 .

[96]  Miomir Vukobratovic,et al.  Zero-Moment Point - Thirty Five Years of its Life , 2004, Int. J. Humanoid Robotics.

[97]  Walter Herzog,et al.  Model-based estimation of muscle forces exerted during movements. , 2007, Clinical biomechanics.

[98]  Mahdiar Hariri,et al.  A study of optimization-based predictive dynamics method for digital human modeling , 2012 .

[99]  Robert J. Wood,et al.  Towards a 3g crawling robot through the integration of microrobot technologies , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..