Data-Driven Approach to Simulating Realistic Human Joint Constraints

Modeling realistic human joint limits is important for applications involving physical human-robot interaction. However, setting appropriate human joint limits is challenging because it is pose-dependent: the range of joint motion varies depending on the positions of other bones. The paper introduces a new technique to accurately simulate human joint limits in physics simulation. We propose to learn an implicit equation to represent the boundary of valid human joint configurations from real human data. The function in the implicit equation is represented by a fully connected neural network whose gradients can be efficiently computed via back-propagation. Using gradients, we can efficiently enforce realistic human joint limits through constraint forces in a physics engine or as constraints in an optimization problem.

[1]  Ernesto Brau,et al.  A Bayesian part-based approach to 3D human pose and camera estimation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[2]  Pascal Fua,et al.  Hierarchical implicit surface joint limits for human body tracking , 2005, Comput. Vis. Image Underst..

[3]  Cristian Sminchisescu,et al.  Estimating Articulated Human Motion with Covariance Scaled Sampling , 2003, Int. J. Robotics Res..

[4]  H Hatze A three-dimensional multivariate model of passive human joint torques and articular boundaries. , 1997, Clinical biomechanics.

[5]  Karen Liu Dynamic Animation and Robotics Toolkit , 2014 .

[6]  Siddhartha S. Srinivasa,et al.  DART: Dynamic Animation and Robotics Toolkit , 2018, J. Open Source Softw..

[7]  C. Karen Liu,et al.  Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture , 2014, ACM Trans. Graph..

[8]  Jessica K. Hodgins,et al.  Constraint-based motion optimization using a statistical dynamic model , 2007, ACM Trans. Graph..

[9]  Yen-Lin Chen,et al.  Interactive generation of human animation with deformable motion models , 2009, TOGS.

[10]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, ACM Trans. Graph..

[11]  Aaron Hertzmann,et al.  Style machines , 2000, SIGGRAPH 2000.

[12]  Qiang Ji,et al.  Data-Free Prior Model for Upper Body Pose Estimation and Tracking , 2013, IEEE Transactions on Image Processing.

[13]  Gang Li,et al.  Range of Motion and Orientation of the Lumbar Facet Joints In Vivo , 2009, Spine.

[14]  Emanuel Todorov,et al.  Convex and analytically-invertible dynamics with contacts and constraints: Theory and implementation in MuJoCo , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  J. Verriest,et al.  Three-dimensional modelling of the motion range of axial rotation of the upper arm. , 1998, Journal of biomechanics.

[16]  Takeo Kanade,et al.  Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models , 2003, Int. J. Robotics Res..

[17]  A E Engin,et al.  Statistical data base for the biomechanical properties of the human shoulder complex--I: Kinematics of the shoulder complex. , 1986, Journal of biomechanical engineering.

[18]  Richard S. Snell Clinical Anatomy by Systems , 2006 .

[19]  David Demirdjian Enforcing Constraints for Human Body Tracking , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[20]  Michael J. Black,et al.  Pose-conditioned joint angle limits for 3D human pose reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).