Hierarchical implicit surface joint limits for human body tracking

To increase the reliability of existing human motion tracking algorithms, we propose a method for imposing limits on the underlying hierarchical joint structures in a way that is true to life. Unlike most existing approaches, we explicitly represent dependencies between the various degrees of freedom and derive these limits from actual experimental data. To this end, we use quaternions to represent individual 3 DOF joint rotations and Euler angles for 2 DOF rotations, which we have experimentally sampled using an optical motion capture system. Each set of valid positions is bounded by an implicit surface and we handle hierarchical dependencies by representing the space of valid configurations for a child joint as a function of the position of its parent joint. This representation provides us with a metric in the space of rotations that readily lets us determine whether a posture is valid or not. As a result, it becomes easy to incorporate these sophisticated constraints into a motion tracking algorithm, using standard constrained optimization techniques. We demonstrate this by showing that doing so dramatically improves performance of an existing system when attempting to track complex and ambiguous upper body motions from low quality stereo data.

[1]  C.G.M. Meskers,et al.  3D shoulder position measurements using a six-degree-of-freedom electromagnetic tracking device. , 1998, Clinical biomechanics.

[2]  S T Tümer,et al.  Three-dimensional kinematic modelling of the human shoulder complex--Part II: Mathematical modelling and solution via optimization. , 1989, Journal of biomechanical engineering.

[3]  Randal W. Beard,et al.  Model Independent Approximate Eigenaxis Rotations via Quaternion Feedback , 2001 .

[4]  G. Smidt,et al.  Measurement of hip-joint motion during walking. Evaluation of an electrogoniometric method. , 1969, The Journal of bone and joint surgery. American volume.

[5]  H Hatze A three-dimensional multivariate model of passive human joint torques and articular boundaries. , 1997, Clinical biomechanics.

[6]  Marko Munih,et al.  Identifying shoulder and elbow passive moments and muscle contributions during static flexion-extension movements in the sagittal plane , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Pascal Fua,et al.  An automatic method for determining quaternion field boundaries for ball-and-socket joint limits , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  N. Bobick Rotating objects using quaternions , 1998 .

[9]  A. Fournier,et al.  Shape Transformations Using Union of Spheres , 1995 .

[10]  Thomas B. Moeslund,et al.  Pose estimation of a human arm using kinematic constraints , 2001 .

[11]  Jon A. Webb,et al.  Quaternions in Computer Vision and Robotics , 1982 .

[12]  Takeo Kanade,et al.  Ambiguities in Visual Tracking of Articulated Objects Using Two- and Three-Dimensional Models , 2003, Int. J. Robotics Res..

[13]  S T Tümer,et al.  Three-dimensional kinematic modelling of the human shoulder complex--Part I: Physical model and determination of joint sinus cones. , 1989, Journal of biomechanical engineering.

[14]  F. Sebastian Grassia,et al.  Practical Parameterization of Rotations Using the Exponential Map , 1998, J. Graphics, GPU, & Game Tools.

[15]  Pascal Fua,et al.  Automatic Determination of Shoulder Joint Limits using Experimentally Determined Quaternion Field Boundaries , 2003 .

[16]  Cristian Sminchisescu,et al.  Estimating Articulated Human Motion with Covariance Scaled Sampling , 2003, Int. J. Robotics Res..

[17]  Marie-Paule Cani,et al.  Implicit Surfaces for Semi-automatic Medical Organ Reconstruction , 1995, Computer Graphics.

[18]  David Demirdjian Enforcing Constraints for Human Body Tracking , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[19]  Walter Maurel,et al.  3D modeling of the human upper limb including the biomechanics of joints, muscles and soft tissues , 1999 .

[20]  Ken Shoemake,et al.  Animating rotation with quaternion curves , 1985, SIGGRAPH.

[21]  J. Verriest,et al.  Three-dimensional modelling of the motion range of axial rotation of the upper arm. , 1998, Journal of biomechanics.

[22]  Andrew S. Glassner,et al.  Graphics Gems , 1990 .

[23]  Pascal Fua,et al.  Automatic Determination of Shoulder Joint Limits Using Quaternion Field Boundaries , 2003, Int. J. Robotics Res..

[24]  Frans C. T. van der Helm,et al.  A standardized protocol for motion recordings of the shoulder , 2002 .

[25]  Alan Watt,et al.  Advanced animation and rendering techniques , 1992 .

[26]  Heinrich Niemann,et al.  Using Quaternions for Parametrizing 3-D Rotations in Unconstrained Nonlinear Optimization , 2001, VMV.

[27]  G. Smidt,et al.  Measurement of hip joint motion during walking , 1969 .

[28]  Ronan Boulic,et al.  Task-priority formulations for the kinematic control of highly redundant articulated structures , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[29]  Andrew J. Hanson,et al.  Constrained optimal framings of curves and surfaces using quaternion Gauss maps , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[30]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[31]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[32]  Pascal Fua,et al.  Articulated Soft Objects for Multiview Shape and Motion Capture , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[34]  P Y Willems,et al.  On the kinematic modelling and the parameter estimation of the human shoulder. , 1999, Journal of biomechanics.

[35]  O. Faugeras Three-dimensional computer vision: a geometric viewpoint , 1993 .

[36]  J. Bloomenthal Calculation of reference frames along a space curve , 1990 .

[37]  R. Plankers,et al.  Articulated soft objects for video-based body modeling , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[38]  F. S. Grassia A Practical Parameterization of 2 and 3 Degree of Freedom Rotations. , 1997 .