Evaluation of on-line analytic and numeric inverse kinematics approaches driven by partial vision input

Despite its central role in the constitution of a truly enactive interface, 3D interaction through human full body movement has been hindered by a number of technological and algorithmic factors. Let us mention the cumbersome magnetic equipments, or the underdetermined data set provided by less invasive video-based approaches. In the present paper, we explore the recovery of the full body posture of a standing subject in front of a stereo camera system. The 3D position of the hands, the head and the center of the trunk segment are extracted in real-time and provided to the body posture recovery algorithmic layer. We focus on the comparison between numeric and analytic inverse kinematics approaches in terms of performances and overall quality of the reconstructed body posture. Algorithmic issues arise from the very partial and noisy input and the singularity of the human standing posture. Despite stability concerns, results confirm the pertinence of this approach in this demanding context.

[1]  A. A. Maciejewsk.  Dealing with the Ill-Conditioned Epuations of Motion for Articulated Figures , 1990 .

[2]  Anthony A. Maciejewski,et al.  Dealing with the ill-conditioned equations of motion for articulated figures , 1990, IEEE Computer Graphics and Applications.

[3]  Norman I. Badler,et al.  Real-Time Control of a Virtual Human Using Minimal Sensors , 1993, Presence: Teleoperators & Virtual Environments.

[4]  Daniel Thalmann,et al.  A robust approach for the center of mass position control with inverse kinetics , 1996 .

[5]  Daniel Thalmann,et al.  A robust approach for the control of the center of mass with inverse kinetics , 1996, Comput. Graph..

[6]  Bobby Bodenheimer,et al.  The Process of Motion Capture: Dealing with the Data , 1997, Computer Animation and Simulation.

[7]  David J. Sturman,et al.  Computer Puppetry , 1998, IEEE Computer Graphics and Applications.

[8]  Michael I. Jordan.  Graphical Models , 2003 .

[9]  Nebojsa Jojic,et al.  Tracking self-occluding articulated objects in dense disparity maps , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Daniel Thalmann,et al.  An architecture for immersive evaluation of complex human tasks , 1999, IEEE Trans. Robotics Autom..

[11]  Alex Pentland,et al.  Understanding purposeful human motion , 1999, Proceedings IEEE International Workshop on Modelling People. MPeople'99.

[12]  Jessica K. Hodgins,et al.  Automatic Joint Parameter Estimation from Magnetic Motion Capture Data , 2023, Graphics Interface.

[13]  V. Pisarevsky,et al.  Intel's Computer Vision Library: applications in calibration, stereo segmentation, tracking, gesture, face and object recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[14]  Norman I. Badler,et al.  Real-Time Inverse Kinematics Techniques for Anthropomorphic Limbs , 2000, Graph. Model..

[15]  Alex Pentland,et al.  Understanding purposeful human motion , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[16]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[17]  Patrick Horain,et al.  3D model based gesture acquisition using a single camera , 2002, Sixth IEEE Workshop on Applications of Computer Vision, 2002. (WACV 2002). Proceedings..

[18]  Ronan Boulic,et al.  Virtual Worker Reachable Space Evaluation with Prioritized Inverse Kinematics , 2003 .

[19]  Tieniu Tan,et al.  Recent developments in human motion analysis , 2003, Pattern Recognit..

[20]  Aaron Hertzmann,et al.  Style-based inverse kinematics , 2004, SIGGRAPH 2004.

[21]  Ronan Boulic,et al.  An inverse kinematics architecture enforcing an arbitrary number of strict priority levels , 2004, The Visual Computer.

[22]  Jitendra Malik,et al.  Twist Based Acquisition and Tracking of Animal and Human Kinematics , 2004, International Journal of Computer Vision.

[23]  Michael J. Black,et al.  Learning the Statistics of People in Images and Video , 2003, International Journal of Computer Vision.

[24]  Ronan Boulic,et al.  Challenges in Exploiting Prioritized Inverse Kinematics for Motion Capture and Postural Control , 2005, Gesture Workshop.

[25]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, ACM Trans. Graph..

[26]  Jessica K. Hodgins,et al.  Performance animation from low-dimensional control signals , 2005, SIGGRAPH 2005.

[27]  Xavier Varona,et al.  Hands and face tracking for VR applications , 2005, Comput. Graph..