A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach

Human motion capture is frequently used to study musculoskeletal biomechanics and clinical problems, as well as to provide realistic animation for the entertainment industry. The most popular technique for human motion capture uses markers placed on the skin, despite some important drawbacks including the impediment to the motion by the presence of skin markers and relative movement between the skin where the markers are placed and the underlying bone. The latter makes it difficult to estimate the motion of the underlying bone, which is the variable of interest for biomechanical and clinical applications. A model-based markerless motion capture system is presented in this study, which does not require the placement of any markers on the subject's body. The described method is based on visual hull reconstruction and an a priori model of the subject. A custom version of adapted fast simulated annealing has been developed to match the model to the visual hull. The tracking capability and a quantitative validation of the method were evaluated in a virtual environment for a complete gait cycle. The obtained mean errors, for an entire gait cycle, for knee and hip flexion are respectively 1.5° (±3.9°) and 2.0° (±3.0°), while for knee and hip adduction they are respectively 2.0° (±2.3°) and 1.1° (±1.7°). Results for the ankle and shoulder joints are also presented. Experimental results captured in a gait laboratory with a real subject are also shown to demonstrate the effectiveness and potential of the presented method in a clinical environment.

[1]  A. Pedotti,et al.  Functionally oriented and clinically feasible quantitative gait analysis method , 1998, Medical and Biological Engineering and Computing.

[2]  Michael J. Black,et al.  Cardboard people: A parametrized model of articulated motion , 1996 .

[3]  Pietro Perona,et al.  Monocular tracking of the human arm in 3D , 1995, Proceedings of IEEE International Conference on Computer Vision.

[4]  Stefano Corazza,et al.  Most favorable camera configuration for a shape-from-silhouette markerless motion capture system for biomechanical analysis , 2005 .

[5]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[6]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[7]  Takeo Kanade,et al.  Shape-From-Silhouette Across Time Part II: Applications to Human Modeling and Markerless Motion Tracking , 2005, International Journal of Computer Vision.

[8]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 3. Soft tissue artifact assessment and compensation. , 2005, Gait & posture.

[9]  Michael J. Black,et al.  Cardboard people: a parameterized model of articulated image motion , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[10]  Michael Potmesil.  Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[11]  A Leardini,et al.  Position and orientation in space of bones during movement: experimental artefacts. , 1996, Clinical biomechanics.

[12]  Takeo Kanade,et al.  Model-based tracking of self-occluding articulated objects , 1995, Proceedings of IEEE International Conference on Computer Vision.

[13]  Ioannis A. Kakadiaris,et al.  Model-based estimation of 3D human motion with occlusion based on active multi-viewpoint selection , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Karl Rohr,et al.  Incremental recognition of pedestrians from image sequences , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[16]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[17]  Michael J. Black,et al.  A Quantitative Evaluation of Video-based 3D Person Tracking , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[18]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[19]  A Leardini,et al.  Position and orientation in space of bones during movement: anatomical frame definition and determination. , 1995, Clinical biomechanics.

[20]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Saïd Salhi,et al.  A hybrid algorithm for identifying global and local minima when optimizing functions with many minima , 2004, Eur. J. Oper. Res..

[22]  H. Szu.  Fast simulated annealing , 1987 .

[23]  Andrea Bottino,et al.  A Silhouette Based Technique for the Reconstruction of Human Movement , 2001, Comput. Vis. Image Underst..

[24]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[25]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 1: theoretical background. , 2005, Gait & posture.

[26]  M. Sati,et al.  Quantitative assessment of skin-bone movement at the knee , 1996 .

[27]  Lester Ingber,et al.  Simulated annealing: Practice versus theory , 1993 .

[28]  L. Ingber.  Very fast simulated re-annealing , 1989 .

[29]  Annegret Mündermann,et al.  Conditions that influence the accuracy of anthropometric parameter estimation for human body segments using shape-from-silhouette , 2005 .

[30]  Larry S. Davis,et al.  Towards 3-D model-based tracking and recognition of human movement: a multi-view approach , 1995 .

[31]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 2: instrumental errors. , 2004, Gait & posture.

[32]  R. Mann,et al.  A comparison of lower-extremity skeletal kinematics measured using skin- and pin-mounted markers , 1997 .

[33]  M. Locatelli.  Simulated Annealing Algorithms for Continuous Global Optimization: Convergence Conditions , 2000 .