A model-based image-matching technique for three-dimensional reconstruction of human motion from uncalibrated video sequences.

In many situations, e.g. sports injuries, three-dimensional kinematics cannot be obtained with traditional lab methods. However, if methods for reconstructing motion patterns from video sequences were available, our understanding of injury mechanisms could be improved. The aim of this study was to assess the accuracy of a new model-based image-matching technique for human motion reconstruction from one or more uncalibrated video sequences, using traditional motion analysis as a gold standard. A laboratory trial was conducted with one test subject performing jogging and side step cutting, while being filmed with three ordinary video cameras. This provided three single camera matchings, three double camera matchings and one triple camera matching for each of the motions. The test subject wore 33 reflective skin markers and was filmed with a seven-camera, 240 Hz motion analysis system. Root mean square (RMS) hip and knee flexion/extension angle differences were less than 12 degrees for all the matchings. Estimates for ad-/abduction (<15 degrees) and internal/external rotation (<16 degrees) were less precise. RMS velocity differences up to 0.62 m/s were found for the single camera matchings, but for the triple camera matching the RMS differences were less than 0.13 m/s for each direction. In conclusion, a new model-based image-matching technique has been developed, that can be used to estimate temporal joint angle histories, velocities and accelerations from uncalibrated video recordings. The kinematic estimates, in particular for center of mass velocity and acceleration, are clearly better when two or more camera views are available. This method can potentially be used to arrive at more precise descriptions of the mechanisms of sports injuries than what has been possible without elaborate methods for three-dimensional reconstruction from uncalibrated video sequences, e.g. for knee injuries.

[1]  Jane Wilhelms,et al.  Human motion from active contours , 2000, Proceedings Workshop on Human Motion.

[2]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[3]  W D Lew,et al.  Mechanics of the anterior drawer and talar tilt tests. A cadaveric study of lateral ligament injuries of the ankle. , 1997, Acta orthopaedica Scandinavica.

[4]  Yoshito Ohta,et al.  Human action tracking guided by key-frames , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[5]  M. Yeadon.  The simulation of aerial movement--II. A mathematical inertia model of the human body. , 1990, Journal of biomechanics.

[6]  A. J. van den Bogert,et al.  Effect of skin movement on the analysis of skeletal knee joint motion during running. , 1997, Journal of biomechanics.

[7]  R. B. Davis,et al.  A gait analysis data collection and reduction technique , 1991 .

[8]  Lars Engebretsen,et al.  Injury Mechanisms for Anterior Cruciate Ligament Injuries in Team Handball , 2004, The American journal of sports medicine.

[9]  C F Ettlinger,et al.  A Method to Help Reduce the Risk of Serious Knee Sprains Incurred in Alpine Skiing , 1995, The American journal of sports medicine.

[10]  L. Engebretsen,et al.  Registration of cruciate ligament injuries in Norwegian top level team handball. A prospective study covering two seasons , 1997, Scandinavian journal of medicine & science in sports.

[11]  D Wright,et al.  A neural network approach to markerless measurement of human motion. , 1997, Biomedical sciences instrumentation.

[12]  Kjartan Halvorsen,et al.  Model-Based Methods in Motion Capture , 2002 .

[13]  J J O'Connor,et al.  Bone position estimation from skin marker co-ordinates using global optimisation with joint constraints. , 1999, Journal of biomechanics.

[14]  D R Pedersen,et al.  A comparison of the accuracy of several hip center location prediction methods. , 1990, Journal of biomechanics.

[15]  Paolo de Leva,et al.  Joint center longitudinal positions computed from a selected subset of Chandler's data , 1996 .

[16]  R. Bahr,et al.  A prospective cohort study of anterior cruciate ligament injuries in elite Norwegian team handball , 1998, Scandinavian journal of medicine & science in sports.

[17]  K. Markolf,et al.  Combined knee loading states that generate high anterior cruciate ligament forces , 1995, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[18]  P. de Leva,et al.  Joint center longitudinal positions computed from a selected subset of Chandler's data. , 1996, Journal of biomechanics.

[19]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[20]  J. Ambrósio,et al.  Spatial reconstruction of the human motion based on images of a single camera. , 2001, Journal of biomechanics.

[21]  Carlin Senter,et al.  Biomechanical Analysis of Tibial Torque and Knee Flexion Angle , 2006, Sports medicine.

[22]  A J van den Bogert,et al.  Computer simulation of landing movement in downhill skiing: anterior cruciate ligament injuries. , 1996, Journal of biomechanics.

[23]  P Schaff,et al.  ACL Injury Mechanism in Alpine Skiing: Analysis of an Accidental ACL Rupture , 1999 .

[24]  I Söderkvist,et al.  Determining the movements of the skeleton using well-configured markers. , 1993, Journal of biomechanics.

[25]  Francisco J. Perales,et al.  A system for human motion matching between synthetic and real images based on a biomechanic graphical model , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[26]  Herman J. Woltring,et al.  A fortran package for generalized, cross-validatory spline smoothing and differentiation , 1986 .

[27]  B. Boden,et al.  Mechanisms of anterior cruciate ligament injury. , 2000, Orthopedics.

[28]  Jiang Yu Zheng,et al.  Interactive human motion acquisition from video sequences , 2000, Proceedings Computer Graphics International 2000.

[29]  H. Woltring.  3-D attitude representation of human joints: a standardization proposal. , 1994, Journal of biomechanics.

[30]  D. Winter,et al.  Kinetic analysis of the lower limbs during walking: what information can be gained from a three-dimensional model? , 1995, Journal of biomechanics.

[31]  R. Zernicke,et al.  Human patellar-tendon rupture. , 1977, The Journal of bone and joint surgery. American volume.