Garment-based motion capture (GaMoCap): high-density capture of human shape in motion

This paper presents a new motion capture (MoCap) system, the garment-based motion capture system—GaMoCap. The key feature is the use of an easily wearable garment printed with colour-coded pattern and a generic multicamera setup with standard video cameras. The coded pattern allows a high-density distribution of markers per unit of surface (about 40 markers per 100 cm$$^2$$2), avoiding markers-swap errors. The high density of markers reconstructed makes possible a simultaneous reconstruction of shape and motion, which gives several concurrent advantages with respect to the state of the art and providing performances comparable with previous marker-based systems. In particular, we provide effective solutions to counter the soft-tissue artefact which is a common problem for garment-based techniques. This effect is reduced using Point Cluster Technique to filter out the points strongly affected by non-rigid motion. Uncertainty of motion estimation has been experimentally quantified by comparing with a state-of-the-art commercial system and numerically predicted by means of a Monte Carlo Method procedure. The experimental evaluation was performed on three different articulated motions: shoulder, knee and hip flexion-extension. The results shows that for the three motion angles estimated with GaMoCap, the system provides comparable accuracies against a commercial VICON system.

[1]  Luca Ballan,et al.  Multimodal 3D Shape Recovery from Texture, Silhouette and Shadow Information , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[2]  Taku Komura,et al.  Capturing Close Interactions with Objects Using a Magnetic Motion Capture System and a RGBD Sensor , 2012, MIG.

[3]  D. Roetenberg,et al.  Xsens MVN: Full 6DOF Human Motion Tracking Using Miniature Inertial Sensors , 2009 .

[4]  R. D. Dorociak,et al.  Determining 3-D System Accuracy for the VICON 370 System , 1995 .

[5]  George E Gorton,et al.  Assessment of the kinematic variability among 12 motion analysis laboratories. , 2009, Gait & posture.

[6]  金谷 健一 Statistical optimization for geometric computation : theory and practice , 2005 .

[7]  O. Svensson,et al.  Kinematics of the Ankle/Foot Complex—Part 3: Influence of Leg Rotation , 1989, Foot & ankle.

[8]  Xuelong Li,et al.  Nonrigid Structure-From-Motion From 2-D Images Using Markov Chain Monte Carlo , 2012, IEEE Transactions on Multimedia.

[9]  Alexandru Tupan,et al.  Triangulation , 1997, Comput. Vis. Image Underst..

[10]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[11]  Emiliano Gambaretto,et al.  Automatic Generation of a Subject-Specific Model for Accurate Markerless Motion Capture and Biomechanical Applications , 2010, IEEE Transactions on Biomedical Engineering.

[12]  Marc Pollefeys,et al.  A General Framework for Motion Segmentation: Independent, Articulated, Rigid, Non-rigid, Degenerate and Non-degenerate , 2006, ECCV.

[13]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 1: theoretical background. , 2005, Gait & posture.

[14]  Andrew W. Fitzgibbon,et al.  Real-time human pose recognition in parts from single depth images , 2011, CVPR 2011.

[15]  R. Hartley Triangulation, Computer Vision and Image Understanding , 1997 .

[16]  Huosheng Hu,et al.  Classification of Upper Limb Motion Trajectories Using Shape Features , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[17]  Francesco Setti,et al.  A Unified Framework for Uncertainty, Compatibility Analysis, and Data Fusion for Multi-Stereo 3-D Shape Estimation , 2010, IEEE Transactions on Instrumentation and Measurement.

[18]  Angelo Cappello,et al.  Quantification of soft tissue artefact in motion analysis by combining 3D fluoroscopy and stereophotogrammetry: a study on two subjects. , 2005, Clinical biomechanics.

[19]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[20]  A. Cappozzo,et al.  Human movement analysis using stereophotogrammetry. Part 3. Soft tissue artifact assessment and compensation. , 2005, Gait & posture.

[21]  Antti Oulasvirta,et al.  Computer Vision – ECCV 2006 , 2006, Lecture Notes in Computer Science.

[22]  Keiichi Abe,et al.  Topological structural analysis of digitized binary images by border following , 1985, Comput. Vis. Graph. Image Process..

[23]  Michael J. Black,et al.  Home 3D body scans from noisy image and range data , 2011, 2011 International Conference on Computer Vision.

[24]  Roberto Tron RenVidal A Benchmark for the Comparison of 3-D Motion Segmentation Algorithms , 2007 .

[25]  T P Andriacchi,et al.  A point cluster method for in vivo motion analysis: applied to a study of knee kinematics. , 1998, Journal of biomechanical engineering.

[26]  Markus Windolf,et al.  Systematic accuracy and precision analysis of video motion capturing systems--exemplified on the Vicon-460 system. , 2008, Journal of biomechanics.

[27]  Greg Welch,et al.  Motion Tracking: No Silver Bullet, but a Respectable Arsenal , 2002, IEEE Computer Graphics and Applications.

[28]  Volker Scholz,et al.  Garment Motion Capture Using Color‐Coded Patterns , 2005, Comput. Graph. Forum.

[29]  Marcus J Fuhrer,et al.  Rehabilitation medicine summit: building research capacity Executive Summary , 2006, Journal of NeuroEngineering and Rehabilitation.

[30]  M. De Cecco,et al.  Uncertainty analysis for multi-stereo 3d shape estimation , 2009, 2009 IEEE International Workshop on Advanced Methods for Uncertainty Estimation in Measurement.

[31]  Andrew W. Fitzgibbon,et al.  Bundle Adjustment - A Modern Synthesis , 1999, Workshop on Vision Algorithms.

[32]  P R Cavanagh,et al.  Three-dimensional kinematics of the human knee during walking. , 1992, Journal of biomechanics.

[33]  Jean-Yves Bouguet,et al.  Camera calibration toolbox for matlab , 2001 .

[34]  Yaser Sheikh,et al.  Motion capture from body-mounted cameras , 2011, ACM Trans. Graph..

[35]  Alessio Del Bue,et al.  Non-Rigid Metric Shape and Motion Recovery from Uncalibrated Images Using Priors , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[36]  Alessio Del Bue,et al.  A Multi-view Stereo System for Articulated Motion Analysis , 2010, VISAPP.

[37]  Thomas P Andriacchi,et al.  The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications , 2006, Journal of NeuroEngineering and Rehabilitation.

[38]  J. Marks,et al.  Garment Motion Capture Using Color‐Coded Patterns , 2005, SIGGRAPH '05.

[39]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[40]  A. J. van den Bogert,et al.  Effect of skin movement on the analysis of skeletal knee joint motion during running. , 1997, Journal of biomechanics.

[41]  Adrien Bartoli,et al.  Coarse-to-fine low-rank structure-from-motion , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.