Robust object tracking techniques for vision-based 3D motion analysis applications

Automated and accurate spatial motion capturing of an object is necessary for a wide variety of applications including industry and science, virtual reality and movie, medicine and sports. For the most part of applications a reliability and an accuracy of the data obtained as well as convenience for a user are the main characteristics defining the quality of the motion capture system. Among the existing systems for 3D data acquisition, based on different physical principles (accelerometry, magnetometry, time-of-flight, vision-based), optical motion capture systems have a set of advantages such as high speed of acquisition, potential for high accuracy and automation based on advanced image processing algorithms. For vision-based motion capture accurate and robust object features detecting and tracking through the video sequence are the key elements along with a level of automation of capturing process. So for providing high accuracy of obtained spatial data the developed vision-based motion capture system “Mosca” is based on photogrammetric principles of 3D measurements and supports high speed image acquisition in synchronized mode. It includes from 2 to 4 technical vision cameras for capturing video sequences of object motion. The original camera calibration and external orientation procedures provide the basis for high accuracy of 3D measurements. A set of algorithms as for detecting, identifying and tracking of similar targets, so for marker-less object motion capture is developed and tested. The results of algorithms’ evaluation show high robustness and high reliability for various motion analysis tasks in technical and biomechanics applications.

[1]  Roberto Cipolla,et al.  Real-Time Tracking of Complex Structures for Visual Servoing , 1999, Workshop on Vision Algorithms.

[2]  V. A. Knyaz,et al.  MULTI-MEDIA PROJECTOR - SINGLE CAMERA PHOTOGRAMMETRIC SYSTEM FOR FAST 3D RECONSTRUCTION , 2010 .

[3]  V. A. Knyaz SCALABLE PHOTOGRAMMETRIC MOTION CAPTURE SYSTEM “MOSCA”: DEVELOPMENT AND APPLICATION , 2015 .

[4]  Richard Szeliski,et al.  Vision Algorithms: Theory and Practice , 2002, Lecture Notes in Computer Science.

[5]  Yury Vizilter,et al.  SPECTRUM-BASED OBJECT DETECTION AND TRACKING TECHNIQUE FOR DIGITAL VIDEO SURVEILLANCE , 2012 .

[6]  Pushmeet Kohli,et al.  PoseCut: Simultaneous Segmentation and 3D Pose Estimation of Humans Using Dynamic Graph-Cuts , 2006, ECCV.

[7]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ian D. Reid,et al.  Articulated Body Motion Capture by Stochastic Search , 2005, International Journal of Computer Vision.

[9]  Bodo Rosenhahn,et al.  Three-Dimensional Shape Knowledge for Joint Image Segmentation and Pose Tracking , 2007, International Journal of Computer Vision.

[10]  Vladimir A. Knyaz,et al.  Stereo sequences analysis for dynamic scene understanding in a driver assistance system , 2015, Optical Metrology.

[11]  Vincent Lepetit,et al.  Monocular Model-Based 3D Tracking of Rigid Objects: A Survey , 2005, Found. Trends Comput. Graph. Vis..

[12]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[13]  Clive S. Fraser,et al.  Tracking of object points in a photogrammetric motion capture system , 2000, IS&T/SPIE Electronic Imaging.