A full body human motion capture system using particle filtering and on-the-fly edge detection

In this paper we present a full body human motion capture system based on particle filtering operating on monocular image sequences. Distinguishing our approach from others is that edge detection is not carried out globally on the whole picture in a preprocess manner, but is done locally on-the-fly during the calculation of the likelihood function. This approach is effective and flexible at the same time, allowing the use of various edge detection algorithms with only small modifications. Another special feature of our system is a highly optimized occlusion test based on a fast point-in-triangIe test. Our system has been designed carefully with respect to serve as a basis for various research activities in the near future, including the incorporation of stereo vision. A general framework architecture for particle filters and an extension for appliance to edge tracking has been developed with which it is possible to test a whole range of search space decomposition variants with minimum implementation effort.

[1]  William H. Press,et al.  Numerical recipes in C (2nd ed.): the art of scientific computing , 1992 .

[2]  F. A. Seiler,et al.  Numerical Recipes in C: The Art of Scientific Computing , 1989 .

[3]  Jitendra Malik,et al.  Tracking people with twists and exponential maps , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[4]  Michael Isard,et al.  Partitioned Sampling, Articulated Objects, and Interface-Quality Hand Tracking , 2000, ECCV.

[5]  Andrew Blake,et al.  Articulated body motion capture by annealed particle filtering , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[6]  大野 義夫,et al.  Computer Graphics : Principles and Practice, 2nd edition, J.D. Foley, A.van Dam, S.K. Feiner, J.F. Hughes, Addison-Wesley, 1990 , 1991 .

[7]  Ralph Johnson,et al.  design patterns elements of reusable object oriented software , 2019 .

[8]  Hans-Hellmut Nagel,et al.  Tracking Persons in Monocular Image Sequences , 1999, Comput. Vis. Image Underst..

[9]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[10]  Hedvig Sidenbladh.  Probabilistic Tracking and Reconstruction of 3D Human Motion in Monocular Video Sequences , 2001 .

[11]  Rainer Stiefelhagen,et al.  Real-Time Person Tracking and Pointing Gesture Recognition for Human-Robot Interaction , 2004, ECCV Workshop on HCI.

[12]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[13]  Andrew Blake,et al.  Tracking through singularities and discontinuities by random sampling , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Michael Isard,et al.  A mixed-state condensation tracker with automatic model-switching , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[15]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.