3D model based gesture acquisition using a single camera

We present a method for 3D human motion capture using a single camera, without markers and without a priori knowledge on gestures. It is based on registering a 3D articulated model on color images with respect to biomechanical constraints. Gestures regularization is discussed as a way to cope with projection ambiguities. Computation is reduced by registering only the moving parts of the body.

[1]  Takeo Kanade,et al.  Visual Tracking of High DOF Articulated Structures: an Application to Human Hand Tracking , 1994, ECCV.

[2]  Olivier D. Faugeras,et al.  3D Articulated Models and Multiview Tracking with Physical Forces , 2001, Comput. Vis. Image Underst..

[3]  Pascal Fua,et al.  Model-Based Silhouette Extraction for Accurate People Tracking , 2002, ECCV.

[4]  E. R. Davies,et al.  Machine vision - theory, algorithms, practicalities , 2004 .

[5]  Michel Dhome,et al.  Human body limbs tracking by multi-ocular vision , 1997 .

[6]  Jérôme Martin,et al.  An Appearance-Based Approach to Gesture-Recognition , 1997, ICIAP.

[7]  Hocine Ouhaddi,et al.  3D Hand Gesture Tracking by Model Registration , 1999 .

[8]  Ara V. Nefian,et al.  A statistical upper body model for 3D static and dynamic gesture recognition from stereo sequences , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[9]  James W. Davis,et al.  Action Recognition Using Temporal Templates , 1997 .

[10]  Ioannis A. Kakadiaris,et al.  Model-Based Estimation of 3D Human Motion , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[12]  Yoshiaki Shirai,et al.  Hand gesture estimation and model refinement using monocular camera-ambiguity limitation by inequality constraints , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[13]  Cai Anni,et al.  Automatic face segmentation in YCrCb images , 1999, Fifth Asia-Pacific Conference on ... and Fourth Optoelectronics and Communications Conference on Communications,.

[14]  E. R. Davies.  Machine vision , 1990 .

[15]  Matthew Turk,et al.  View-based interpretation of real-time optical flow for gesture recognition , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[16]  Masahiko Yachida,et al.  Gesture recognition based on subspace method and hidden Markov model , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[17]  Rangachar Kasturi,et al.  Machine vision , 1995 .

[18]  M. Partridge,et al.  Face recognition using a new distance metric , 2000, Neural Networks for Signal Processing X. Proceedings of the 2000 IEEE Signal Processing Society Workshop (Cat. No.00TH8501).

[19]  J. Little,et al.  Recognizing People by Their Gait: The Shape of Motion , 1998 .

[20]  Thomas S. Huang,et al.  Vision based hand modeling and tracking for virtual teleconferencing and telecollaboration , 1995, Proceedings of IEEE International Conference on Computer Vision.

[21]  Larry S. Davis,et al.  3-D model-based tracking of humans in action: a multi-view approach , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[22]  David J. Fleet,et al.  Robustly Estimating Changes in Image Appearance , 2000, Comput. Vis. Image Underst..

[23]  Fumio Kishino,et al.  Human posture estimation from multiple images using genetic algorithm , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[24]  Matthew Brand,et al.  Discovery and Segmentation of Activities in Video , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Yoshinari Kameda,et al.  Estimation of the location of joint points of human body from successive volume data , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.