Real-time motion capture system using one video camera based on color and edge distribution

This paper proposes a real-time, video based motion capture system using only one video camera. Since conventional video based motion capture systems need many cameras and take a long time to deal with many video images, they cannot generate motion data in real time. Therefore they cannot be used as a real-time input device for a standard PC. On the other hand, the prototype system proposed in this paper uses only one video camera, it takes video images of the upper body of the person, e.g., x, y, z position of the hands, a face rotation, a body rotation, etc., and it employs a very simple motion-tracking method to generate such upper body motion data in real time. This paper mainly describes its aspects as a hand and face motion-capturing device for a standard PC showing its application examples. Key-Words: -Image understanding, Motion capture, Motion recognition, Interface, Virtual reality

[1]  Yuzuru Tanaka,et al.  IntelligentBox: a constructive visual software development system for interactive 3D graphic applications , 1995, Proceedings Computer Animation'95.

[2]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[3]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[4]  Takeo Kanade,et al.  A real time system for robust 3D voxel reconstruction of human motions , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Sebastian Weik,et al.  Hierarchical 3D Pose Estimation for Articulated Human Body Models from a Sequence of Volume Data , 2001, RobVis.

[6]  Ying Wu,et al.  Color tracking by transductive learning , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[7]  Charles Q. Little,et al.  Real-Time Tracking of Articulated Human Models Using a 3D Shape-from-Silhouette Method , 2001, RobVis.

[8]  R. Zabih,et al.  Exact voxel occupancy with graph cuts , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[9]  Yuzuru Tanaka,et al.  Collaborative environments of IntelligentBox for distributed 3D graphics applications , 1998, The Visual Computer.

[10]  Yuntao Cui,et al.  Hand sign recognition from intensity image sequences with complex backgrounds , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.