Vision-based tracking and interpretation of human leg movement for virtual reality applications

A vision-based system for tracking and interpreting leg motion in image sequences using a single camera is developed for a user to control his movement in the virtual world by his legs. Twelve control commands are defined. The trajectories of the color marks placed on the shoes of the user are used to determine the types of leg movement by a first-order Markov process. Then, the types of leg movement are encoded symbolically as input to Mealy machines to recognize the control command associated with a sequence of leg movements. The proposed system is implemented on a commercial PC without any special hardware. Because the transition functions of Mealy machines are deterministic, the implementation of the proposed system is simple and the response time of the system is short. Experimental results with a 14-Hz frame rate on 320/spl times/240 image resolution are included to prove the feasibility of the proposed approach.

[1]  Shu-Yuan Chen,et al.  A systematic approach to analytic determination of camera parameters by line features , 1990, Pattern Recognit..

[2]  Vladimir Pavlovic,et al.  Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Josef Kittler,et al.  Pattern recognition : a statistical approach , 1982 .

[4]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Michael Isard,et al.  Statistical models of visual shape and motion , 1998, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[6]  Michael J. Black,et al.  Cardboard people: a parameterized model of articulated image motion , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[7]  Francis K. H. Quek.  Eyes in the interface , 1995, Image Vis. Comput..

[8]  Hsi-Jian Lee,et al.  Knowledge-guided visual perception of 3-D human gait from a single image sequence , 1992, IEEE Trans. Syst. Man Cybern..

[9]  Alex Pentland,et al.  Space-time gestures , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Mubarak Shah,et al.  Visual gesture recognition , 1994 .

[11]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[12]  Hsi-Jian Lee,et al.  Determination of 3D human body postures from a single view , 1985, Comput. Vis. Graph. Image Process..

[13]  Kazuo Kyuma,et al.  Computer vision for computer games , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[14]  Larry S. Davis,et al.  Tracking of humans in action: a 3-D model-based approach , 1996 .

[15]  Frank Biocca,et al.  Virtual Reality Technology: A Tutorial , 1992 .

[16]  Azriel Rosenfeld,et al.  Computer Vision , 1988, Adv. Comput..

[17]  K. Rohr.  Towards model-based recognition of human movements in image sequences , 1994 .