A Robust Human-Silhouette Extraction Technique for Interactive Virtual Environments

In this paper, we present a method for robustly extracting the silhouette form of the participant within an interactive environment. The approach overcomes the inherent problems associated with traditional chroma-keying, background subtraction, and rear-light projection methods. We employ a specialized infrared system while not making the underlying technology apparent to those interacting within the environment. The design also enables multiple video projection screens to be placed around the user. As an example use of this technology, we present an interactive virtual aerobics system. Our current implementation is a portable system which can act as a re-usable infrastructure for many interactive projects.

[1]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[2]  James W. Davis,et al.  The representation and recognition of human movement using temporal templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[4]  Joseph A. Paradiso,et al.  Tracking hands above large interactive surfaces with a low-cost scanning laser rangefinder , 1998, CHI Conference Summary.

[5]  Trevor Darrell,et al.  A novel environment for situated vision and behavior , 1994 .

[6]  P. Maes,et al.  Old tricks, new dogs: ethology and interactive creatures , 1997 .

[7]  Claudio S. Pinhanez,et al.  Interval scripts: a design paradigm for story-based interactive systems , 1997, CHI.

[8]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  David C. Hogg Model-based vision: a program to see a walking person , 1983, Image Vis. Comput..

[10]  James W. Davis,et al.  Virtual PAT: A Virtual Personal Aerobics Trainer , 1998 .

[11]  Alex Pentland,et al.  Pfinder: real-time tracking of the human body , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  J. Murray Hamlet on the Holodeck , 1997 .

[13]  J. Rekimoto,et al.  Perceptual Surfaces : Towards a Human and Object Sensitive Interactive Display , 1997 .

[14]  J. A. Paradiso Electronic money: toward a virtual wallet , 1997 .