Interacting with steerable projected displays

When computer vision is combined with a steerable projector, any surface in an environment can be turned into an interactive interface, without having to modify or wire the surface. Steerable projected displays offer rich opportunities and pose new challenges for interaction based on gesture recognition. In this paper, we present real-time techniques for recognizing "touch" and "point" gestures on steerable projected displays produced by a new device called the Everywhere Displays projector (ED-projector). We demonstrate the viability of our approach through an experiment involving hundreds of users interacting with projected interfaces.

[1]  Jun Rekimoto,et al.  A multiple device approach for supporting whiteboard-based interactions , 1998, CHI.

[2]  Mark Weiser.  The computer for the 21st century , 1991 .

[3]  Rick Kjeldsen,et al.  Design issues for vision-based computer interaction systems , 2001, PUI '01.

[4]  H. Pluckrose,et al.  Things to See , 1973 .

[5]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[6]  Claudio S. Pinhanez,et al.  HyperMask : Talking Head Projected onto Real Objects , 2000 .

[7]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[8]  Rick Kjeldsen,et al.  Head gestures for computer control , 2001, Proceedings IEEE ICCV Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems.

[9]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[10]  Michael S. Brown,et al.  Projected Imagery in Your "Office of the Future" , 2000, IEEE Computer Graphics and Applications.

[11]  Hiroshi Ishii,et al.  Emancipated pixels: real-world graphics in the luminous room , 1999, SIGGRAPH.

[12]  James L. Crowley,et al.  Perceptual user interfaces: things that see , 2000, CACM.

[13]  Ron MacNeil,et al.  metaField maze , 1999, SIGGRAPH '99.

[14]  Ruigang Yang,et al.  Automatic and Continuous Projector Display Surface Estimation Using Everyday Imagery , 2001, WSCG.

[15]  Ying Wu,et al.  Vision-Based Gesture Recognition: A Review , 1999, Gesture Workshop.

[16]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[17]  Claudio S. Pinhanez.  The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces , 2001, UbiComp.

[18]  M. Weiser.  The Computer for the Twenty-First Century , 1991 .

[19]  Staffan Björk,et al.  Pirates! Using the Physical World as a Game Board , 2001, INTERACT.

[20]  K. Glasgow,et al.  Los Angeles, California , 2003 .

[21]  Tom Forester.  Office of the Future , 1985 .

[22]  Frank Nielsen,et al.  Hypermask talking head projected onto real object , 2000 .