A camera-based input device for large interactive displays

The Digital Vision Touch (DViT) system uses smart cameras to determine where a person touches a large display, thereby allowing intuitive human-computer interaction. The cameras process the collected images in such a way as to recognize various object attributes, such as location relative to the display in 3D space. The system can then use this information in feedback to the computer generating the display, enabling touch control of the application. When we touch-enable large displays, multiuser collaboration and the ability to detect pen or finger contact are desirable functions. DViT is a touch-enabling technology with this capability and facilitates human-computer interaction in a natural way. The system we created works with a variety of display sizes - both large and wall-sized formats - and accommodates multiple users simultaneously.

[1]  Björn Stenger,et al.  Filtering using a tree-based estimator , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[3]  David Holmgren,et al.  7.4: Machine Vision Passive Touch Technology for Interactive Displays , 2001 .

[4]  Julien Letessier,et al.  Visual tracking of bare fingers for interactive surfaces , 2004, UIST '04.

[5]  Ying Wu,et al.  Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper , 2001, PUI '01.

[6]  J. Rekimoto,et al.  Perceptual Surfaces : Towards a Human and Object Sensitive Interactive Display , 1997 .

[7]  James L. Crowley,et al.  Perceptual user interfaces: things that see , 2000, CACM.

[8]  François Bérard,et al.  Bare-hand human-computer interaction , 2001, PUI '01.

[9]  C. Jennings,et al.  Robust finger tracking with multiple cameras , 1999, Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV'99 (Cat. No.PR00378).

[10]  Paul A. Beardsley,et al.  Computer Vision for Interactive Computer Graphics , 1998, IEEE Computer Graphics and Applications.

[11]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[12]  I. Scott MacKenzie,et al.  Lag as a determinant of human performance in interactive systems , 1993, INTERCHI.

[13]  James L. Crowley,et al.  Finger Tracking as an Input Device for Augmented Reality , 1995 .

[14]  Thomas A. Funkhouser,et al.  Large-format displays , 2000, IEEE Computer Graphics and Applications.

[15]  David Minnen,et al.  The perceptive workbench: Computer-vision-based gesture tracking, object tracking, and 3D reconstruction for augmented desks , 2003, Machine Vision and Applications.

[16]  Nasser Kehtarnavaz,et al.  A smart camera application: DSP-based people detection and tracking , 2000, J. Electronic Imaging.

[17]  James M. Rehg,et al.  Increasing the Usability of Virtual Rear Projection Displays , 2003 .

[18]  David Holmgren,et al.  54.4: Toward a Touch‐Sensitive Display Wall , 2003 .