This paper describes a system for advanced man-machine interaction based on computer vision technology allowing users to manipulate information displayed on large wall panels by using their own hands as pointing devices. The system gets its input from a pair of color video cameras (placed so as to have the user in view); a personal computer performs image analysis and updates interaction parameters. Such parameters, which reflect current user status, are then transformed into graphic interface commands and output to the screen through a beamer. Graphic interface operation is the same as with standard computer mice; the main points of innovation concern naturality of interaction, low intrusiveness and a priori training, and low equipment cost. An experimental version of the system is currently being employed to provide museum visitors with advanced interactive services.
[1]
R. Jacob.
Human-computer interaction: input devices
,
1996,
CSUR.
[2]
A. P. Pentland,et al.
Computer Vision for Human–Machine Interaction: Smart Rooms: Machine Understanding of Human Behavior
,
1998
.
[3]
Carlo Colombo,et al.
Computer Vision for Human–Machine Interaction: Interfacing through Visual Pointers
,
1998
.
[4]
K. Mase.
Computer Vision for Human–Machine Interaction: Human Reader: A Vision-Based Man-Machine Interface
,
1998
.
[5]
Jakob Nielsen,et al.
Noncommand user interfaces
,
1993,
CACM.
[6]
C. Maggioni,et al.
Computer Vision for Human–Machine Interaction: GestureComputer – History, Design and Applications
,
1998
.
[7]
James L. Crowley,et al.
Perceptual user interfaces: things that see
,
2000,
CACM.