Direct Interaction with Large-Scale Display Systems using Infrared Laser tracking Devices

Existing large scale display systems generally adopt an indirect approach to user interaction. This is due to the use of standard desktop-oriented devices, such as a mouse on a desk, to control the large wall-sized display. By using an infrared laser pointer and an infrared tracking device, a more direct interaction with the large display can be achieved, thereby reducing the cognitive load of the user and improving their mobility. The challenge in designing such systems is to allow users to interact with objects on the display naturally and easily. Our system addresses this with hotspots, regions surrounding objects of interest, and gestures, movements made with the laser pointer which triggers an action, similar to those found in modern web browsers (e.g. Mozilla and Opera). Finally, these concepts are demonstrated by an add-in module for Microsoft® PowerPoint® using the NaturalPointTM Smart-NavTM tracking device.

[1]  R. Jacob Human-computer interaction: input devices , 1996, CSUR.

[2]  Brad A. Myers,et al.  A brief history of human-computer interaction technology , 1998, INTR.

[3]  Douglas C. Engelbart,et al.  A research center for augmenting human intellect , 1968, AFIPS Fall Joint Computing Conference.

[4]  Jeffrey Nichols,et al.  Interacting at a distance: measuring the performance of laser pointers and other devices , 2002, CHI.

[5]  Rahul Sukthankar,et al.  Self-Calibrating Camera-Assisted Presentation Interface , 2000 .

[6]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[7]  Mark J. Willey Design and Implementation of a Stroke Interface Library , 1997 .

[8]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[9]  Ramana Rao,et al.  A focus+context technique based on hyperbolic geometry for visualizing large hierarchies , 1995, CHI '95.

[10]  Robert J. K. Jacob,et al.  Evaluation of eye gaze interaction , 2000, CHI.

[11]  Takeo Igarashi,et al.  Flatland: new dimensions in office whiteboards , 1999, CHI '99.

[12]  Joseph J. LaViola,et al.  CavePainting: a fully immersive 3D artistic medium and interactive experience , 2001, I3D '01.

[13]  Dan R. Olsen,et al.  Laser pointer interaction , 2001, CHI.

[14]  Jock D. Mackinlay,et al.  The document lens , 1993, UIST '93.

[15]  Heinrich Müller,et al.  Interaction with a projection screen using a camera-tracked laser pointer , 1998, Proceedings 1998 MultiMedia Modeling. MMM'98 (Cat. No.98EX200).

[16]  John C. Tang,et al.  Liveboard: a large interactive display supporting group meetings, presentations, and remote collaboration , 1992, CHI.

[17]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[18]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[19]  Terry Winograd,et al.  FlowMenu: combining command, text, and data entry , 2000, UIST '00.

[20]  Steven F. Roth,et al.  SDM: selective dynamic manipulation of visualizations , 1995, UIST '95.

[21]  Choon Hong Peck Useful parameters for the design of laser pointer interaction techniques , 2001, CHI Extended Abstracts.

[22]  Florian Vogt,et al.  Interacting with the big screen: pointers to ponder , 2002, CHI Extended Abstracts.

[23]  Xing Chen,et al.  Lumipoint: multi-user laser-based interaction on large tiled displays , 2002 .