Touching the void: direct-touch interaction for intangible displays

In this paper, we explore the challenges in applying and investigate methodologies to improve direct-touch interaction on intangible displays. Direct-touch interaction simplifies object manipulation, because it combines the input and display into a single integrated interface. While traditional tangible display-based direct-touch technology is commonplace, similar direct-touch interaction within an intangible display paradigm presents many challenges. Given the lack of tactile feedback, direct-touch interaction on an intangible display may show poor performance even on the simplest of target acquisition tasks. In order to study this problem, we have created a prototype of an intangible display. In the initial study, we collected user discrepancy data corresponding to the interpretation of 3D location of targets shown on our intangible display. The result showed that participants performed poorly in determining the z-coordinate of the targets and were imprecise in their execution of screen touches within the system. Thirty percent of positioning operations showed errors larger than 30mm from the actual surface. This finding triggered our interest to design a second study, in which we quantified task time in the presence of visual and audio feedback. The pseudo-shadow visual feedback was shown to be helpful both in improving user performance and satisfaction.

[1]  Leonard Wanger,et al.  The effect of shadow quality on the perception of spatial relationships in computer generated imagery , 1992, I3D '92.

[2]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[3]  Doug A. Bowman,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 2001, Presence Teleoperators Virtual Environ..

[4]  Tovi Grossman,et al.  The design and evaluation of selection techniques for 3D volumetric displays , 2006, UIST.

[5]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[6]  Andrea H. Mason,et al.  Reaching movements to augmented and graphic objects in virtual environments , 2001, CHI.

[7]  Jane Yung-jen Hsu,et al.  Gesture-based interaction for a magic crystal ball , 2007, VRST '07.

[8]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[9]  Darren Leigh,et al.  Under the table interaction , 2006, UIST.

[10]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[11]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[12]  Jane Yung-jen Hsu,et al.  On top of tabletop: A virtual touch panel display , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[13]  Daniel C. Robbins,et al.  Interactive shadows , 1992, UIST '92.

[14]  Tovi Grossman,et al.  An evaluation of depth perception on volumetric displays , 2006, AVI '06.

[15]  Colin Ware,et al.  Eye-hand co-ordination with force feedback , 2000, CHI.

[16]  Christine L. MacKenzie,et al.  Physical versus virtual pointing , 1996, CHI.

[17]  Donald B. Johnson,et al.  Testbed Evaluation of Virtual Environment Interaction Techniques , 1999, Presence: Teleoperators & Virtual Environments.

[18]  Stephen DiVerdi,et al.  An Immaterial, Dual-sided Display System with 3D Interaction , 2006, IEEE Virtual Reality Conference (VR 2006).

[19]  Randy Pausch,et al.  Virtual reality on a WIM: interactive worlds in miniature , 1995, CHI '95.

[20]  Anthony Tang,et al.  Shadow reaching: a new perspective on interaction for large displays , 2007, UIST.

[21]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[22]  T. Ichikawa,et al.  Egocentric Object Manipulation in Virtual Environments: Empirical Evaluation of Interaction Techniques , 1998, Comput. Graph. Forum.

[23]  Frederick P. Brooks,et al.  Moving objects in space: exploiting proprioception in virtual-environment interaction , 1997, SIGGRAPH.

[24]  Hiromi IKEDA,et al.  i-ball: interactive information display like a crystal ball , 2001 .