Multi-Touch Surfaces - A Technical Guide Technical Report TUM-I0833 Categories and Subject Descriptors

Multi-touch interaction with computationally enhanced surfaces has received considerable recent attention. Approaches to the implementation of multi-touch interaction such as Frustrated Total Internal Reflection (FTIR) and Diffused Illumination (DI) have allowed for the low cost development of such surfaces, leading to a number of technology and application innovations. Although many of these techniques have been presented in an academic setting, the practicalities of building a high quality multi-touch enabled surface, both in terms of the software and hardware, are not trivial. This document aims to summarize the knowledge and experience of developers of multi-touch technology who gathered at the Bootcamp on Construction & Implementation of Optical Multi-touch Surfaces at Tabletop 2008 in Amsterdam, and seeks to provide hints and practical advice to people seeking to “build your own” multi-touch surface. We mostly focus on technical aspects that are important in the construction of optical multi-touch surfaces, including: infrared illumination, silicone compliant surfaces, projection screens, cameras, filters, and projectors. In addition, we outline how to integrate this hardware to allow users to create a solid multi-touch surface, and provide an overview of existing software libraries for the implementation of multi-touch applications. In addition, we discuss the problem of latency introduced by the different parts of the system. A brief description of most of the common technologies to realize (multi-) touch surfaces is provided; however, the main focus is on those that utilise optical approaches.

[1]  Jefferson Y. Han Multi-touch interaction wall , 2006, SIGGRAPH '06.

[2]  Yijie Han,et al.  An efficient and fast parallel-connected component algorithm , 1990, JACM.

[3]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[4]  Enrico Costanza,et al.  A Region Adjacency Tree Approach to the Detection and Design of Fiducials , 2003, VVG.

[5]  Enrico Costanza,et al.  INTRODUCING AUDIO D-TOUCH: A TANGIBLE USER INTERFACE FOR MUSIC COMPOSITION AND PERFORMANCE , 2003 .

[6]  Jun Rekimoto,et al.  HoloWall: designing a finger, hand, body, and object sensitive wall , 1997, UIST '97.

[7]  Andrew J. Woods,et al.  The Compatibility of Consumer Displays with Time-Sequential Stereoscopic 3 D Visualisation , 2006 .

[8]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[9]  Dennis Proffitt,et al.  Two-handed virtual manipulation , 1998, TCHI.

[10]  Timo Engelke,et al.  Adapting X3D for multi-touch environments , 2008, Web3D '08.

[11]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[12]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[13]  Andrew J. Woods,et al.  The compatibility of consumer plasma displays with time-sequential stereoscopic 3D visualization , 2008, Electronic Imaging.

[14]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[15]  Johannes Schöning,et al.  Improving interaction with virtual globes through spatial thinking: helping users ask "why?" , 2008, IUI '08.

[16]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[17]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[18]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[19]  Andrew D. Wilson TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[20]  Sascha Spors,et al.  The multi-touch SoundScape renderer , 2008, AVI '08.

[21]  Nima Motamedi Hd touch: multi-touch and object sensing on a high definition lcd tv , 2008, CHI Extended Abstracts.

[22]  Stephan Rusdorf,et al.  Real-Time Interaction with a Humanoid Avatar in an Immersive Table Tennis Simulation , 2007, IEEE Transactions on Visualization and Computer Graphics.

[23]  Andrew J. Woods,et al.  The compatibility of consumer DLP projectors with time-sequential stereoscopic 3D visualisation , 2007, Electronic Imaging.

[24]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[25]  L. Y. L. Muller Multi-touch displays : design , applications and performance evaluation , 2008 .