Building Interactive Multi-touch Surfaces

Multi-touch interaction with computationally enhanced surfaces has received considerable attention in recent years. Hardware implementations of multi-touch interaction such as Frustrated Total Internal Reflection (FTIR) and Diffuse Illumination (DI) have allowed for the low cost development of surfaces. Although many of these technologies and associated applications have been presented in academic settings, the practicalities of building a high quality multi-touch enabled surface, both in terms of the software and hardware required, are not widely known. We draw upon our extensive experience as developers of multi-touch technology to provide practical advice in relation to building, and deploying applications upon, multi-touch surfaces. This includes technical details of the construction of optical multi-touch surfaces, including: infrared illumination, silicone compliant surfaces, projection screens, cameras, filters, and projectors, and an overview of existing software libraries for tracking.

[1]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[2]  Johannes Schöning,et al.  Multi-Touch Surfaces: A Technical Guide , 2008 .

[3]  Robin Jeffries,et al.  CHI '06 Extended Abstracts on Human Factors in Computing Systems , 2006, CHI 2006.

[4]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[5]  Chris Harrison,et al.  Providing dynamically changeable physical buttons on a visual display , 2009, CHI.

[6]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[7]  Philip Tuddenham,et al.  Distributed Tabletops: Supporting Remote and Mixed-Presence Tabletop Collaboration , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[8]  Antonio Krüger,et al.  Multi-touch is Dead, Long live Multi-touch , 2009 .

[9]  Enrico Costanza,et al.  A Region Adjacency Tree Approach to the Detection and Design of Fiducials , 2003, VVG.

[10]  Nima Motamedi.  Hd touch: multi-touch and object sensing on a high definition lcd tv , 2008, CHI Extended Abstracts.

[11]  Ken Perlin,et al.  IMPAD: an inexpensive multi-touchpressure acquisition device , 2009, CHI Extended Abstracts.

[12]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[13]  Gudrun Klinker,et al.  A multitouch software architecture , 2008, NordiCHI.

[14]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[15]  H. Ojanen.  Automatic Correction of Lens Distortion by Using Digital Image Processing , 1999 .

[16]  Tomer Moscovich.  Multi-touch interaction , 2006, CHI EA '06.

[17]  Johannes Schöning,et al.  Improving interaction with virtual globes through spatial thinking: helping users ask "why?" , 2008, IUI '08.

[18]  Enrico Costanza,et al.  TUIO: A Protocol for Table-Top Tangible User Interfaces , 2005 .

[19]  John F. Hughes,et al.  Indirect mappings of multi-touch input using one and two hands , 2008, CHI.

[20]  Alessandro Valli,et al.  Natural interaction sensitivetable , 2008, CHI Extended Abstracts.

[21]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[22]  Yijie Han,et al.  An efficient and fast parallel-connected component algorithm , 1990, JACM.

[23]  Timo Engelke,et al.  Adapting X3D for multi-touch environments , 2008, Web3D '08.

[24]  Antti Oulasvirta,et al.  It's Mine, Don't Touch!: interactions at a large multi-touch display in a city centre , 2008, CHI.

[25]  Johannes Schöning,et al.  Whole Body Interaction with Geospatial Data , 2009, Smart Graphics.

[26]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[27]  Gudrun Klinker,et al.  A short guide to modulated light , 2009, Tangible and Embedded Interaction.

[28]  Dominik Schmidt.  Design and Realization of an Interactive Multi-Touch Table , 2010 .

[29]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[30]  Ross Bencina,et al.  reacTIVision: a computer-vision framework for table-based tangible interaction , 2007, TEI.

[31]  L. Y. L. Muller.  Multi-touch displays : design , applications and performance evaluation , 2008 .

[32]  Enrico Costanza,et al.  INTRODUCING AUDIO D-TOUCH: A TANGIBLE USER INTERFACE FOR MUSIC COMPOSITION AND PERFORMANCE , 2003 .

[33]  Jun Rekimoto,et al.  HoloWall: designing a finger, hand, body, and object sensitive wall , 1997, UIST '97.

[34]  K. Shadan,et al.  Available online: , 2012 .

[35]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.