ThinSight: a thin form-factor interactive surface technology

ThinSight is a thin form-factor interactive surface technology based on optical sensors embedded inside a regular liquid crystal display (LCD). These augment the display with the ability to sense a variety of objects near the surface, including fingertips and hands, to enable multitouch interaction. Optical sensing also allows other physical items to be detected, allowing interactions using various tangible objects. A major advantage of ThinSight over existing camera and projector-based systems is its compact form-factor, making it easier to deploy in a variety of settings. We describe how the ThinSight hardware is embedded behind a regular LCD, allowing sensing without degradation of dis- play capability, and illustrate the capabilities of our system through a number of proof-of-concept hardware prototypes and applications.

[1]  Bill Buxton,et al.  Multi-Touch Systems that I Have Known and Loved , 2009 .

[2]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[3]  Andrew D. Wilson.  TouchLight: an imaging touch screen and display for gesture-based interaction , 2004, ICMI '04.

[4]  Shahzad Malik,et al.  Visual touchpad: a two-handed gestural input device , 2004, ICMI '04.

[5]  Jun Rekimoto,et al.  Dual touch: a two-handed interface for pen-based PDAs , 2000, UIST '00.

[6]  Jörn Loviscach.  Two-finger input with a standard touch screen , 2007, UIST '07.

[7]  Jun Rekimoto,et al.  HoloWall: designing a finger, hand, body, and object sensitive wall , 1997, UIST '97.

[8]  Michael Kiy,et al.  Optical proximity and touch sensors based on monolithically integrated polymer photodiodes and polymer LEDs , 2006 .

[9]  Myron W. Krueger,et al.  Artificial reality II , 1991 .

[10]  Scott E. Hudson.  Using light emitting diode arrays as touch-sensitive input and output devices , 2004, UIST '04.

[11]  Adi Abileah,et al.  Optical sensors embedded within AMLCD panel: design and applications , 2007, SIGGRAPH Emerging Technologies.

[12]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[13]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[14]  A. Agarwal,et al.  C-Slate: A Multi-Touch and Object Recognition System for Remote Collaboration using Horizontal Surfaces , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[15]  Kenneth C. Smith,et al.  A multi-touch three dimensional touch-sensitive tablet , 1985, CHI '85.

[16]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[17]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[18]  Malcolm Hall,et al.  Experiences with building a thin form-factor touch and tangible tabletop , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[19]  Andrew D. Wilson.  PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[20]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.