An interaction model for touch-aware tangibles on interactive surfaces

Tangibles on interactive surfaces enable users to physically manipulate digital content by placing, moving, manipulating, or removing a tangible object. However, the information whether and how a user grasps these tangibles has not been exploited for input so far. Based on Buxton's Three-State Model for graphical input, we present an interaction model that describes input on tangibles that are aware of the user's touch and grasp. We present two examples showing how the user benefits from this extended interaction model.

[1]  Hiroshi Ishii,et al.  A comparison of spatial organization strategies in graphical and tangible user interfaces , 2000, DARE '00.

[2]  Jun Rekimoto,et al.  SmartSkin: an infrastructure for freehand manipulation on interactive surfaces , 2002, CHI.

[3]  William Buxton,et al.  A three-state model of graphical input , 1990, INTERACT.

[4]  Sebastian Boring,et al.  HandSense: discriminating different ways of grasping and holding a tangible user interface , 2009, Tangible and Embedded Interaction.

[5]  Jon Trinder,et al.  The Humane Interface: New Directions for Designing Interactive Systems , 2002, Interact. Learn. Environ..

[6]  Jan O. Borchers,et al.  Madgets: actuating widgets on interactive tabletops , 2010, UIST.

[7]  Ivan Poupyrev,et al.  Touché: enhancing touch interaction on humans, screens, liquids, and everyday objects , 2012, CHI.

[8]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[9]  James D. Hollan,et al.  SLAP widgets: bridging the gap between virtual and physical controls on tabletops , 2009, CHI.

[10]  Andreas Butz,et al.  HapTouch and the 2+1 state model: potentials of haptic feedback on touch based in-vehicle information systems , 2010, AutomotiveUI.

[11]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[12]  Yuichi Itoh,et al.  PUCs: detecting transparent, passive untouched capacitive widgets on unmodified multi-touch displays , 2013, ITS.