Custom-made tangible interfaces with touchtokens

TouchTokens were introduced recently as a means to design low-cost tangible interfaces. The technique consists in recognizing multi-touch patterns associated with specific tokens, and works on any touch-sensitive surface, with passive tokens that can be made out of any material. TouchTokens have so far been limited to a few basic geometrical shapes only, which puts a significant practical limit to how tailored token sets can be. In this article, we introduce TouchTokenBuilder and TouchTokenTracker that, taken together, aim at facilitating the development of tailor-made tangible interfaces. TouchTokenBuilder is an application that assists interface designers in creating token sets using a simple direct-manipulation interface. TouchTokenTracker is a library that enables tracking the tokens' full geometry. We report on experiments with those tools, showing the strengths and limitations of tangible interfaces with passive tokens.

[1]  Stefanie Müller,et al.  CapStones and ZebraWidgets: sensing stacks of building blocks, dials and sliders on capacitive touch screens , 2012, CHI.

[2]  Li-Wei Chan,et al.  GaussBits: magnetic tangible bits for portable and occlusion-free near-surface interactions , 2013, CHI Extended Abstracts.

[3]  Hiroshi Ishii,et al.  Token+constraint systems for tangible interaction with digital information , 2005, TCHI.

[4]  Marian Petre,et al.  Usability Analysis of Visual Programming Environments: A 'Cognitive Dimensions' Framework , 1996, J. Vis. Lang. Comput..

[5]  Francis K. H. Quek,et al.  Material Significance of Tangibles for Young Children , 2015, Tangible and Embedded Interaction.

[6]  M. Latash,et al.  Enslaving effects in multi-finger force production , 2000, Experimental Brain Research.

[7]  Mike Y. Chen,et al.  Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls , 2011, UIST '11.

[8]  Olivier Chapuis,et al.  Reciprocal Drag-and-Drop , 2015, TCHI.

[9]  Michael S. Horn,et al.  Designing tangible programming languages for classroom use , 2007, TEI.

[10]  Sungjae Hwang,et al.  MagGetz: customizable passive tangible controllers on and around conventional mobile devices , 2013, UIST.

[11]  Steve Daniels,et al.  Tiles that Talk: Tangible Templates for Networked Objects , 2015, Tangible and Embedded Interaction.

[12]  Natasa Milic-Frayling,et al.  Materializing the query with facet-streams: a hybrid surface for collaborative search on tabletops , 2011, CHI.

[13]  Ali Mazalek,et al.  PuzzleTale: A tangible puzzle game for interactive storytelling , 2010, CIE.

[14]  Jan O. Borchers,et al.  PERCs: Persistently Trackable Tangibles on Capacitive Multi-Touch Displays , 2015, UIST.

[15]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[16]  Emmanuel Pietriga,et al.  Passive yet Expressive TouchTokens , 2017, CHI.

[17]  Raimund Dachselt,et al.  T4 - transparent and translucent tangibles on tabletops , 2014, AVI.

[18]  Da-Yuan Huang,et al.  GaussBricks: magnetic building blocks for constructive tangible interactions on portable displays , 2014, CHI.

[19]  Beryl Plimmer,et al.  CapTUI: Geometric Drawing with Tangibles on a Capacitive Multi-touch Display , 2013, INTERACT.

[20]  Orit Shaer,et al.  The tangible video editor: collaborative video editing with active tokens , 2007, Tangible and Embedded Interaction.

[21]  Michael Rohs,et al.  CapWidgets: tangile widgets versus multi-touch controls on mobile devices , 2011, CHI Extended Abstracts.

[22]  Emmanuel Pietriga,et al.  TouchTokens: Guiding Touch Patterns with Passive Tokens , 2016, CHI.

[23]  Yuichi Itoh,et al.  PUCs: detecting transparent, passive untouched capacitive widgets on unmodified multi-touch displays , 2013, ITS.

[24]  M H Schieber,et al.  Quantifying the Independence of Human Finger Movements: Comparisons of Digits, Hands, and Movement Frequencies , 2000, The Journal of Neuroscience.

[25]  Marko Jurmu,et al.  Activity pad: teaching tool combining tangible interaction and affordance of paper , 2013, ITS.

[26]  Jean-Daniel Fekete,et al.  Stackables: combining tangibles for faceted browsing , 2012, AVI.

[27]  M. Gentilucci,et al.  Finger control in the tripod grasp , 2003, Experimental Brain Research.

[28]  Ali Mazalek,et al.  Exploring the design space of gestural interaction with active tokens through user-defined gestures , 2014, CHI.

[29]  Jacob O. Wobbrock,et al.  Portico: tangible interaction on and around a tablet , 2011, UIST.

[30]  Michael A. Arbib,et al.  Programs, Schemas, and Neural Networks for Control of Hand Movements: Beyond the RS Framework , 2018, Attention and Performance XIII.