Sticky tools: full 6DOF force-based interaction for multi-touch tables

Tabletop computing techniques are using physically familiar force-based interactions to enable compelling interfaces that provide a feeling of being embodied with a virtual object. We introduce an interaction paradigm that has the benefits of force-based interaction complete with full 6DOF manipulation. Only multi-touch input, such as that provided by the Microsoft Surface and the SMART Table, is necessary to achieve this interaction freedom. This paradigm is realized through sticky tools: a combination of sticky fingers, a physically familiar technique for moving, spinning, and lifting virtual objects; opposable thumbs, a method for flipping objects over; and virtual tools, a method for propagating behaviour to other virtual objects in the scene. We show how sticky tools can introduce richer meaning to tabletop computing by drawing a parallel between sticky tools and the discussion in Urp [20] around the meaning of tangible devices in terms of nouns, verbs, reconfigurable tools, attributes, and pure objects. We then relate this discussion to other force-based interaction techniques by describing how a designer can introduce complexity in how people can control both physical and virtual objects, how physical objects can control both physical and virtual objects, and how virtual objects can control virtual objects.

[1]  M. Sheelagh T. Carpendale,et al.  Rotation and translation mechanisms for tabletop interaction , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[2]  Adrian Bullock,et al.  H.5.3 [Information Interfaces and Presentation (e.g. HCI)]: , 2022 .

[3]  M. Sheelagh T. Carpendale,et al.  Evaluating the effects of fluid interface components on tabletop collaboration , 2006, AVI '06.

[4]  Meredith Ringel Morris,et al.  DiamondSpin: an extensible toolkit for around-the-table interaction , 2004, CHI.

[5]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[6]  M. Sheelagh T. Carpendale,et al.  Fluid integration of rotation and translation , 2005, CHI.

[7]  Tobias Isenberg,et al.  A Buffer Framework for Supporting Responsive Interaction in Information Visualization Interfaces , 2006, Fourth International Conference on Creating, Connecting and Collaborating through Computing (C5'06).

[8]  Shumin Zhai,et al.  User performance in relation to 3D input device design , 1998, COMG.

[9]  Otmar Hilliges,et al.  Bringing physics to the surface , 2008, UIST '08.

[10]  M. Sheelagh T. Carpendale,et al.  Roles of Orientation in Tabletop Collaboration: Comprehension, Coordination and Communication , 2004, Computer Supported Cooperative Work (CSCW).

[11]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[12]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[13]  Ravin Balakrishnan,et al.  Keepin' it real: pushing the desktop metaphor with physics, piles and the pen , 2006, CHI.

[14]  Tobias Isenberg,et al.  Exploring 3D Interaction in Alternate Control-Display Space Mappings , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[15]  Carl Gutwin,et al.  TNT: improved rotation and translation on digital tables , 2006, Graphics Interface.

[16]  Abhishek Ranjan,et al.  Interacting with large displays from a distance with vision-tracked multi-finger gestural input , 2005, SIGGRAPH '06.

[17]  Frédéric Vernier,et al.  Personal digital historian: story sharing around the table , 2003, INTR.

[18]  Xiang Cao,et al.  ShapeTouch: Leveraging contact shape on interactive surfaces , 2008, 2008 3rd IEEE International Workshop on Horizontal Interactive Human Computer Systems.

[19]  Mike Wu,et al.  Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays , 2003, UIST '03.

[20]  Bernd Fröhlich,et al.  The GlobeFish and the GlobeMouse: two new six degree of freedom input devices for graphics applications , 2006, CHI.

[21]  François Guimbretière,et al.  Techniques , 2011, Laboratory Investigation.