Exploring tangible and direct touch interfaces for manipulating 2D and 3D information on a digital table

On traditional tables, people often manipulate a variety of physical objects, both 2D in nature (e.g., paper) and 3D in nature (e.g., books, pens, models, etc.). Current advances in hardware technology for tabletop displays introduce the possibility of mimicking these physical interactions through direct-touch or tangible user interfaces. While both promise intuitive physical interaction, they are rarely discussed in combination in the literature. In this paper, we present a study that explores the advantages and disadvantages of tangible and touch interfaces, specifically in relation to one another. We discuss our results in terms of how effective each technique was for accomplishing both a 3D object manipulation task and a 2D information visualization exploration task. Results suggest that people can more quickly move and rotate objects in 2D with our touch interaction, but more effectively navigate the visualization using tangible interaction. We discuss how our results can be used to inform future designs of tangible and touch interaction.

[1]  Dimitre Novatchev,et al.  Chunking and Phrasing and the Design of Human-Computer Dialogues - Response , 1986, IFIP Congress.

[2]  Andrew D. Wilson PlayAnywhere: a compact interactive tabletop projection-vision system , 2005, UIST.

[3]  Scott R. Klemmer,et al.  How bodies matter: five themes for interaction design , 2006, DIS '06.

[4]  Sergi Jordà,et al.  The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces , 2007, TEI.

[5]  Andreas Paepcke,et al.  TeamTag: exploring centralized versus replicated controls for co-located tabletop groupware , 2006, CHI.

[6]  William Buxton,et al.  ThinSight: versatile multi-touch sensing for thin form-factor displays , 2007, UIST.

[7]  John F. Hughes,et al.  Multi-finger cursor techniques , 2006, Graphics Interface.

[8]  Jefferson Y. Han Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[9]  Hiroshi Ishii,et al.  Tangible bits: towards seamless interfaces between people, bits and atoms , 1997, CHI.

[10]  M. Sheelagh T. Carpendale,et al.  Fluid integration of rotation and translation , 2005, CHI.

[11]  J. Underkoff Urp : A Luminous-Tangible Workbench for Urban Planning and Design , 1999, CHI 1999.

[12]  Gerald Penn,et al.  Living with a Tabletop: Analysis and Observations of Long Term Office Use of a Multi-Touch Table , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[13]  Adrian Bullock,et al.  H.5.3 [Information Interfaces and Presentation (e.g. HCI)]: , 2022 .

[14]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[15]  W. Bu A MULTI-TOUCH THREE DIMENSIONAL TOUCH-SENSITIVE TABLET , 1985 .

[16]  Andreas Butz,et al.  Photohelix: Browsing, Sorting and Sharing Digital Photo Collections , 2007, Second Annual IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP'07).

[17]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[18]  Mitchel Resnick,et al.  Digital manipulatives: new toys to think with , 1998, CHI.

[19]  Stacey D. Scott,et al.  Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces , 2009 .

[20]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[21]  Hiroshi Ishii,et al.  The metaDESK: models and prototypes for tangible user interfaces , 1997, UIST '97.

[22]  Paul Dourish,et al.  Where the action is , 2001 .

[23]  Hiroshi Ishii,et al.  Bricks: laying the foundations for graspable user interfaces , 1995, CHI '95.

[24]  Ali Mazalek,et al.  TViews: An Extensible Architecture for Multiuser Digital Media Tables , 2006, IEEE Computer Graphics and Applications.

[25]  Jun Rekimoto,et al.  DataTiles: a modular platform for mixed physical and graphical interactions , 2001, CHI.

[26]  Anne Marie Piper,et al.  Mediating Group Dynamics through Tabletop Interface Design , 2006, IEEE Computer Graphics and Applications.

[27]  Y Wang,et al.  Bringing Clay and Sand into Digital Design — Continuous Tangible user Interfaces , 2004 .

[28]  Regan L. Mandryk,et al.  Direct intentions: the effects of input devices on collaboration around a tabletop display , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[29]  Jacob Buur,et al.  Getting a grip on tangible interaction: a framework on physical space and social interaction , 2006, CHI.

[30]  Mike Sinclair,et al.  Touch-sensing input devices , 1999, CHI '99.

[31]  Kenneth P. Fishkin,et al.  A taxonomy for and analysis of tangible interfaces , 2004, Personal and Ubiquitous Computing.

[32]  Tovi Grossman,et al.  Going Deeper: a Taxonomy of 3D on the Tabletop , 2007, Tabletop.

[33]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[34]  Andrew D. Wilson Robust computer vision-based detection of pinching for one and two-handed gesture input , 2006, UIST.