The effect of perspective projection in multi-touch 3D interaction

In this paper we describe the development and comparison of interaction techniques for 3D direct manipulation on multi-touch enabled devices. The literature on this topic currently shows diverging arguments for what enables effective and/or intuitive interaction. We argue that the limiting problem is the projection from 3D to 2D in input and output; and in particular how transformations in 3D are mapped to the interaction surface. Not only does this argument explain the divergence in the literature -- it also leads to improved interaction metaphors, similar but not identical to widgets in other 3D interaction domains. We show in a controlled experiment that adapted interaction widgets are significantly superior to other approaches in the context of multi-touch interaction.

[1]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[2]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[3]  Ken Shoemake,et al.  ARCBALL: a user interface for specifying three-dimensional orientation using a mouse , 1992 .

[4]  Dennis R. Wixon,et al.  Building a user-derived interface , 1984, CACM.

[5]  Laurent Grisoni,et al.  The design and evaluation of 3D positioning techniques for multi-touch displays , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[6]  Pierre David Wellner,et al.  Interacting with paper on the DigitalDesk , 1993, CACM.

[7]  M. Sheelagh T. Carpendale,et al.  Fluid integration of rotation and translation , 2005, CHI.

[8]  Andries van Dam,et al.  Post-WIMP user interfaces , 1997, CACM.

[9]  Igor Mordatch,et al.  ViewCube: a 3D orientation indicator and controller , 2008, I3D '08.

[10]  Stephanie Houde,et al.  Iterative design of an interface for easy 3-D direct manipulation , 1992, CHI.

[11]  Darren Leigh,et al.  DiamondTouch: a multi-user touch technology , 2001, UIST '01.

[12]  Martin Hachet,et al.  Multi-touch RST in 2D and 3D spaces: Studying the impact of directness on user performance , 2011, 2011 IEEE Symposium on 3D User Interfaces (3DUI).

[13]  Patrick Baudisch,et al.  Separability of spatial manipulations in multi-touch interfaces , 2009, Graphics Interface.

[14]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.

[15]  George W. Fitzmaurice,et al.  The Rockin'Mouse: integral 3D manipulation on a plane , 1997, CHI.

[16]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[17]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[18]  Jefferson Y. Han.  Low-cost multi-touch sensing through frustrated total internal reflection , 2005, UIST.

[19]  Joe Tullio,et al.  Usability analysis of 3D rotation techniques , 1997, UIST '97.

[20]  Meredith Ringel Morris,et al.  User-defined gestures for surface computing , 2009, CHI.

[21]  Patrick Olivier,et al.  Camera Control in Computer Graphics , 2008, Comput. Graph. Forum.

[22]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[23]  W. Buxton,et al.  A study in two-handed input , 1986, CHI '86.

[24]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[25]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[26]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[27]  Abigail Sellen,et al.  A study in interactive 3-D rotation using 2-D control devices , 1988, SIGGRAPH.

[28]  Donald A. Norman,et al.  Natural user interfaces are not natural , 2010, INTR.

[29]  Laurent Grisoni,et al.  The effect of DOF separation in 3D manipulation tasks with multi-touch displays , 2010, VRST '10.

[30]  M. Sheelagh T. Carpendale,et al.  Rotation and translation mechanisms for tabletop interaction , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[31]  A. Tamhane,et al.  Multiple Comparison Procedures , 1989 .

[32]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[33]  Marc Herrlich,et al.  Integrated Rotation and Translation for 3D Manipulation on Multi-Touch Interactive Surfaces , 2011, Smart Graphics.