Combining bimanual interaction and teleportation for 3D manipulation on multi-touch wall-sized displays

While multi-touch devices are well established in our everyday life, they are currently becoming larger and larger. Large screens such as wall-sized displays are now equipped with multi-touch capabilities. Multi-touch wall-sized displays will become widespread in a near future in various places such as public places or meeting rooms. These new devices are an interesting opportunity to interact with 3D virtual environments: the large display surface offers a good immersion, while the multi-touch capabilities could make interaction with 3D content accessible to the general public. In this paper, we aim to explore touch-based 3D interaction in the situation where users are immersed in a 3D virtual environment and move in front of a vertical wall-sized display. We design In(SITE), a bimanual touch-based technique combined with object teleportation features which enables users to interact on a large wall-sized display. This technique is compared with a standard 3D interaction technique for performing 6 degrees of freedom manipulation tasks on a wall-sized display. The results of two controlled experiments show that participants can reach the same level of performance for completion time and a better precision for fine adjustments of object position with the In(SITE) technique. They also suggest that combining object teleportation with both techniques improves translations in terms of ease of use, fatigue, and user preference.

[1]  Martin Hachet,et al.  Beyond the mouse: Understanding user gestures for manipulating 3D objects from touchscreen inputs , 2012, Comput. Graph..

[2]  J. J. Higgins,et al.  The aligned rank transform for nonparametric factorial analyses using only anova procedures , 2011, CHI.

[3]  Laurent Grisoni,et al.  The design and evaluation of 3D positioning techniques for multi-touch displays , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[4]  Jim Humphries,et al.  Gestural interaction in a virtual environment , 1994, Electronic Imaging.

[5]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[6]  Tobias Isenberg,et al.  FI3D: Direct-Touch Interaction for the Exploration of 3D Scientific Visualization Spaces , 2010, IEEE Transactions on Visualization and Computer Graphics.

[7]  Klaus H. Hinrichs,et al.  Triangle cursor: interactions with objects above the tabletop , 2011, ITS '11.

[8]  Thierry Duval,et al.  An asymmetric 2D Pointer/3D Ray for 3D interaction within collaborative virtual environments , 2009, Web3D '09.

[9]  Nicolas Roussel,et al.  1 € filter: a simple speed-based low-pass filter for noisy input in interactive systems , 2012, CHI.

[10]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[11]  Tobias Isenberg,et al.  Towards An Understanding of Mobile Touch Navigation in a Stereoscopic Viewing Environment for 3D Data Exploration , 2016, IEEE Transactions on Visualization and Computer Graphics.

[12]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[13]  Martin Hachet,et al.  Advances in Interaction with 3D Environments , 2015, Comput. Graph. Forum.

[14]  Klaus H. Hinrichs,et al.  2d touching of 3d stereoscopic objects , 2011, CHI.

[15]  Laurent Grisoni,et al.  The effect of DOF separation in 3D manipulation tasks with multi-touch displays , 2010, VRST '10.

[16]  Mark R. Mine,et al.  Virtual Environment Interaction Techniques , 1995 .

[17]  Daniel Vogel,et al.  The Impact of Control-Display Gain on User Performance in Pointing Tasks , 2008, Hum. Comput. Interact..

[18]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[19]  Randy F. Pausch,et al.  Voodoo dolls: seamless interaction at multiple scales in virtual environments , 1999, SI3D.

[20]  M. Sheelagh T. Carpendale,et al.  Sticky tools: full 6DOF force-based interaction for multi-touch tables , 2009, ITS '09.

[21]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[22]  Jan O. Borchers,et al.  Direct manipulation and the third dimension: co-planar dragging on 3d displays , 2012, ITS '12.

[23]  Fotis Sotiropoulos,et al.  Interactive Slice WIM: Navigating and Interrogating Volume Data Sets Using a Multisurface, Multitouch VR Interface , 2012, IEEE Transactions on Visualization and Computer Graphics.

[24]  Steven K. Feiner,et al.  Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selection , 2007, 2007 IEEE Symposium on 3D User Interfaces.

[25]  Daniel F. Keefe,et al.  Nailing down multi-touch: anchored above the surface interaction for 3D modeling and navigation , 2012, Graphics Interface.

[26]  Nicolas Roussel,et al.  Direct and indirect multi-touch interaction on a wall display , 2014, IHM.