3DTouch and HOMER-S: intuitive manipulation techniques for one-handed handheld augmented reality

Existing interaction techniques for mobile AR often use the multi-touch capabilities of the device's display for object selection and manipulation. To provide full 3D manipulation by touch in an integral way, existing approaches use complex multi finger and hand gestures. However, they are difficult or impossible to use in one-handed handheld AR scenarios and their usage requires prior knowledge. Furthermore, a handheld's touch screen offers only two dimensions for interaction and limits manipulation to physical screen size. To overcome these problems, we present two novel intuitive six degree-of-freedom (6DOF) manipulation techniques, 3DTouch and HOMER-S. While 3DTouch uses only simple touch gestures and decomposes the degrees of freedom, Homer-S provides full 6DOF and is decoupled from screen input to overcome physical limitations. In a comprehensive user study, we explore performance, usability and accuracy of both techniques. Therefore, we compare 3DTouch with HOMER-S in four different scenarios with varying transformation requirements. Our results reveal both techniques to be intuitive to translate and rotate objects. HOMER-S lacks accuracy compared to 3DTouch but achieves significant performance increases in terms of speed for transformations addressing all 6DOF.

[1]  Robert J. K. Jacob,et al.  Integrality and separability of input devices , 1994, TCHI.

[2]  Ivan Poupyrev,et al.  The go-go interaction technique: non-linear mapping for direct manipulation in VR , 1996, UIST '96.

[3]  Andrew S. Forsberg,et al.  Image plane interaction techniques in 3D immersive environments , 1997, SI3D.

[4]  Martin Hachet,et al.  tBox: a 3d transformation widget designed for touch-screens , 2011, CHI.

[5]  Ivan Poupyrev,et al.  3D User Interfaces: Theory and Practice , 2004 .

[6]  Doug A. Bowman,et al.  An evaluation of techniques for grabbing and manipulating remote objects in immersive virtual environments , 1997, SI3D.

[7]  Wolfgang Hürst,et al.  Gesture-based interaction via finger tracking for mobile augmented reality , 2011, Multimedia Tools and Applications.

[8]  Laurent Grisoni,et al.  The design and evaluation of 3D positioning techniques for multi-touch displays , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[9]  M. Sheelagh T. Carpendale,et al.  Shallow-depth 3d interaction: design and evaluation of one-, two- and three-touch techniques , 2007, CHI.

[10]  Marvin Everett Mundel,et al.  Motion and Time Study: Improving Productivity , 1970 .

[11]  Gudrun Klinker,et al.  Phone-based motion control in VR: analysis of degrees of freedom , 2011, CHI EA '11.

[12]  Steven K. Feiner,et al.  Mobile augmented reality interaction techniques for authoring situated media on-site , 2006, 2006 IEEE/ACM International Symposium on Mixed and Augmented Reality.

[13]  M. Sheelagh T. Carpendale,et al.  Rotation and translation mechanisms for tabletop interaction , 2006, First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06).

[14]  Philip L. Davidson,et al.  A screen-space formulation for 2D and 3D direct manipulation , 2009, UIST '09.

[15]  Wolfgang Hürst,et al.  Multimodal Interaction Concepts for Mobile Augmented Reality Applications , 2011, MMM.

[16]  Hannes Kaufmann,et al.  ARTiFICe - Augmented Reality Framework for Distributed Collaboration , 2012, Int. J. Virtual Real..

[17]  Tolga K. Çapin,et al.  Dual-Finger 3D Interaction Techniques for mobile devices , 2012, Personal and Ubiquitous Computing.

[18]  Tobias Höllerer,et al.  Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking , 2007, 2007 11th IEEE International Symposium on Wearable Computers.

[19]  Antonio Krüger,et al.  Designing gestures for mobile 3D gaming , 2012, MUM.

[20]  Mark Billinghurst,et al.  Virtual object manipulation using a mobile phone , 2005, ICAT '05.

[21]  Dominique Bechmann,et al.  Influence of degrees of freedom's manipulation on performances during orientation tasks in virtual reality environments , 2009, VRST '09.

[22]  Laurent Grisoni,et al.  Integrality and Separability of Multitouch Interaction Techniques in 3D Manipulation Tasks , 2012, IEEE Transactions on Visualization and Computer Graphics.

[23]  Jun Rekimoto,et al.  Tilting operations for small screen interfaces , 1996, UIST '96.

[24]  Jin Sung Choi,et al.  Freeze-Set-Go interaction method for handheld mobile augmented reality environments , 2009, VRST '09.

[25]  Michael Rohs,et al.  Extending the virtual trackball metaphor to rear touch input , 2010, 2010 IEEE Symposium on 3D User Interfaces (3DUI).

[26]  Masatoshi Ishikawa,et al.  In-air typing interface for mobile devices with vibration feedback , 2010, SIGGRAPH '10.