Dual-Surface input: augmenting one-handed interaction with coordinated front and behind-the-screen input

Interaction patterns with handheld mobile devices are constantly evolving. Researchers observed that users prefer to interact with mobile device using one hand. However, only few interaction techniques support this mode of operation. We show that one-handed operations can be enhanced with coordinated interaction using for input the front and back of a mobile device, which we term as Dual-Surface interaction. We present some of the design rationale for introducing coordinated Dual-Surface interactions. We demonstrate that several tasks, including target selection, benefit from Dual-Surface input which allows users to rapidly select small targets in locations that are less accessible when interacting using the thumb with one-handed input. Furthermore, we demonstrate the benefits of virtual enhancements that are possible with behind-the-display relative input to perform complex tasks, such as steering. Our results show that Dual-Surface interactions offer numerous benefits that are not available with input on the front or the back alone.

[1]  Jack Tigh Dennerlein,et al.  Force-feedback improves performance for steering and combined steering-targeting tasks , 2000, CHI.

[2]  Ravin Balakrishnan,et al.  Acquisition of expanding targets , 2002, CHI.

[3]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[4]  Patrick Baudisch,et al.  Lucid touch: a see-through mobile device , 2007, UIST.

[5]  Brad A. Myers,et al.  The performance of hand postures in front- and back-of-device interaction for mobile computing , 2008, Int. J. Hum. Comput. Stud..

[6]  Mark W. Newman,et al.  Escape: a target selection technique using visually-cued gestures , 2008, CHI.

[7]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[8]  Patrick Baudisch,et al.  Back-of-device interaction allows creating very small touch devices , 2009, CHI.

[9]  B. Bederson,et al.  Understanding Single-Handed Mobile Device Interaction , 2006 .

[10]  B. Shneiderman,et al.  Improving the accuracy of touch screens: an experimental evaluation of three strategies , 1988, CHI '88.

[11]  Erik Nilsen,et al.  Device comparisons for goal-directed drawing tasks , 1994, CHI '94.

[12]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[13]  Steven K. Feiner,et al.  Rubbing and tapping for precise and rapid selection on touch-screen displays , 2008, CHI.

[14]  Gerhard Leitner,et al.  An evaluation of sticky and force enhanced targets in multi target situations , 2006, NordiCHI '06.

[15]  Masanori Sugimoto,et al.  HybridTouch: an intuitive manipulation technique for PDAs using their front and rear surfaces , 2006, Mobile HCI.

[16]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[17]  Alan Esenther,et al.  Fluid DTMouse: better mouse support for touch-based interactions , 2006, AVI '06.

[18]  Benjamin B. Bederson,et al.  One-handed touchscreen input for legacy applications , 2008, CHI.

[19]  Benjamin B. Bederson,et al.  Target size study for one-handed thumb use on small touchscreen devices , 2006, Mobile HCI.

[20]  Ravin Balakrishnan,et al.  Evaluating tactile feedback and direct vs. indirect stylus input in pointing and crossing selection tasks , 2008, CHI.

[21]  Benjamin B. Bederson,et al.  ThumbSpace: Generalized One-Handed Input for Touchscreen-Based Mobile Devices , 2007, INTERACT.

[22]  Daniel Vogel,et al.  Shift: a technique for operating pen-based interfaces using touch , 2007, CHI.

[23]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[24]  David Ahlstr Modeling and Improving Selection in Cascading Pull›Down Menus Using Fitts' Law, the Steering Law and Force Fields , 2005 .

[25]  Benjamin B. Bederson,et al.  AppLens and launchTile: two designs for one-handed thumb use on small devices , 2005, CHI.

[26]  Regan L. Mandryk,et al.  Smart Sticky Widgets: Pseudo-haptic Enhancements for Multi-Monitor Displays , 2006, Smart Graphics.