Expanding touch input vocabulary by using consecutive distant taps

In recent years, touch screens have emerged and matured as the main input interface for mobile and tablet computers calling for extended touch input possibilities. In this paper, we explore the use of consecutive distant taps to expand the touch screen input vocabulary. We analyzed time intervals and distances between consecutive taps during common applications on a tablet and verified that consecutive distant taps can be used conflict-free with existing touch gestures. We designed the two interaction techniques Ta-tap and Ta-Ta-tap that utilize consecutive distant taps. Ta-tap uses two consecutive distant taps to invoke alternative touch operations for multi-touch emulation, whereas Ta-Ta-tap uses a series of consecutive distant taps to define a spatial gesture. We verified the feasibility of both interaction techniques through a series of experiments and a user study. The high recognition rate of Ta-tap and Ta-Ta-tap gestures, the few conflicts with existing gestures, and the positive feedback from the participants assert the potential of consecutive distant taps as a new design space to enrich touch screen interactions.

[1]  Hendrik Müller,et al.  Understanding tablet use: a multi-method exploration , 2012, Mobile HCI.

[2]  Eric Lecolinet,et al.  MicroRolls: expanding touch-screen input vocabulary by distinguishing rolls vs. slides of the thumb , 2009, CHI.

[3]  Chris Harrison,et al.  TapSense: enhancing finger interaction on touch surfaces , 2011, UIST.

[4]  Geehyuk Lee,et al.  Forcetap: extending the input vocabulary of mobile touch screens by adding tap gestures , 2011, Mobile HCI.

[5]  Geehyuk Lee,et al.  Force gestures: augmenting touch screen gestures with normal and tangential forces , 2011, UIST.

[6]  Daniel J. Wigdor,et al.  Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces , 2011, CHI.

[7]  Marcos Serrano,et al.  Bezel-Tap gestures: quick activation of commands from sleep mode on tablets , 2013, CHI.

[8]  Chris Harrison,et al.  Using shear as a supplemental two-dimensional input channel for rich touchscreen interaction , 2012, CHI.

[9]  Patrick Baudisch,et al.  Precise selection techniques for multi-touch screens , 2006, CHI.

[10]  Ben Shneiderman,et al.  High Precision Touchscreens: Design Strategies and Comparisons with a Mouse , 1991, Int. J. Man Mach. Stud..

[11]  Tony DeRose,et al.  Determining the benefits of direct-touch, bimanual, and multifinger input on a multitouch workstation , 2009, Graphics Interface.

[12]  Volker Roth,et al.  Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices , 2009, CHI.

[13]  Philip L. Davidson,et al.  Extending 2D object arrangement with pressure-sensitive layering cues , 2008, UIST '08.

[14]  Caroline Appert,et al.  Extending the vocabulary of touch events with ThumbRock , 2013, Graphics Interface.

[15]  Patrick Baudisch,et al.  Imaginary phone: learning imaginary interfaces by transferring spatial memory from a familiar device , 2011, UIST.

[16]  Feng Wang,et al.  Empirical evaluation for finger input properties in multi-touch interaction , 2009, CHI.

[17]  Jun Rekimoto,et al.  GraspZoom: zooming and scrolling control model for single-handed mobile interaction , 2009, Mobile HCI.

[18]  Wendy E. Mackay,et al.  BiTouch and BiPad: designing bimanual interaction for hand-held tablets , 2012, CHI.

[19]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[20]  Yang Li,et al.  Gestures without libraries, toolkits or training: a $1 recognizer for user interface prototypes , 2007, UIST.

[21]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[22]  Anna L. Cox,et al.  Questionnaires, in-depth interviews and focus groups , 2008 .

[23]  Maneesh Agrawala,et al.  Zone and polygon menus: using relative position to increase the breadth of multi-stroke marking menus , 2006, CHI.

[24]  L. R. Rabiner,et al.  A comparative study of several dynamic time-warping algorithms for connected-word recognition , 1981, The Bell System Technical Journal.

[25]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[26]  John Karat,et al.  A Comparison of Menu Selection Techniques: Touch Panel, Mouse and Keyboard , 1986, Int. J. Man Mach. Stud..

[27]  Xiang Cao,et al.  Detecting and leveraging finger orientation for interaction with direct-touch surfaces , 2009, UIST '09.

[28]  Ken Hinckley,et al.  Sensor synaesthesia: touch in motion, and motion in touch , 2011, CHI.

[29]  Shwetak N. Patel,et al.  GripSense: using built-in sensors to detect hand posture and pressure on commodity mobile phones , 2012, UIST.