Effect of Orientation on Unistroke Touch Gestures

As touchscreens are the most successful input method of current mobile devices, touch gestures became a widely used input technique. While gestures provide users with advantages to express themselves, they also introduce challenges regarding accuracy and memorability. In this paper, we investigate the effect of a gesture's orientation on how well the gesture can be performed. We conducted a study in which participants performed systematically rotated unistroke gestures. For straight lines as well as for compound lines, we found that users tend to align gestures with the primary axes. We show that the error can be described by a Clausen function with R² = .93. Based on our findings, we suggest design implications and highlight the potential for recognizing flick gestures, visualizing gestures and improving recognition of compound gestures.

[1]  Daniel J. Wigdor,et al.  Slide to X: unlocking the potential of smartphone unlocking , 2014, CHI.

[2]  Laurent Grisoni,et al.  Understanding Users' Perceived Difficulty of Multi-Touch Gesture Articulation , 2014, ICMI.

[3]  Joseph A. Paradiso,et al.  The gesture recognition toolkit , 2014, J. Mach. Learn. Res..

[4]  William Buxton,et al.  The limits of expert performance using hierarchic marking menus , 1993, INTERCHI.

[5]  Janet E. Rogers,et al.  Orthogonal Distance Regression ∗ , 2009 .

[6]  Albrecht Schmidt,et al.  SmudgeSafe: geometric image transformations for smudge-resistant user authentication , 2014, UbiComp.

[7]  Ahmed Sabbir Arif,et al.  A comparative evaluation of touch and pen gestures for adult and child users , 2013, IDC.

[8]  Shumin Zhai,et al.  Differences and Similarities between Finger and Pen Stroke Gestures on Stationary and Mobile devices , 2015, TCHI.

[9]  Yang Li,et al.  Experimental analysis of touch-screen gesture designs in mobile environments , 2011, CHI.

[10]  James A. Landay,et al.  Implications for a gesture design tool , 1999, CHI '99.

[11]  Ravin Balakrishnan,et al.  Simple vs. compound mark hierarchical marking menus , 2004, UIST '04.

[12]  Atau Tanaka,et al.  Beyond recognition: using gesture variation for continuous interaction , 2013, CHI Extended Abstracts.

[13]  Vittorio Fuccella,et al.  Gestures and widgets: performance in text editing on multi-touch capable mobile devices , 2013, CHI.

[14]  Shumin Zhai,et al.  SHARK2: a large vocabulary shorthand writing system for pen-based computers , 2004, UIST '04.

[15]  Shumin Zhai,et al.  Using strokes as command shortcuts: cognitive benefits and toolkit support , 2009, CHI.

[16]  Luis Paulo Reis,et al.  A comparison of machine learning algorithms applied to hand gesture recognition , 2012, 7th Iberian Conference on Information Systems and Technologies (CISTI 2012).

[17]  Niels Henze,et al.  The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments , 2018, CHI.

[18]  Shumin Zhai,et al.  Modeling Gesture-Typing Movements , 2018, Hum. Comput. Interact..

[19]  Gilles Bailly,et al.  Leaf Menus: Linear Menus with Stroke Shortcuts for Small Handheld Devices , 2009, INTERACT.

[20]  Alireza Sahami Shirazi,et al.  Understanding shortcut gestures on mobile touch devices , 2014, MobileHCI '14.

[21]  N. Fisher,et al.  A correlation coefficient for circular data , 1983 .

[22]  Dean Rubine,et al.  Specifying gestures by example , 1991, SIGGRAPH.

[23]  Xiang 'Anthony' Chen,et al.  Swipeboard: a text entry technique for ultra-small interfaces that supports novice to expert transitions , 2014, UIST.

[24]  Milan Sonka,et al.  Image processing analysis and machine vision [2nd ed.] , 1999 .

[25]  Luis A. Leiva,et al.  Gestures à Go Go , 2015, ACM Trans. Intell. Syst. Technol..

[26]  Sandra G. Hart,et al.  Nasa-Task Load Index (NASA-TLX); 20 Years Later , 2006 .

[27]  Shumin Zhai,et al.  Modeling human performance of pen stroke gestures , 2007, CHI.

[28]  Niels Henze,et al.  Modeling Distant Pointing for Compensating Systematic Displacements , 2015, CHI.

[29]  Niels Henze,et al.  100,000,000 taps: analysis and improvement of touch performance in the large , 2011, Mobile HCI.

[30]  Shumin Zhai,et al.  A comparative evaluation of finger and pen stroke gestures , 2012, CHI.

[31]  Shumin Zhai,et al.  Shapewriter on the iphone: from the laboratory to the real world , 2009, CHI Extended Abstracts.

[32]  Paul A. Beardsley,et al.  Design and control of a spherical omnidirectional blimp , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.