Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones

In this paper we present an investigation into how hand usage is affected by different mobile phone form factors. Our initial (qualitative) study explored how users interact with various mobile phone types (touchscreen, physical keyboard and stylus). The analysis of the videos revealed that each type of mobile phone affords specific handgrips and that the user shifts these grips and consequently the tilt and rotation of the phone depending on the context of interaction. In order to further investigate the tilt and rotation effects we conducted a controlled quantitative study in which we varied the size of the phone and the type of grips (Symmetric bimanual, Asymmetric bimanual with finger, Asymmetric bimanual with thumb and Single handed) to better understand how they affect the tilt and rotation during a dual pointing task. The results showed that the size of the phone does have a consequence and that the distance needed to reach action items affects the phones' tilt and rotation. Additionally, we found that the amount of tilt, rotation and reach required corresponded with the participant's grip preference. We finish the paper by discussing the design lessons for mobile UI and proposing design guidelines and applications for these insights.

[1]  Brad A. Myers,et al.  The performance of hand postures in front- and back-of-device interaction for mobile computing , 2008, Int. J. Hum. Comput. Stud..

[2]  Y. Guiard Asymmetric division of labor in human skilled bimanual action: the kinematic chain as a model. , 1987, Journal of motor behavior.

[3]  Simon Rogers,et al.  28 frames later: predicting screen touches from back-of-device grip changes , 2014, CHI.

[4]  Juan Pablo Hourcade,et al.  Evaluating one handed thumb tapping on mobile touchscreen devices , 2008, Graphics Interface.

[5]  Joanna McGrenere,et al.  Grip Change as an Information Side Channel for Mobile Touch Interaction , 2015, CHI.

[6]  Makiko Kouchi,et al.  Virtual Grasping Assessment Using 3 D Digital Hand Model , 2007 .

[7]  Mike Y. Chen,et al.  iRotate: automatic screen rotation based on face orientation , 2012, CHI.

[8]  Anne Roudaut,et al.  Investigating how the hand interacts with different mobile phones , 2016, MobileHCI Adjunct.

[9]  Jungwon Yoon,et al.  Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger , 2015, MobileHCI Adjunct.

[10]  Niels Henze,et al.  Finger Placement and Hand Grasp during Smartphone Interaction , 2016, CHI Extended Abstracts.

[11]  Karsten Seipp,et al.  Backpat: improving one-handed touchscreen operation by patting the back of the device , 2014, CHI Extended Abstracts.

[12]  Xiang 'Anthony' Chen,et al.  The fat thumb: using the thumb's contact size for single-handed mobile interaction , 2012, Mobile HCI.

[13]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[14]  Joanna Bergstrom-Lehtovirta,et al.  Modeling the functional area of the thumb on mobile touchscreen surfaces , 2014, CHI.

[15]  Shumin Zhai,et al.  Touch behavior with different postures on soft smartphone keyboards , 2012, Mobile HCI.

[16]  Kee-Eung Kim,et al.  Hand Grip Pattern Recognition for Mobile User Interfaces , 2006, AAAI.

[17]  Sebastian Boring,et al.  HandSense: discriminating different ways of grasping and holding a tangible user interface , 2009, Tangible and Embedded Interaction.

[18]  Mike Y. Chen,et al.  iGrasp: grasp-based adaptive keyboard for mobile devices , 2013, CHI Extended Abstracts.

[19]  Kenton O'Hara,et al.  Pre-Touch Sensing for Mobile Interaction , 2016, CHI.

[20]  Jinwook Seo,et al.  Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture , 2015, CHI.