Investigating How Smartphone Movement is Affected by Body Posture

We present an investigation into how hand usage is affected by different body postures (Sitting at a table, Lying down and Standing) when interacting with smartphones. We theorize a list of factors (smartphone support, body support and muscle usage) and explore their influence the tilt and rotation of the smartphone. From this we draw a list of hypotheses that we investigate in a quantitative study. We varied the body postures and grips (Symmetric bimanual, Asymmetric bimanual finger, Asymmetric bimanual thumb and Single-handed) studying the effects through a dual pointing task. Our results showed that the body posture Lying down had the most movement, followed by Sitting at a table and finally Standing. We additionally generate reports of motions performed using different grips. Our work extends previous research conducted with multiple grips in a sitting position by including other body postures, it is anticipated that UI designers will use our results to inform the development of mobile user interfaces.

[1]  Kee-Eung Kim,et al.  Hand Grip Pattern Recognition for Mobile User Interfaces , 2006, AAAI.

[2]  J E Gold,et al.  Postures, typing strategies, and gender differences in mobile device usage: an observational study. , 2012, Applied ergonomics.

[3]  Simon Rogers,et al.  28 frames later: predicting screen touches from back-of-device grip changes , 2014, CHI.

[4]  Sebastian Boring,et al.  HandSense: discriminating different ways of grasping and holding a tangible user interface , 2009, Tangible and Embedded Interaction.

[5]  Juan Pablo Hourcade,et al.  Evaluating one handed thumb tapping on mobile touchscreen devices , 2008, Graphics Interface.

[6]  Henry. Dreyfuss,et al.  The measure of man , 1960 .

[7]  Niels Henze,et al.  Finger Placement and Hand Grasp during Smartphone Interaction , 2016, CHI Extended Abstracts.

[8]  Alireza Sahami Shirazi,et al.  Upright or sideways?: analysis of smartphone postures in the wild , 2013, MobileHCI '13.

[9]  Mike Y. Chen,et al.  iRotate: automatic screen rotation based on face orientation , 2012, CHI.

[10]  Shumin Zhai,et al.  Touch behavior with different postures on soft smartphone keyboards , 2012, Mobile HCI.

[11]  Antti Oulasvirta,et al.  Performance and Ergonomics of Touch Surfaces: A Comparative Study using Biomechanical Simulation , 2015, CHI.

[12]  Makiko Kouchi,et al.  Virtual Grasping Assessment Using 3 D Digital Hand Model , 2007 .

[13]  Joanna McGrenere,et al.  Grip Change as an Information Side Channel for Mobile Touch Interaction , 2015, CHI.

[14]  Joanna Bergstrom-Lehtovirta,et al.  Modeling the functional area of the thumb on mobile touchscreen surfaces , 2014, CHI.

[15]  Stephen A. Brewster,et al.  Investigating the effects of encumbrance on one- and two- handed interactions with mobile devices , 2014, CHI.

[16]  Woen-Sik Chae,et al.  Biomechanical Analysis of a Smartphone Task with Different Postures , 2012 .

[17]  Anne Roudaut,et al.  Investigating how the hand interacts with different mobile phones , 2016, MobileHCI Adjunct.

[18]  김동수,et al.  스마트폰 사용 자세에 따른 운동역학적 변인 분석 , 2012 .

[19]  Jacob O. Wobbrock,et al.  WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry , 2012, CHI.

[20]  Patrick Baudisch,et al.  The generalized perceived input point model and how to double touch accuracy by extracting fingerprints , 2010, CHI.

[21]  Jan O. Borchers,et al.  BackXPress: Using Back-of-Device Finger Pressure to Augment Touchscreen Input on Smartphones , 2017, CHI.

[22]  Karsten Seipp,et al.  Backpat: improving one-handed touchscreen operation by patting the back of the device , 2014, CHI Extended Abstracts.

[23]  Anne Roudaut,et al.  Understanding Grip Shifts: How Form Factors Impact Hand Movements on Mobile Phones , 2017, CHI.

[24]  Jungwon Yoon,et al.  Index Finger Zone: Study on Touchable Area Expandability Using Thumb and Index Finger , 2015, MobileHCI Adjunct.

[25]  Brad A. Myers,et al.  The performance of hand postures in front- and back-of-device interaction for mobile computing , 2008, Int. J. Hum. Comput. Stud..

[26]  Kenton O'Hara,et al.  Pre-Touch Sensing for Mobile Interaction , 2016, CHI.

[27]  Jinwook Seo,et al.  Understanding Users' Touch Behavior on Large Mobile Touch-Screens and Assisted Targeting by Tilting Gesture , 2015, CHI.