Introducing postural variability improves the distribution of muscular loads during mid-air gestural interaction

Only time will tell if motion-controlled systems are the future of gaming and other industries and if mid-air gestural input will eventually offer a more intuitive way to play games and interact with computers. Whatever the eventual outcome, it is necessary to assess the ergonomics of mid-air input metaphors and propose design guidelines which will guarantee their safe use in the long run. This paper presents an ergonomic study showing how to mitigate the muscular strain induced by prolonged mid-air gesture interaction by encouraging postural shifts during the interaction. A quantitative and qualitative user study involving 30 subjects validates the setup. The simulated musculo-skeletal load values support our hypothesis and show a statistically significant 19% decrease in average muscle loads on the shoulder, neck, and back area in the modified condition compared to the baseline.

[1]  Antti Oulasvirta,et al.  Investigating the Dexterity of Multi-Finger Input for Mid-Air Text Entry , 2015, CHI.

[2]  Paulo Flores,et al.  Challenges in using OpenSim as a multibody design tool to model, simulate, and analyze prosthetic devices : a knee joint case-study , 2012 .

[3]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[4]  Pourang Irani,et al.  Consumed endurance: a metric to quantify arm fatigue of mid-air interactions , 2014, CHI.

[5]  G R Johnson,et al.  A framework for the definition of standardized protocols for measuring upper-extremity kinematics. , 2009, Clinical biomechanics.

[6]  김동수,et al.  스마트폰 사용 자세에 따른 운동역학적 변인 분석 , 2012 .

[7]  Hans-Peter Seidel,et al.  MovExp: A Versatile Visualization Tool for Human-Computer Interaction Studies with 3D Performance and Biomechanical Data , 2014, IEEE Transactions on Visualization and Computer Graphics.

[8]  Scott L. Delp,et al.  A Model of the Upper Extremity for Simulating Musculoskeletal Surgery and Analyzing Neuromuscular Control , 2005, Annals of Biomedical Engineering.

[9]  L M Straker,et al.  A comparison of posture and muscle activity during tablet computer, desktop computer and paper use by young children , 2008, Ergonomics.

[10]  Ayman Habib,et al.  OpenSim: Open-Source Software to Create and Analyze Dynamic Simulations of Movement , 2007, IEEE Transactions on Biomedical Engineering.

[11]  E. Heath Borg's Perceived Exertion and Pain Scales , 1998 .

[12]  Jeffrey A. Reinbolt,et al.  Simulation of human movement: applications using OpenSim , 2011 .

[13]  Woen-Sik Chae,et al.  Biomechanical Analysis of a Smartphone Task with Different Postures , 2012 .

[14]  David Lindlbauer,et al.  Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI , 2012 .

[15]  Antti Oulasvirta,et al.  Is motion capture-based biomechanical simulation valid for HCI studies?: study and implications , 2014, CHI.

[16]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[17]  Shumin Zhai,et al.  Quantifying coordination in multiple DOF movement and its application to evaluating 6 DOF input devices , 1998, CHI.

[18]  A. Franklyn-Miller,et al.  Biomechanical overload syndrome: defining a new diagnosis , 2012, British Journal of Sports Medicine.

[19]  Antti Oulasvirta,et al.  Performance and Ergonomics of Touch Surfaces: A Comparative Study using Biomechanical Simulation , 2015, CHI.