Leap Motion- and Mouse-Based Target Selection: Productivity, Perceived Comfort and Fatigue, User Preference, and Perceived Usability

ABSTRACT Remote pointing is an input method that involves in-air gesticulation. Target selection via Leap Motion-based remote pointing and mouse-based pointing were compared while addressing methodological limitations that were present in previous studies. Participants completed the ISO 9241-9 multidirectional tapping test for pointing device evaluation with a wide range of target size-distance combinations and a standardized arm posture. Dependent variables included movement time, errors, throughput, perceived comfort, perceived fatigue, user preference, and perceived usability. Leap Motion-based input led to (a) worse user productivity, (b) more finger, wrist, shoulder, and neck fatigue, (c) lower preference ratings, and (d) lower usability ratings than mouse-based input. The experiment (i) confirmed findings about remote pointing-related productivity and fatigue, and did so while controlling methodological limitations present in prior studies, (ii) revealed significant discomfort and fatigue despite the presence of an arm rest, and (iii) revealed new findings about preference and usability.

[1]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[2]  Jacob S Nteere,et al.  Information Capacity of the Human Motor system , 1982 .

[3]  Alvin Jude,et al.  Personal space: user defined gesture space for GUI interaction , 2014, CHI Extended Abstracts.

[4]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[5]  C. A. Boneau,et al.  The effects of violations of assumptions underlying the test. , 1960, Psychological bulletin.

[6]  Herbert Colle,et al.  Standing at a kiosk: Effects of key size and spacing on touch screen numeric keypad performance and user preference , 2004, Ergonomics.

[7]  I. Scott MacKenzie,et al.  ISO 9241-9 evaluation of video game controllers , 2009, Graphics Interface.

[8]  Jacob O. Wobbrock,et al.  The effects of task dimensionality, endpoint deviation, throughput calculation, and experiment design on pointing measures and models , 2011, CHI.

[9]  Diana Adler,et al.  Using Multivariate Statistics , 2016 .

[10]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[11]  Sangwon Lee,et al.  Fatigue problems in remote pointing and the use of an upper-arm support , 2012 .

[12]  B. Tabachnick,et al.  Using multivariate statistics, 5th ed. , 2007 .

[13]  Brett Wilkinson,et al.  Comparison of gestural, touch, and mouse interaction with Fitts' law , 2013, OZCHI.

[14]  Wolfgang Stuerzlinger,et al.  The performance of un-instrumented in-air pointing , 2014, Graphics Interface.

[15]  Gerhard Rinkenauer,et al.  Evaluation of the Leap Motion Controller as a New Contact-Free Pointing Device , 2014, Sensors.

[16]  Alvin Jude,et al.  An evaluation of touchless hand gestural interaction for pointing tasks with preferred and non-preferred hands , 2014, NordiCHI.

[17]  I. Scott MacKenzie,et al.  An Evaluation of Two Input Devices for Remote Pointing , 2001, EHCI.

[18]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[19]  Roger J. Hubbold,et al.  Real-time Hand Tracking With Variable-Length Markov Models of Behaviour , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[20]  Gwanseob Shin,et al.  User discomfort, work posture and muscle activity while using a touchscreen in a desktop PC setting , 2011, Ergonomics.

[21]  Jonathan W. Decker,et al.  Performance measurements for the Microsoft Kinect skeleton , 2012, 2012 IEEE Virtual Reality Workshops (VRW).

[22]  Alexandros Pino,et al.  Using Wiimote for 2D and 3D Pointing Tasks: Gesture Performance Evaluation , 2011, Gesture Workshop.

[23]  Jorge C. S. Cardoso,et al.  The Leap Motion movement for 2D pointing tasks: Characterisation and comparison to other devices , 2015, 2015 International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS).

[24]  Jorge C. S. Cardoso,et al.  One Hand or Two Hands? 2D Selection Tasks With the Leap Motion Device , 2015, ACHI 2015.

[25]  Alexandros Pino,et al.  Using Kinect for 2D and 3D Pointing Tasks: Performance Evaluation , 2013, HCI.

[26]  Marcelo Knörich Zuffo,et al.  On the usability of gesture interfaces in virtual reality environments , 2005, CLIHC '05.

[27]  George E Stelmach,et al.  Age-related kinematic differences as influenced by task difficulty, target size, and movement amplitude. , 2002, The journals of gerontology. Series B, Psychological sciences and social sciences.

[28]  Anne Marsden,et al.  International Organization for Standardization , 2014 .

[29]  Bengt Ahlström,et al.  Overcoming touchscreen user fatigue by workplace design , 1992, CHI '92.