A pointing facilitation system for motor-impaired users combining polynomial smoothing and time-weighted gradient target prediction models

ABSTRACT As computers become more and more essential for everyday life, people who cannot use them are missing out on an important tool. The predominant method of interaction with a screen is a mouse, and difficulty in using a mouse can be a huge obstacle for people who would otherwise gain great value from using a computer. If mouse pointing were to be made easier, then a large number of users may be able to begin using a computer efficiently where they may previously have been unable to. The present article aimed to improve pointing speeds for people with arm or hand impairments. The authors investigated different smoothing and prediction models on a stored data set involving 25 people, and the best of these algorithms were chosen. A web-based prototype was developed combining a polynomial smoothing algorithm with a time-weighted gradient target prediction model. The adapted interface gave an average improvement of 13.5% in target selection times in a 10-person study of representative users of the system. A demonstration video of the system is available at https://youtu.be/sAzbrKHivEY

[1]  Simon J. Godsill,et al.  Statistical estimation of user's interactions from motion impaired cursor use data , 2006 .

[2]  J. B. Brooke,et al.  SUS: A 'Quick and Dirty' Usability Scale , 1996 .

[3]  Edward Lank,et al.  Speeding pointing in tiled widgets: understanding the effects of target expansion and misprediction , 2010, IUI '10.

[4]  P. Fitts The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[5]  Ehud Sharlin,et al.  Predictive interaction using the delphian desktop , 2005, UIST.

[6]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[7]  Faustina Hwang,et al.  Effects of Target Expansion on Selection Performance in Older Computer Users , 2013, ACM Trans. Access. Comput..

[8]  Patrick Langdon,et al.  Developing Multimodal Adaptation Algorithm for Mobility Impaired Users by Evaluating Their Hand Strength , 2012, Int. J. Hum. Comput. Interact..

[9]  Patrick Langdon,et al.  Multimodal Intelligent Eye-Gaze Tracking System , 2015, Int. J. Hum. Comput. Interact..

[10]  Edward Lank,et al.  Endpoint prediction using motion kinematics , 2007, CHI.

[11]  Lee Skrypchuk,et al.  Interactive Displays in Vehicles: Improving Usability with a Pointing Gesture Tracker and Bayesian Intent Predictors , 2014, AutomotiveUI.

[12]  Susumu Harada,et al.  The angle mouse: target-agnostic dynamic gain adjustment based on angular deviation , 2009, CHI.

[13]  C. Riddle Disability and Health , 2017 .

[14]  Atsuo Murata,et al.  Improvement of Pointing Time by Predicting Targets in Pointing With a PC Mouse , 1998, Int. J. Hum. Comput. Interact..

[15]  Peter Robinson,et al.  Designing Inclusive Interfaces Through User Modeling and Simulation , 2012, Int. J. Hum. Comput. Interact..

[16]  Peter Robinson,et al.  Cursor measures for motion-impaired computer users , 2002, ASSETS.

[17]  Tovi Grossman,et al.  The bubble cursor: enhancing target acquisition by dynamic resizing of the cursor's activation area , 2005, CHI.

[18]  Anind K. Dey,et al.  Probabilistic pointing target prediction via inverse optimal control , 2012, IUI '12.