Human-computer interaction for users with cerebral palsy based on head orientation. Can cursor's movement be modeled by Fitts's law?

Abstract This paper presents an experiment to validate a head-mounted inertial interface for human-computer interaction (HCI) developed for people with cerebral palsy (CP). The method is based on Fitts’s law, an empirical model of human motor performance for aimed movements. Head motion is recorded in a series of goal-crossing tasks and a regression model of the movement time ( MT ) is estimated for each user. Values of R 2 above 0.9 are indicators of a strong correlation of those motion patterns with the linear model proposed by Fitts. The analysis of MT confirmed that head movements of users without disability follow Fitts’s law and showed that 3 users with CP (MACS IV and V) had the same behavior. There was a weaker correlation ( R 2 =0.839) for one individual with cervical dystonia and ballistic movements and no correlation for two users with cervical hypotonia and dyskinetic CP. Results show the impact of ballistic movements and poor postural control in computer interaction. They also provide the foundation for new interaction techniques to develop a universal computer interface for motor impaired users.

[1]  M. Woollacott,et al.  Head stability during quiet sitting in children with cerebral palsy: effect of vision and trunk support , 2010, Experimental Brain Research.

[2]  Ravin Balakrishnan,et al.  "Beating" Fitts' law: virtual enhancements for pointing facilitation , 2004, Int. J. Hum. Comput. Stud..

[3]  Andy Cockburn,et al.  Examining the costs of multiple trajectory pointing techniques , 2013, Int. J. Hum. Comput. Stud..

[4]  Jukka Lekkala,et al.  Pointing and Selecting with Facial Activity , 2016, Interact. Comput..

[5]  R. Raya,et al.  Positive and negative motor signs of head motion in cerebral palsy an analysis based on a wearable inertial human computer interface , 2013, 2013 ISSNIP Biosignals and Biorobotics Conference: Biosignals and Robotics for Better and Safer Living (BRC).

[6]  Jukka Lekkala,et al.  Wireless Face Interface: Using voluntary gaze direction and facial muscle activations for human-computer interaction , 2012, Interact. Comput..

[7]  B. Dan,et al.  Proposed definition and classification of cerebral palsy, April 2005. , 2005, Developmental medicine and child neurology.

[8]  Kim Van Naarden Braun,et al.  Birth Prevalence of Cerebral Palsy: A Population-Based Study , 2016, Pediatrics.

[9]  Gregg C. Vanderheiden,et al.  Mental workload during brain–computer interface training , 2012, Ergonomics.

[10]  Jian Zhao,et al.  A model of scrolling on touch-sensitive displays , 2014, Int. J. Hum. Comput. Stud..

[11]  Xiaohui Liu,et al.  Editorial: Data mining for understanding user needs , 2010, TCHI.

[12]  Stuart K. Card,et al.  Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys, for text selection on a CRT , 1987 .

[13]  Poika Isokoski,et al.  Gazing and frowning as a new human--computer interaction technique , 2004, TAP.

[14]  Erik J Scheme,et al.  On the usability of intramuscular EMG for prosthetic control: a Fitts' Law approach. , 2014, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[15]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[16]  T. C. Davies,et al.  A cross‐sectional study examining computer task completion by adolescents with cerebral palsy across the Manual Ability Classification System levels , 2014, Developmental medicine and child neurology.

[17]  Pradipta Biswas,et al.  A new interaction technique involving eye gaze tracker and scanning system , 2013, ETSA '13.

[18]  François Guimbretière,et al.  Techniques , 2011, Laboratory Investigation.

[19]  William Harwin,et al.  Quantification of the effects of haptic feedback during motor skills tasks in a simulated environment , 2000 .

[20]  Scott E. Hudson,et al.  Automatically detecting pointing performance , 2008, IUI '08.

[21]  Ting-Fang Wu,et al.  Performance of Different Pointing Devices on Children with Cerebral Palsy , 2007, HCI.

[22]  R. Kirsch,et al.  Evaluation of head orientation and neck muscle EMG signals as three-dimensional command sources , 2015, Journal of NeuroEngineering and Rehabilitation.

[23]  Shumin Zhai,et al.  Foundations for designing and evaluating user interfaces based on the crossing paradigm , 2010, TCHI.

[24]  R J Jagacinski,et al.  Fitts' Law in two dimensions with hand and head movements. , 1983, Journal of motor behavior.

[25]  Yao-Ming Yeh,et al.  Assisting an Adolescent with Cerebral Palsy to Entry Text by Using the Chorded Keyboard , 2008, ICCHP.

[26]  Daniel Vogel,et al.  Crossing-based selection with direct touch input , 2014, CHI.

[27]  Nina Rudigkeit,et al.  Evaluation of control modes for head motion-based control with motion sensors , 2015, 2015 IEEE International Symposium on Medical Measurements and Applications (MeMeA) Proceedings.

[28]  Klaus-Robert Müller,et al.  Adaptive Methods in BCI Research - An Introductory Tutorial , 2009 .

[29]  Shumin Zhai,et al.  More than dotting the i's --- foundations for crossing-based interfaces , 2002, CHI.

[30]  David Rempel,et al.  The design of hand gestures for human-computer interaction: Lessons from sign language interpreters , 2014, Int. J. Hum. Comput. Stud..

[31]  A. Eliasson,et al.  The Manual Ability Classification System (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. , 2006, Developmental medicine and child neurology.

[32]  Richard C. Simpson,et al.  Evaluation of an adaptive row/column scanning system , 2006 .

[33]  Minho Kim,et al.  Hybrid EEG and eye movement interface to multi-directional target selection , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[34]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[35]  Ann Johnson.  Prevalence and characteristics of children with cerebral palsy in Europe. , 2002, Developmental medicine and child neurology.

[36]  Minho Kim,et al.  Quantitative Evaluation of a Low-Cost Noninvasive Hybrid Interface Based on EEG and Eye Movement , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[37]  J. Grauer,et al.  Normal Functional Range of Motion of the Cervical Spine During 15 Activities of Daily Living , 2010, Journal of spinal disorders & techniques.

[38]  Tom Chau,et al.  Youth with cerebral palsy with differing upper limb abilities: how do they access computers? , 2010, Archives of physical medicine and rehabilitation.

[39]  Ramón Ceres Ruíz,et al.  Positive and Negative Motor Signs of Head Motion in Cerebral Palsy: Assessment of Impairment and Task Performance , 2016, IEEE Systems Journal.

[40]  Jacob O. Wobbrock,et al.  Modeling and predicting pointing errors in two dimensions , 2011, CHI.

[41]  R.F. Kirsch,et al.  Evaluation of Head Orientation and Neck Muscle EMG Signals as Command Inputs to a Human–Computer Interface for Individuals With High Tetraplegia , 2008, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[42]  Erik J. Scheme,et al.  Validation of a Selective Ensemble-Based Classification Scheme for Myoelectric Control Using a Three-Dimensional Fitts' Law Test , 2013, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[43]  M. Woollacott,et al.  Segmental Contributions to Trunk Control in Children With Moderate-to-Severe Cerebral Palsy. , 2015, Archives of physical medicine and rehabilitation.

[44]  Xun Chen,et al.  Pattern recognition of number gestures based on a wireless surface EMG system , 2013, Biomed. Signal Process. Control..

[45]  Oleg Spakov,et al.  Look and lean: accurate head-assisted eye pointing , 2014, ETRA.

[46]  T. Claire Davies,et al.  Using cursor measures to investigate the effects of impairment severity on cursor control for youths with cerebral palsy , 2014, Int. J. Hum. Comput. Stud..

[47]  Brendan Z. Allison,et al.  Brain-Computer Interfaces , 2010 .

[48]  I. Scott MacKenzie,et al.  Fitts' throughput and the speed-accuracy tradeoff , 2008, CHI.

[49]  Mickaël Causse,et al.  Evaluation of head-free eye tracking as an input device for air traffic control , 2013, Ergonomics.

[50]  Dan Ding,et al.  Target prediction for icon clicking by athetoid persons , 2008, 2008 IEEE International Conference on Robotics and Automation.

[51]  T CLAIRE DAVIES,et al.  Enabling self‐directed computer use for individuals with cerebral palsy: a systematic review of assistive devices and technologies , 2010, Developmental medicine and child neurology.

[52]  M L Lin,et al.  A Method for Evaluating Head-Controlled Computer Input Devices Using Fitts' Law , 1990, Human factors.

[53]  C. Cans.  Surveillance of cerebral palsy in Europe: a collaboration of cerebral palsy surveys and registers , 2000, Developmental medicine and child neurology.

[54]  Alison Gump,et al.  Application of Fitts' Law to Individuals with Cerebral Palsy , 2002, Perceptual and motor skills.

[55]  Y. Istefanopulos,et al.  IEEE Engineering in Medicine and Biology Society , 2019, IEEE Transactions on Biomedical Engineering.

[56]  Erik Scheme,et al.  Motion Normalized Proportional Control for Improved Pattern Recognition-Based Myoelectric Control , 2014, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[57]  Nicolas Roussel,et al.  No more bricolage!: methods and tools to characterize, replicate and compare pointing transfer functions , 2011, UIST.

[58]  José Luis Pons Rovira,et al.  A Robust Kalman Algorithm to Facilitate Human-Computer Interaction for People with Cerebral Palsy, Using a New Interface Based on Inertial Sensors , 2012, Sensors.