Upper Limb Motor Skills Performance Evaluation Based on Point-and-Click Cursor Trajectory Analysis: Application in Early Multiple Sclerosis Detection

We present an enhanced version of the input device evaluation application (IDEA) system as an objective method for evaluating upper limb motor skills performance. By introducing three new metrics for mouse cursor trajectory analysis, along with the application of the two-dimensional (2D) experiment in the case of multiple sclerosis (MS), we examine the sensitivity of the IDEA system for differentiating patients with early-stage MS and healthy participants. The IDEA system calculates multiple kinematic metrics for point-and-click tasks: movement time, index of difficulty, effective target width, effective index of difficulty, throughput, missed clicks, target re-entry, task axis crossing, movement direction change, orthogonal direction change, movement variability, movement error, movement offset, mean velocity, velocity peaks, and maximum/mean velocity ratio. The results reveal that the IDEA system sensitivity has been improved in comparison with previous studies, which is high enough to detect the presence of early-stage MS with a 70.9% success rate in the 2D experiment.

[1]  M. Popovic,et al.  Relationship between clinical assessments of function and measurements from an upper-limb robotic rehabilitation device in cervical spinal cord injury , 2022 .

[2]  M. Filippi,et al.  Abnormal adaptation over time of motor network recruitment in multiple sclerosis patients with fatigue , 2016, Multiple sclerosis.

[3]  Alexandros Pino,et al.  Using Kinect for 2D and 3D Pointing Tasks: Performance Evaluation , 2013, HCI.

[4]  Philippe Allain,et al.  Executive functioning in normal aging: A study of action planning using the Zoo Map Test , 2005, Brain and Cognition.

[5]  L. Derogatis,et al.  The SCL-90-R, Brief Symptom Inventory, and Matching Clinical Rating Scales. , 1999 .

[6]  Ilaria Carpinella,et al.  Robot-based rehabilitation of the upper limbs in multiple sclerosis: feasibility and preliminary results. , 2009, Journal of rehabilitation medicine.

[7]  S S Stevens,et al.  HUMAN ENGINEERING FOR AN EFFECTIVE AIR-NAVIGATION AND TRAFFIC-CONTROL SYSTEM, AND APPENDIXES 1 THRU 3 , 1951 .

[8]  A. David,et al.  Unpacking the depersonalization syndrome: an exploratory factor analysis on the Cambridge Depersonalization Scale , 2005, Psychological Medicine.

[9]  H. Weiner,et al.  A working protocol to be used as a guideline for trials in multiple sclerosis. , 1983, Archives of neurology.

[10]  N. Hogan,et al.  Movement Smoothness Changes during Stroke Recovery , 2002, The Journal of Neuroscience.

[11]  Alexandros Pino,et al.  Brain Computer Interface Cursor Measures for Motion-impaired and Able-bodied Users , 2022 .

[12]  J. D. de Jonghe,et al.  The Zung Self-Rating Depression Scale: A Replication Study on Reliability, Validity and Prediction , 1989 .

[13]  Ian Mackenzie,et al.  Fitts' law as a performance model in human-computer interaction , 1992 .

[14]  Gammon M Earhart,et al.  The 9-Hole Peg Test of Upper Extremity Function: Average Values, Test-Retest Reliability, and Factors Contributing to Performance in People With Parkinson Disease , 2011, Journal of neurologic physical therapy : JNPT.

[15]  James McNames,et al.  Objective measure of upper extremity motor impairment in Parkinson's disease with inertial sensors , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[16]  R. Bagby,et al.  The alexithymia construct: relationship with sociodemographic variables and intelligence. , 1989, Comprehensive psychiatry.

[17]  Daniel J. Wigdor,et al.  Direct-touch vs. mouse input for tabletop displays , 2007, CHI.

[18]  E. Smeraldi,et al.  An assessment of the Wisconsin Card Sorting Test as an indicator of liability to schizophrenia , 1994, Schizophrenia Research.

[19]  Maysam Ghovanloo,et al.  Using Fitts's law for evaluating Tongue Drive System as a pointing device for computer access , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[20]  I. Scott MacKenzie,et al.  Towards a standard for pointing device evaluation, perspectives on 27 years of Fitts' law research in HCI , 2004, Int. J. Hum. Comput. Stud..

[21]  N. Silberberg,et al.  Hand strength and dexterity. , 1971, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[22]  Wolfgang Stuerzlinger,et al.  Laser Pointers as Collaborative Pointing Devices , 2002, Graphics Interface.

[23]  I. Scott MacKenzie,et al.  An Evaluation of Two Input Devices for Remote Pointing , 2001, EHCI.

[24]  Alexandros Pino,et al.  Upper Limb Motor Skills Evaluation in Patients with Early Multiple Sclerosis Using the IDEA System , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[25]  Roseli de Deus Lopes,et al.  Human–Computer Interface Controlled by the Lip , 2015, IEEE Journal of Biomedical and Health Informatics.

[26]  J. H. Eysenck,et al.  PRINCIPLES AND METHODS OF PERSONALITY DESCRIPTION, CLASSIFICATION AND DIAGNOSIS. , 1964, British journal of psychology.

[27]  I. Scott MacKenzie,et al.  Accuracy measures for evaluating computer pointing devices , 2001, CHI.

[28]  Cristina Manresa-Yee,et al.  Evaluation of a Mobile Head-Tracker Interface for Accessibility , 2016, ICCHP.

[29]  J. Bradshaw,et al.  Movement Planning and Online Control in Multiple Sclerosis: Assessment Using a Fitts Law Reciprocal Aiming Task , 2014, Cognitive and behavioral neurology : official journal of the Society for Behavioral and Cognitive Neurology.

[30]  P. Fitts,et al.  INFORMATION CAPACITY OF DISCRETE MOTOR RESPONSES. , 1964, Journal of experimental psychology.

[31]  Douglas J. Gillan,et al.  How does Fitts' law fit pointing and dragging? , 1990, CHI '90.

[32]  Georgios Kouroupetroglou,et al.  Performance Evaluation of Gesture-based 2D and 3D Pointing Tasks , 2011 .

[33]  J. Kurtzke.  Rating neurologic impairment in multiple sclerosis , 1983, Neurology.

[34]  Karl J. Friston,et al.  Investigations of the functional anatomy of attention using the stroop test , 1993, Neuropsychologia.

[35]  Ludwig Kappos,et al.  Usability and Acceptability of ASSESS MS: Assessment of Motor Dysfunction in Multiple Sclerosis Using Depth-Sensing Computer Vision , 2015, JMIR human factors.

[36]  Kasper Hornbæk,et al.  An experimental comparison of touch interaction on vertical and horizontal surfaces , 2012, NordiCHI.

[37]  Hans J. Eysenck,et al.  Manual of the Eysenck personality questionnaire , 1975 .

[38]  K. Kavale,et al.  What Definitions of Learning Disability Say and Don't Say , 2000, Journal of learning disabilities.

[39]  Virgil Mathiowetz,et al.  Test-retest reliability of the Purdue Pegboard for persons with multiple sclerosis. , 2003, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[40]  P. Feys,et al.  The Armeo Spring as training tool to improve upper limb functionality in multiple sclerosis: a pilot study , 2011, Journal of NeuroEngineering and Rehabilitation.

[41]  P. Fitts.  The information capacity of the human motor system in controlling the amplitude of movement. , 1954, Journal of experimental psychology.

[42]  Kimatha Oxford Grice,et al.  Adult norms for a commercially available Nine Hole Peg Test for finger dexterity. , 2003, The American journal of occupational therapy : official publication of the American Occupational Therapy Association.

[43]  Etienne Burdet,et al.  A Robust and Sensitive Metric for Quantifying Movement Smoothness , 2012, IEEE Transactions on Biomedical Engineering.

[44]  Georgios Kouroupetroglou.  Disability Informatics and Web Accessibility for Motor Limitations , 2013 .

[45]  Sheng Quan Xie,et al.  Exoskeleton robots for upper-limb rehabilitation: state of the art and future prospects. , 2012, Medical engineering & physics.

[46]  M. Levin,et al.  Virtual Reality in Stroke Rehabilitation: A Systematic Review of its Effectiveness for Upper Limb Motor Recovery , 2007, Topics in stroke rehabilitation.

[47]  L. Vécsei,et al.  The epidemiology of multiple sclerosis in Europe , 2006, European journal of neurology.

[48]  Krzysztof Z. Gajos,et al.  A comparison of area pointing and goal crossing for people with and without motor impairments , 2007, Assets '07.

[49]  V. Mathiowetz,et al.  Adult Norms for the Nine Hole Peg Test of Finger Dexterity , 1985 .

[50]  Marko Munih,et al.  Upper limb motion analysis using haptic interface , 2001 .

[51]  K. Sunnerhagen,et al.  Kinematic Variables Quantifying Upper-Extremity Performance After Stroke During Reaching and Drinking From a Glass , 2011, Neurorehabilitation and neural repair.

[52]  A. Merlo,et al.  Upper limb evaluation with robotic exoskeleton. Normative values for indices of accuracy, speed and smoothness. , 2013, NeuroRehabilitation.

[53]  Shumin Zhai,et al.  Beyond Fitts' law: models for trajectory-based HCI tasks , 1997, CHI Extended Abstracts.

[54]  Robert Riener,et al.  Robot-aided neurorehabilitation of the upper extremities , 2005, Medical and Biological Engineering and Computing.

[55]  Abigail Sellen,et al.  A comparison of input devices in element pointing and dragging tasks , 1991, CHI.

[56]  Sarah A. Douglas,et al.  Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard , 1999, CHI '99.

[57]  Chris Harris,et al.  Markerless Motion Capture and Measurement of Hand Kinematics: Validation and Application to Home-Based Upper Limb Rehabilitation , 2013, IEEE Transactions on Biomedical Engineering.

[58]  N. Larocca,et al.  The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. , 1989, Archives of neurology.

[59]  D. Goodkin,et al.  Upper extremity function in multiple sclerosis: improving assessment sensitivity with box-and-block and nine-hole peg tests. , 1988, Archives of physical medicine and rehabilitation.

[60]  Georgios Kouroupetroglou.  Assistive Technologies and Computer Access for Motor Disabilities , 2013 .

[61]  Alan C. Evans,et al.  Neuroimaging in multiple sclerosis. , 1995, Neurologic clinics.

[62]  I.,et al.  Fitts' Law as a Research and Design Tool in Human-Computer Interaction , 1992, Hum. Comput. Interact..

[63]  V. Sanguineti,et al.  Robotic Assessment of Upper Limb Motor Function After Stroke , 2012, American journal of physical medicine & rehabilitation.

[64]  Alexandros Pino,et al.  Using Wiimote for 2D and 3D Pointing Tasks: Gesture Performance Evaluation , 2011, Gesture Workshop.

[65]  R. Kroll,et al.  The relationship between locus of control and long-term stuttering treatment outcome in adult stutterers , 1995 .

[66]  Rachael A. Burno.  Equating User Experience and Fitts’ Law in Gesture Based Input Modalities , 2015 .

[67]  H. Vankova.  Mini Mental State , 2010 .

[68]  Diego Torricelli,et al.  Quantitative assessment based on kinematic measures of functional impairments during upper extremity movements: A review. , 2014, Clinical biomechanics.

[69]  D. Frank Hsu,et al.  Rank-Score Characteristics (RSC) Function and Cognitive Diversity , 2010, Brain Informatics.

[70]  Roel Vertegaal,et al.  Evaluating effects of structural holds on pointing and dragging performance with flexible displays , 2011, CHI.

[71]  B. Wünsche,et al.  Assessment of movement quality in robot- assisted upper limb rehabilitation after stroke: a review , 2014, Journal of NeuroEngineering and Rehabilitation.

[72]  Jorge C. S. Cardoso,et al.  The Leap Motion movement for 2D pointing tasks: Characterisation and comparison to other devices , 2015, 2015 International Conference on Pervasive and Embedded Computing and Communication Systems (PECCS).

[73]  N. Filippini,et al.  Impaired Functional Connectivity Unmasked by Simple Repetitive Motor Task in Early Relapsing-Remitting Multiple Sclerosis , 2015, Neurorehabilitation and neural repair.