Real-world keystroke dynamics are a potentially valid biomarker for clinical disability in multiple sclerosis

BACKGROUND Clinical measures in multiple sclerosis (MS) face limitations that may be overcome by utilising smartphone keyboard interactions acquired continuously and remotely during regular typing. OBJECTIVE The aim of this study was to determine the reliability and validity of keystroke dynamics to assess clinical aspects of MS. METHODS In total, 102 MS patients and 24 controls were included in this observational study. Keyboard interactions were obtained with the Neurokeys keyboard app. Eight timing-related keystroke features were assessed for reliability with intraclass correlation coefficients (ICCs); construct validity by analysing group differences (in fatigue, gadolinium-enhancing lesions on magnetic resonance imaging (MRI), and patients vs controls); and concurrent validity by correlating with disability measures. RESULTS Reliability was moderate in two (ICC = 0.601 and 0.742) and good to excellent in the remaining six features (ICC = 0.760-0.965). Patients had significantly higher keystroke latencies than controls. Latency between key presses correlated the highest with Expanded Disability Status Scale (r = 0.407) and latency between key releases with Nine-Hole Peg Test and Symbol Digit Modalities Test (ρ = 0.503 and r = -0.553, respectively), ps < 0.001. CONCLUSION Keystroke dynamics were reliable, distinguished patients and controls, and were associated with clinical disability measures. Consequently, keystroke dynamics are a promising valid surrogate marker for clinical disability in MS.

[1]  Illhoi Yoo,et al.  A Systematic Review of Healthcare Applications for Smartphones , 2012, BMC Medical Informatics and Decision Making.

[2]  G. Bleijenberg,et al.  The assessment of fatigue: Psychometric qualities and norms for the Checklist individual strength. , 2017, Journal of psychosomatic research.

[3]  Albert Costa,et al.  When does word frequency influence written production? , 2013, Front. Psychol..

[4]  Joseph E. Schwartz,et al.  Variability of Momentary Pain Predicts Recall of Weekly Pain: A Consequence of the Peak (or Salience) Memory Heuristic , 2005, Personality & social psychology bulletin.

[5]  D. Altman,et al.  STATISTICAL METHODS FOR ASSESSING AGREEMENT BETWEEN TWO METHODS OF CLINICAL MEASUREMENT , 1986, The Lancet.

[6]  Caroline B. Terwee,et al.  Measurement in Medicine: Index , 2011 .

[7]  Lynn D. Hudson,et al.  Validity of the Symbol Digit Modalities Test as a cognition performance outcome measure for multiple sclerosis , 2017, Multiple sclerosis.

[8]  Dimitrios Iakovakis,et al.  Touchscreen typing-pattern analysis for detecting fine motor skills decline in early-stage Parkinson’s disease , 2018, Scientific reports.

[9]  L. von Koch,et al.  Cognitive and motor function in people with multiple sclerosis in Stockholm County , 2006, Multiple sclerosis.

[10]  Frederik Barkhof,et al.  Assessing treatment outcomes in multiple sclerosis trials and in the clinical setting , 2018, Nature Reviews Neurology.

[11]  Ilse Lamers,et al.  The Nine-Hole Peg Test as a manual dexterity performance measure for multiple sclerosis , 2017, Multiple sclerosis.

[12]  M. Kehoe,et al.  A questionnaire study to explore the views of people with multiple sclerosis of using smartphone technology for health care purposes , 2018, Disability and rehabilitation.

[13]  N. Larocca,et al.  The fatigue severity scale. Application to patients with multiple sclerosis and systemic lupus erythematosus. , 1989, Archives of neurology.

[14]  Mohammad S. Obaidat,et al.  Verification of computer users using keystroke dynamics , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[15]  Tapas Mondal,et al.  Wearable Sensors for Remote Health Monitoring , 2017, Sensors.

[16]  Ana Londral,et al.  Markers for upper limb dysfunction in Amyotrophic Lateral Sclerosis using analysis of typing activity , 2016, Clinical Neurophysiology.

[17]  K. Roach,et al.  Measurement of Health Outcomes: Reliability, Validity and Responsiveness , 2006 .

[18]  Joseph P. Romano,et al.  Efficient Computation of Adjusted P-Values for Resampling-Based Stepdown Multiple Testing , 2016 .

[19]  G. Bleijenberg,et al.  The measurement of fatigue in patients with multiple sclerosis. A multidimensional comparison with patients with chronic fatigue syndrome and healthy subjects. , 1996, Archives of neurology.

[20]  G. Brichetto We should monitor our patients with wearable technology instead of neurological examination – Commentary , 2020, Multiple sclerosis.

[21]  Vir V. Phoha,et al.  Utilizing linguistically enhanced keystroke dynamics to predict typist cognition and demographics , 2015, Int. J. Hum. Comput. Stud..

[22]  Brett W Fling,et al.  Relationship between perceived fatigue and performance fatigability in people with multiple sclerosis: A systematic review and meta-analysis. , 2017, Journal of psychosomatic research.

[23]  D. Kahneman,et al.  When More Pain Is Preferred to Less: Adding a Better End , 1993 .

[24]  B. Uitdehaag Disability Outcome Measures in Phase III Clinical Trials in Multiple Sclerosis , 2018, CNS Drugs.

[25]  Margaret E. Morris,et al.  Embedded Assessment: Overcoming Barriers to Early Detection with Pervasive Computing , 2005, Pervasive.

[26]  R. Motl,et al.  Upper and Lower Extremity Motor Function and Cognitive Impairment in Multiple Sclerosis , 2011, Journal of the International Neuropsychological Society.

[27]  Pierre Grammond,et al.  Silent lesions on MRI imaging – Shifting goal posts for treatment decisions in multiple sclerosis , 2018, Multiple sclerosis.

[28]  P. Dagum Digital biomarkers of cognitive function , 2018, npj Digital Medicine.

[29]  David H. Miller,et al.  Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria , 2017, The Lancet Neurology.

[30]  J. Kurtzke Rating neurologic impairment in multiple sclerosis , 1983, Neurology.

[31]  J. Fisk,et al.  The Impact of Fatigue on Patients with Multiple Sclerosis , 1994, Canadian Journal of Neurological Sciences / Journal Canadien des Sciences Neurologiques.

[32]  Terry K Koo,et al.  A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. , 2016, Journal Chiropractic Medicine.

[33]  G. Kwakkel,et al.  Real-Time Assessment of Fatigue in Patients With Multiple Sclerosis: How Does It Relate to Commonly Used Self-Report Fatigue Questionnaires? , 2016, Archives of physical medicine and rehabilitation.