Psychomotor Impairment Detection via Finger Interactions with a Computer Keyboard During Natural Typing

Modern digital devices and appliances are capable of monitoring the timing of button presses, or finger interactions in general, with a sub-millisecond accuracy. However, the massive amount of high resolution temporal information that these devices could collect is currently being discarded. Multiple studies have shown that the act of pressing a button triggers well defined brain areas which are known to be affected by motor-compromised conditions. In this study, we demonstrate that the daily interaction with a computer keyboard can be employed as means to observe and potentially quantify psychomotor impairment. We induced a psychomotor impairment via a sleep inertia paradigm in 14 healthy subjects, which is detected by our classifier with an Area Under the ROC Curve (AUC) of 0.93/0.91. The detection relies on novel features derived from key-hold times acquired on standard computer keyboards during an uncontrolled typing task. These features correlate with the progression to psychomotor impairment (p < 0.001) regardless of the content and language of the text typed, and perform consistently with different keyboards. The ability to acquire longitudinal measurements of subtle motor changes from a digital device without altering its functionality may allow for early screening and follow-up of motor-compromised neurodegenerative conditions, psychological disorders or intoxication at a negligible cost in the general population.

[1]  D. Jindrich,et al.  Finger joint coordination during tapping. , 2006, Journal of biomechanics.

[2]  Mark C. Jones PRINCIPLES AND PRACTICE OF SLEEP MEDICINE , 1990 .

[3]  Noble Harter,et al.  Studies in the physiology and psychology of the telegraphic language , 1897 .

[4]  JoyceRick,et al.  Identity authentication based on keystroke latencies , 1990 .

[5]  D. Bruck,et al.  The effects of sleep inertia on decision‐making performance , 1999, Journal of sleep research.

[6]  Christine L. MacKenzie,et al.  Computer user verification using login string keystroke dynamics , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[7]  Mohammad S. Obaidat,et al.  An online neural network system for computer access security , 1993, IEEE Trans. Ind. Electron..

[8]  Alain Muzet,et al.  Sleep inertia. , 2000, Sleep medicine reviews.

[9]  F. Scheer,et al.  An Endogenous Circadian Rhythm in Sleep Inertia Results in Greatest Cognitive Impairment upon Awakening during the Biological Night , 2008, Journal of biological rhythms.

[10]  Lakhmi C. Jain,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2004, Lecture Notes in Computer Science.

[11]  Suzanne T. Witt,et al.  Functional neuroimaging correlates of finger-tapping task variations: An ALE meta-analysis , 2008, NeuroImage.

[12]  Devin L Jindrich,et al.  Effects of keyswitch design and finger posture on finger joint kinematics and dynamics during tapping on computer keyswitches. , 2004, Clinical biomechanics.

[13]  Fabian Monrose,et al.  Keystroke dynamics as a biometric for authentication , 2000, Future Gener. Comput. Syst..

[14]  J. Hagen,et al.  Circular stapled pyloroplasty: a fast and effective technique for pyloric disruption during esophagectomy with gastric pull-up. , 2011, Diseases of the esophagus : official journal of the International Society for Diseases of the Esophagus.

[15]  Lee Luan Ling,et al.  User authentication through typing biometrics features , 2005, IEEE Transactions on Signal Processing.

[16]  Charles A Czeisler,et al.  Effects of sleep inertia on cognition. , 2006, JAMA.

[17]  Gopal K. Gupta,et al.  Identity authentication based on keystroke latencies , 1990, Commun. ACM.

[18]  Christophe Rosenberger,et al.  Keystroke dynamics with low constraints SVM based passphrase enrollment , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[19]  Georgios C. Anagnostopoulos,et al.  Knowledge-Based Intelligent Information and Engineering Systems , 2003, Lecture Notes in Computer Science.

[20]  Mohammad S. Obaidat,et al.  Dimensionality reduction and feature extraction applications in identifying computer users , 1991, IEEE Trans. Syst. Man Cybern..

[21]  Drew Dawson,et al.  Managing fatigue: it's about sleep. , 2005, Sleep medicine reviews.

[22]  M.J.E. Salami,et al.  Dynamic keystroke analysis using AR model , 2004, 2004 IEEE International Conference on Industrial Technology, 2004. IEEE ICIT '04..

[23]  David F. Dinges,et al.  Are you awake? Cognitive performance and reverie during the hypnopompic state. , 1990 .

[24]  Mary A. Carskadon,et al.  Chapter 2 – Normal Human Sleep: An Overview , 2017 .

[25]  Jugurta R. Montalvão Filho,et al.  On the equalization of keystroke timing histograms , 2006, Pattern Recognit. Lett..

[26]  Nasir Ahmad,et al.  Keystroke dynamics in the pre-touchscreen era , 2013, Front. Hum. Neurosci..

[27]  B. Hussien,et al.  Computer-Access Security Systems Using Keystroke Dynamics , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  A. F. Adams,et al.  The Survey , 2021, Dyslexia in Higher Education.

[29]  Ren G Dong,et al.  Analysis of musculoskeletal loading in an index finger during tapping. , 2008, Journal of biomechanics.

[30]  Sungzoon Cho,et al.  Keystroke dynamics identity verification - its problems and practical solutions , 2004, Comput. Secur..

[31]  Peter Herscovitch,et al.  The process of awakening: a PET study of regional brain activity patterns mediating the re-establishment of alertness and consciousness. , 2002, Brain : a journal of neurology.

[32]  M. Carskadon,et al.  Neurobehavioral performance of residents after heavy night call vs after alcohol ingestion. , 2005, JAMA.

[33]  Philipp Berens,et al.  CircStat: AMATLABToolbox for Circular Statistics , 2009, Journal of Statistical Software.

[34]  Damon L. Woodard,et al.  Biometric Authentication and Identification using Keystroke Dynamics: A Survey , 2012 .

[35]  A. Muzet,et al.  Sleep inertia. , 2000, Sleep medicine reviews.

[36]  C D Mote,et al.  A method of measuring fingertip loading during keyboard use. , 1994, Journal of biomechanics.

[37]  Weide Chang,et al.  Improving hidden Markov models with a similarity histogram for typing pattern biometrics , 2005, IRI -2005 IEEE International Conference on Information Reuse and Integration, Conf, 2005..

[38]  Christopher Drake,et al.  Ethanol and sleep loss: a "dose" comparison of impairing effects. , 2003, Sleep.

[39]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.