Automated stress detection using keystroke and linguistic features: An exploratory study

Monitoring of cognitive and physical function is central to the care of people with or at risk for various health conditions, but existing solutions rely on intrusive methods that are inadequate for continuous tracking. Less intrusive techniques that facilitate more accurate and frequent monitoring of the status of cognitive or physical function become increasingly desirable as the population ages and lifespan increases. Since the number of seniors using computers continues to grow dramatically, a method that exploits normal daily computer interactions is attractive. This research explores the possibility of detecting cognitive and physical stress by monitoring keyboard interactions with the eventual goal of detecting acute or gradual changes in cognitive and physical function. Researchers have already attributed a certain amount of variability and ''drift'' in an individual's typing pattern to situational factors as well as stress, but this phenomenon has not been explored adequately. In an attempt to detect changes in typing associated with stress, this research analyzes keystroke and linguistic features of spontaneously generated text. Results show that it is possible to classify cognitive and physical stress conditions relative to non-stress conditions based on keystroke and linguistic features with accuracy rates comparable to those currently obtained using affective computing methods. The proposed approach is attractive because it requires no additional hardware, is unobtrusive, is adaptable to individual users, and is of very low cost. This research demonstrates the potential of exploiting continuous monitoring of keyboard interactions to support the early detection of changes in cognitive and physical function.

[2]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[3]  M. Pavel,et al.  Unobtrusive Computer Monitoring of Sensory-Motor Function , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[4]  Ian H. Witten,et al.  Data mining - practical machine learning tools and techniques, Second Edition , 2005, The Morgan Kaufmann series in data management systems.

[5]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[6]  Ethem Alpaydin,et al.  Introduction to Machine Learning (Adaptive Computation and Machine Learning) , 2004 .

[7]  George Mandler Thought, memory, and learning: Effects of emotional stress. , 1993 .

[8]  Fabian Monrose,et al.  Keystroke dynamics as a biometric for authentication , 2000, Future Gener. Comput. Syst..

[9]  Margaret E. Morris,et al.  Embedded Assessment: Overcoming Barriers to Early Detection with Pervasive Computing , 2005, Pervasive.

[10]  Maria Papadaki,et al.  Keystroke Analysis as a Method of Advanced User Authentication and Response , 2002, SEC.

[11]  Claudia Picardi,et al.  Keystroke analysis of free text , 2005, TSEC.

[12]  Sung-Hyuk Cha,et al.  Keystroke Biometric Recognition Studies on Long-Text Input under Ideal and Application-Oriented Conditions , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[13]  L. Zhou An empirical investigation of deception behavior in instant messaging , 2005, IEEE Transactions on Professional Communication.

[14]  Fabian Monrose,et al.  Authentication via keystroke dynamics , 1997, CCS '97.

[15]  Jianchu Yao,et al.  A wearable point-of-care system for home use that incorporates plug-and-play and wireless standards , 2005, IEEE Transactions on Information Technology in Biomedicine.

[16]  C B Hall,et al.  A change point model for estimating the onset of cognitive decline in preclinical Alzheimer's disease. , 2000, Statistics in medicine.

[17]  Carla E. Brodley,et al.  User re-authentication via mouse movements , 2004, VizSEC/DMSEC '04.

[18]  J. Dimsdale,et al.  Plasma catecholamines in stress and exercise. , 1980, JAMA.

[19]  A. Murata,et al.  Assessment of mental fatigue during VDT task using event-related potential (P300) , 2000, Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No.00TH8499).

[20]  D. Ayman,et al.  BLOOD PRESSURE DETERMINATIONS BY PATIENTS WITH ESSENTIAL HYPERTENSION: I. The Difference Between Clinic and Home Readings Before Treatment , 1940 .

[21]  R. Kessler,et al.  Measuring stress: A guide for health and social scientists. , 1995 .

[22]  B. G. Rule,et al.  Adult age differences in working memory. , 1989, Psychology and aging.

[23]  R. Suganya,et al.  Data Mining Concepts and Techniques , 2010 .

[24]  Ehud Sharlin,et al.  Cognitive cubes: a tangible user interface for cognitive assessment , 2002, CHI.

[25]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[26]  R. Yerkes,et al.  The relation of strength of stimulus to rapidity of habit‐formation , 1908 .

[27]  Bor-Shing Lin,et al.  RTWPMS: A Real-Time Wireless Physiological Monitoring System , 2006, IEEE Transactions on Information Technology in Biomedicine.

[28]  Gopal K. Gupta,et al.  Identity authentication based on keystroke latencies , 1990, Commun. ACM.

[29]  A. Mehrabian,et al.  Non-immediacy between communicator and object of communication in a verbal message: application to the inference of attitudes. , 1966, Journal of consulting psychology.

[30]  Elaine B. Hyder,et al.  The ELDer project: social, emotional, and environmental factors in the design of eldercare technologies , 2000, CUU '00.

[31]  Dongsong Zhang,et al.  A Comparison of Deception Behavior in Dyad and Triadic Group Decision Making in Synchronous , 2006 .

[32]  H. Jimison,et al.  Monitoring Computer Interactions to Detect Early Cognitive Impairment in Elders , 2006, 1st Transdisciplinary Conference on Distributed Diagnosis and Home Healthcare, 2006. D2H2..

[33]  Emmanuel Munguia Tapia,et al.  Lessons learned using ubiquitous sensors for data collection in real homes , 2004, CHI EA '04.

[34]  Susannah Fox,et al.  Generations online in 2009 , 2009 .

[35]  Yuan Qi,et al.  The Bayes Point Machine for computer-user frustration detection via pressuremouse , 2001, PUI '01.

[36]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[37]  Lee Luan Ling,et al.  User authentication through typing biometrics features , 2005 .

[38]  Fang Chen,et al.  Automatic cognitive load detection from speech features , 2007, OZCHI '07.

[39]  Dimitris N. Metaxas,et al.  Monitoring of facial stress during space flight: Optical computer recognition combining discriminative and generative methods , 2007 .

[40]  J. Nunamaker,et al.  Automating Linguistics-Based Cues for Detecting Deception in Text-Based Asynchronous Computer-Mediated Communications , 2004 .

[41]  Hirofumi Tanaka,et al.  Age-predicted maximal heart rate revisited. , 2001, Journal of the American College of Cardiology.

[42]  T. Pincus,et al.  Reliability of grip strength, walking time and button test performed according to a standard protocol. , 1991, The Journal of rheumatology.

[43]  J. Burgoon,et al.  Interpersonal Deception Theory , 1996 .

[44]  Andrew Sears,et al.  Physical disabilities and computing technologies: an analysis of impairments , 2002 .

[45]  Andrew Sears,et al.  The Development and Evaluation of Performance-Based Functional Assessment: A Methodology for the Measurement of Physical Capabilities , 2009, TACC.

[46]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[47]  Hinrich Schütze,et al.  Introduction to information retrieval , 2008 .

[48]  A. Murata,et al.  Evaluation of mental fatigue in human-computer interaction-analysis using feature parameters extracted from event-related potential , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[49]  Jennifer Healey,et al.  SmartCar: detecting driver stress , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[50]  Abdulmotaleb El-Saddik,et al.  Haptic: the new biometrics-embedded media to recognizing and quantifying human patterns , 2005, MULTIMEDIA '05.

[51]  Kathryn M. McMillan,et al.  N‐back working memory paradigm: A meta‐analysis of normative functional neuroimaging studies , 2005, Human brain mapping.

[52]  Peter Gregor,et al.  Introduction to the Special Issue on Aging and Information Technology , 2009, TACC.

[53]  Roy S. Kalawsky,et al.  Sensor Networks for Continuous Health Monitoring , 2004 .

[54]  Misha Pavel,et al.  Unobtrusive monitoring of computer interactions to detect cognitive status in elders , 2004, IEEE Transactions on Information Technology in Biomedicine.

[55]  D M MacKenzie,et al.  Brief cognitive screening of the elderly: a comparison of the Mini-Mental State Examination (MMSE), Abbreviated Mental Test (AMT) and Mental Status Questionnaire (MSQ) , 1996, Psychological Medicine.

[56]  S. T. Buckland,et al.  An Introduction to the Bootstrap. , 1994 .