Identifying emotional states using keystroke dynamics

The ability to recognize emotions is an important part of building intelligent computers. Emotionally-aware systems would have a rich context from which to make appropriate decisions about how to interact with the user or adapt their system response. There are two main problems with current system approaches for identifying emotions that limit their applicability: they can be invasive and can require costly equipment. Our solution is to determine user emotion by analyzing the rhythm of their typing patterns on a standard keyboard. We conducted a field study where we collected participants' keystrokes and their emotional states via self-reports. From this data, we extracted keystroke features, and created classifiers for 15 emotional states. Our top results include 2-level classifiers for confidence, hesitance, nervousness, relaxation, sadness, and tiredness with accuracies ranging from 77 to 88%. In addition, we show promise for anger and excitement, with accuracies of 84%.

[1]  Robert C. Holte,et al.  C4.5, Class Imbalance, and Cost Sensitivity: Why Under-Sampling beats Over-Sampling , 2003 .

[2]  Andrew Sears,et al.  Automated stress detection using keystroke and linguistic features: An exploratory study , 2009, Int. J. Hum. Comput. Stud..

[3]  Gopal K. Gupta,et al.  Identity authentication based on keystroke latencies , 1990, Commun. ACM.

[4]  Giancarlo Ruffo,et al.  Keystroke Analysis of Different Languages: A Case Study , 2005, IDA.

[5]  Ian Witten,et al.  Data Mining , 2000 .

[6]  John J. B. Allen,et al.  The handbook of emotion elicitation and assessment , 2007 .

[7]  Clayton Charles Epp,et al.  Identifying emotional states through keystroke dynamics , 2010 .

[8]  Roel Vertegaal,et al.  Using mental load for managing interruptions in physiologically attentive user interfaces , 2004, CHI EA '04.

[9]  Yong Sheng,et al.  A parallel decision tree-based method for user authentication based on keystroke patterns , 2005, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[10]  Veikko Surakka,et al.  Real-time estimation of emotional experiences from facial expressions , 2006, Interact. Comput..

[11]  Masood Mehmood Khan,et al.  Automated Facial Expression Classification and affect interpretation using infrared measurement of facial skin temperature variations , 2006, TAAS.

[12]  Claudia Picardi,et al.  Keystroke analysis of free text , 2005, TSEC.

[13]  Marcus Brown,et al.  User Identification via Keystroke Characteristics of Typed Names using Neural Networks , 1993, Int. J. Man Mach. Stud..

[14]  L.C. De Silva,et al.  Real-time facial feature extraction and emotion recognition , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[15]  Regan L. Mandryk,et al.  A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies , 2007, Int. J. Hum. Comput. Stud..

[16]  Claudia Picardi,et al.  Identity verification through dynamic keystroke analysis , 2003, Intell. Data Anal..

[17]  K. Quigley,et al.  Applications of Psychophysiological Recording , 2000 .

[18]  P. Lang.  Behavioral treatment and bio-behavioral assessment: computer applications , 1980 .

[19]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[20]  L. Carroll,et al.  Alice's Adventures in Wonderland: Princeton University Press , 2015 .

[21]  Fabian Monrose,et al.  Keystroke dynamics as a biometric for authentication , 2000, Future Gener. Comput. Syst..

[22]  Claudia Picardi,et al.  User authentication through keystroke dynamics , 2002, TSEC.

[23]  Norman Shapiro,et al.  Authentication by Keystroke Timing: Some Preliminary Results , 1980 .

[24]  Robert D. Ward,et al.  Physiological responses to different WEB page designs , 2003, Int. J. Hum. Comput. Stud..

[25]  Steven Furnell,et al.  A Long-term Trial of Keystroke Profiling using Digraph, Trigraph and Keyword Latencies , 2004, SEC.

[26]  T. A. Williams,et al.  Technology in mental health care delivery systems , 1980 .

[27]  Rochelle Young,et al.  Adventures in wonderland , 2001, Nature Biotechnology.

[28]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[29]  P. Zimmermann,et al.  Affective Computing—A Rationale for Measuring Mood With Mouse and Keyboard , 2003, International journal of occupational safety and ergonomics : JOSE.

[30]  M. Csíkszentmihályi,et al.  Experience Sampling Method: Measuring the Quality of Everyday Life , 2006 .

[31]  Anil K. Jain,et al.  Statistical Pattern Recognition: A Review , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  J. Russell.  Core affect and the psychological construction of emotion. , 2003, Psychological review.

[33]  M. Angela Sasse,et al.  Do Users Always Know What's Good For Them? Utilising Physiological Responses to Assess Media Quality , 2000, BCS HCI.