Mouse Tracking Measures and Movement Patterns with Application for Online Surveys

There is growing interest in the field of human-computer interaction in the use of mouse movement data to infer e.g. user’s interests, preferences and personality. Previous work has defined various patterns of mouse movement behavior. However, there is a paucity of mouse tracking measures and defined movement patterns for use in the specific context of data collection with online surveys. The present study aimed to define and visualize patterns of mouse movements while the user provided responses in a survey (with questions to be answered using a 5-point Likert response scale). The study produced a wide range of different patterns, including new patterns, and showed that these can easily be distinguished. The identified patterns may - in conjunction with machine learning algorithms - be used for further investigation toward e.g. the recognition of the user’s state of mind or for user studies.

[1]  Joseph S. Valacich,et al.  How Is Your User Feeling? Inferring Emotion Through Human-Computer interaction Devices , 2017, MIS Q..

[2]  Tzafilkou Katerina,et al.  Mouse behavioral patterns and keystroke dynamics in End-User Development: What can they tell us about users’ behavioral attributes? , 2018, Computers in Human Behavior.

[3]  Andreas Holzinger,et al.  Human-Computer Interaction and Knowledge Discovery (HCI-KDD): What Is the Benefit of Bringing Those Two Fields to Work Together? , 2013, CD-ARES.

[4]  K. Glaister,et al.  Breaking the frame: an analysis of strategic cognition and decision making under uncertainty , 1999 .

[5]  Hamid Jahankhani,et al.  A Survey of User Authentication Based on Mouse Dynamics , 2008 .

[6]  Gary M Olson,et al.  Human-computer interaction: psychological aspects of the human use of computing. , 2003, Annual review of psychology.

[7]  Robert M. Hierons,et al.  Measuring personality from keyboard and mouse use , 2008, ECCE '08.

[8]  Ecnica De Lisboa,et al.  MULTI-MODAL BEHAVIORAL BIOMETRICS BASED ON HCI AND ELECTROPHYSIOLOGY , 2008 .

[9]  A. Damasio.  Descartes’ Error. Emotion, Reason and the Human Brain. New York (Grosset/Putnam) 1994. , 1994 .

[10]  José Neves,et al.  Monitoring Mental Fatigue through the Analysis of Keyboard and Mouse Interaction Patterns , 2013, HAIS.

[11]  Eric J. Johnson,et al.  Adaptive Strategy Selection in Decision Making. , 1988 .

[12]  Ryen W. White,et al.  No clicks, no problem: using cursor movements to understand and improve search , 2011, CHI.

[13]  Luis A. Leiva,et al.  Predicting User Engagement with Direct Displays Using Mouse Cursor Information , 2016, SIGIR.

[14]  P. Zimmermann,et al.  Affective Computing—A Rationale for Measuring Mood With Mouse and Keyboard , 2003, International journal of occupational safety and ergonomics : JOSE.

[15]  Bengisu Tulu,et al.  Can a Reasonable Time Limit Improve the Effective Usage of a Computerized Decision Aid? , 2008, Commun. Assoc. Inf. Syst..

[16]  K. Rayner.  Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[17]  Albrecht Schmidt,et al.  Knowing the User's Every Move – User Activity Tracking for Website Usability Evaluation and Implicit Interaction , 2006 .

[18]  Adriana M. Seelye,et al.  Computer mouse movement patterns: A potential marker of mild cognitive impairment , 2015, Alzheimer's & dementia.

[19]  Takashi Yamauchi,et al.  Reading Emotion From Mouse Cursor Motions: Affective Computing Approach , 2018, Cogn. Sci..

[20]  Ernesto Arroyo,et al.  Usability tool for analysis of web designs using mouse tracks , 2006, CHI Extended Abstracts.

[21]  Kym Elizabeth Pocius.  Personality factors in human-computer interaction: A review of the literature , 1991 .

[22]  Andrew Dillon,et al.  User analysis in HCI - the historical lessons from individual differences research , 1996, Int. J. Hum. Comput. Stud..