Exploring workload and attention measurements with uLog mouse data

User-system interactions (e.g., mouse clicks and movements) can be logged with the uLog computer program. A Web-based study with 20 participants was conducted to investigate the feasibility of using uLog data as an indicator of workload and attention. Eye fixation, heart rate variability (HRV), and skin conductance were used to unveil users’ workload and attention and, hence, to validate uLog data as indicators of these. Results on one of the Tasks did indeed show correlations between uLog data and HRV. This is a promising first step toward the validation of uLog mouse data as indicators of workload and attention.

[1]  T. Robbins,et al.  Contrasts between the cardiovascular concomitants of tests of planning and attention. , 1999, Psychophysiology.

[2]  Erik Wilde,et al.  Extensible Markup Language (XML) , 1999 .

[3]  D I Boomsma,et al.  Does the heart know what the eye sees? A cardiac/pupillometric analysis of motor preparation and response execution. , 1989, Psychophysiology.

[4]  Joseph H. Goldberg,et al.  Eye tracking in web search tasks: design implications , 2002, ETRA.

[5]  F. Thomas Eggemeier,et al.  Workload assessment methodology. , 1986 .

[6]  Maarten van Someren,et al.  The Think Aloud Method: A Practical Guide to Modelling Cognitive Processes , 1994 .

[7]  John L. Sibert,et al.  Heart rate variability: indicator of user state as an aid to human-computer interaction , 1998, CHI.

[8]  W. Verwey,et al.  Detecting short periods of elevated workload: A comparison of nine workload assessment techniques , 1996 .

[9]  L. Cooke,et al.  Using eye tracking to address limitations in think-aloud protocol , 2005, IPCC 2005. Proceedings. International Professional Communication Conference, 2005..

[10]  Andy Cockburn,et al.  AppMonitor: A tool for recording user actions in unmodified Windows applications , 2008, Behavior research methods.

[11]  Aline Chevalier,et al.  The use of Tholos software for combining measures of mental workload: Toward theoretical and methodological improvements , 2008, Behavior research methods.

[12]  H. Nagaraja,et al.  Heart rate variability: origins, methods, and interpretive caveats. , 1997, Psychophysiology.

[13]  Egon L. van den Broek,et al.  Prerequisites for Affective Signal Processing (ASP) , 2009, BIOSIGNALS.

[14]  Andrew T. Duchowski,et al.  Eye tracking methodology - theory and practice, 2nd Edition , 2007 .

[15]  Jakob Nielsen,et al.  Usability engineering , 1997, The Computer Science and Engineering Handbook.

[16]  Alexandre N. Tuch,et al.  Visual complexity of websites: Effects on users' experience, physiology, performance, and memory , 2009, Int. J. Hum. Comput. Stud..

[17]  R. Proctor,et al.  Attention: Theory and Practice , 2003 .

[18]  Stephen H. Fairclough,et al.  Fundamentals of physiological computing , 2009, Interact. Comput..

[19]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[20]  N. Smelser,et al.  International Encyclopedia of the Social and Behavioral Sciences , 2001 .

[21]  Ryan Johnson,et al.  International Encyclopedia of the Social & Behavioral Sciences , 2022 .

[22]  Stergios B. Fotopoulos,et al.  Introduction to Modern Nonparametric Statistics , 2004, Technometrics.

[23]  David Graham Wastell,et al.  Stress, control and computer system design: A psychophysiological field study , 1996, Behav. Inf. Technol..

[24]  G. Breithardt,et al.  Heart rate variability: standards of measurement, physiological interpretation and clinical use. Task Force of the European Society of Cardiology and the North American Society of Pacing and Electrophysiology. , 1996 .

[25]  L. Cooke,et al.  Is the Mouse a “ Poor Man ’ s Eye Tracker ” ? , 2006 .

[26]  Lucas P J J Noldus,et al.  The Observer XT: A tool for the integration and synchronization of multimodal signals , 2009, Behavior research methods.

[27]  Urmila Kukreja,et al.  RUI: Recording user input from interfaces under Windows and Mac OS X , 2006, Behavior research methods.

[28]  J. Thayer,et al.  Vagal influence on working memory and attention. , 2003, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  Andrew T Duchowski,et al.  A breadth-first survey of eye-tracking applications , 2002, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[30]  G. Vossel,et al.  Finally, After Two Decades , 2001 .

[31]  M. Chun,et al.  Contextual cueing of visual attention , 2022 .

[32]  Monique W. M. Jaspers,et al.  The think aloud method: a guide to user interface design , 2004, Int. J. Medical Informatics.

[33]  C. Alder,et al.  Investigating the human-computer interface using the Datalogger , 1996 .

[34]  H. Critchley,et al.  Neural Activity Relating to Generation and Representation of Galvanic Skin Conductance Responses: A Functional Magnetic Resonance Imaging Study , 2000, The Journal of Neuroscience.

[35]  J. Lagopoulos.  Electrodermal activity , 2007, Acta Neuropsychiatrica.

[36]  Shari Trewin.  InputLogger: General-purpose logging of keyboard and mouse events on an Apple Macintosh , 1998 .

[37]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[38]  L. Kaufman,et al.  Handbook of perception and human performance , 1986 .

[39]  Daniel Gopher,et al.  Workload: An examination of the concept. , 1986 .