Optimizing the usage of pupillary based indicators for cognitive workload

The Index of Cognitive Activity (ICA) and its open-source alternative, the Index of Pupillary Activity (IPA), are pupillary-based indicators for cognitive workload and are independent of light changes. Both indicators were investigated regarding influences of cognitive demand, fatigue and inter-individual differences. In addition, the variability of pupil changes between both eyes (difference values) were compared with the usually calculated pupillary changes averaged over both eyes (mean values). Fifty-five participants performed a spatial thinking test, the R-Cube-Vis Test, with six distinct difficulty levels and a simple fixation task before and after the R-Cube-Vis Test. The distributions of the ICA and IPA were comparable. The ICA/IPA values were lower during the simple fixation tasks than during the cognitively demanding R-Cube-Vis Test. A fatigue effect was found only for the mean ICA values. The effects of both indicators were larger between difficulty levels of the test when inter-individual differences were controlled using z-standardization. The difference values seemed to control for fatigue and appeared to differentiate better between more demanding cognitive tasks than the mean values. The derived recommendations for the ICA/IPA values are beneficial to gain more insights in individual performance and behavior during, e.g., training and testing scenarios.

[1]  Aaron O'Leary,et al.  PyWavelets: A Python package for wavelet analysis , 2019, J. Open Source Softw..

[2]  N. Werner,et al.  Relationships between features of autonomic cardiovascular control and cognitive performance , 2009, Biological Psychology.

[3]  Wes McKinney,et al.  pandas: a Foundational Python Library for Data Analysis and Statistics , 2011 .

[4]  Jeffrey N. Rouder,et al.  Bayesian t tests for accepting and rejecting the null hypothesis , 2009, Psychonomic bulletin & review.

[5]  Caroline Di Bernardi Luft,et al.  Heart rate variability and cognitive function: Effects of physical effort , 2009, Biological Psychology.

[6]  Canan Karatekin,et al.  Attention allocation in the dual-task paradigm as measured through behavioral and psychophysiological responses. , 2004, Psychophysiology.

[7]  Michael J Schwartz,et al.  Eye Metrics as an Objective Assessment of Surgical Skill , 2010, Annals of surgery.

[8]  D. Kahneman,et al.  Attention and Effort , 1973 .

[9]  Krzysztof Krejtz,et al.  Eye tracking cognitive load using pupil diameter and microsaccades with fixed gaze , 2018, PloS one.

[10]  Gaël Varoquaux,et al.  The NumPy Array: A Structure for Efficient Numerical Computation , 2011, Computing in Science & Engineering.

[11]  A. Zekveld,et al.  Cognitive processing load across a wide range of listening conditions: insights from pupillometry. , 2014, Psychophysiology.

[12]  J. Beatty,et al.  The pupillary system. , 2000 .

[13]  Isabell Wartenburger,et al.  Resource allocation and fluid intelligence: insights from pupillometry. , 2010, Psychophysiology.

[14]  Andrew L. Kun,et al.  Estimating cognitive load using remote eye tracking in a driving simulator , 2010, ETRA.

[15]  Ravi D. Mill,et al.  Pupil dilation during recognition memory: Isolating unexpected recognition from judgment uncertainty , 2016, Cognition.

[16]  Benedict C. O. F. Fehringer.  One threshold to rule them all? Modification of the Index of Pupillary Activity to optimize the indication of cognitive load , 2020, ETRA Short Papers.

[17]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[18]  Michael P. Rogers.  Python Tutorial , 2009 .

[19]  Felix D. Schönbrodt,et al.  Sequential Hypothesis Testing With Bayes Factors: Efficiently Testing Mean Differences , 2017, Psychological methods.

[20]  B. Fehringer.  Spatial thinking from a different view: Disentangling top-down and bottom-up processes using eye tracking , 2020 .

[21]  A. Bakker,et al.  A multifaceted investigation of the link between mental fatigue and task disengagement. , 2015, Psychophysiology.

[22]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[23]  Vera Demberg,et al.  Pupillometry: the Index of Cognitive Activity in a dual-task study , 2013, CogSci.

[24]  Joseph J. Tecce.  Psychophysiology: human behavior and physiological response (4th ed.) , 2001 .

[25]  Andrew T. Duchowski,et al.  The Low/High Index of Pupillary Activity , 2020, CHI.

[26]  Sandra P. Marshall,et al.  Integrating psychophysiological measures of cognitive workload and eye movements to detect strategy shifts , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[27]  S. P. Marshall,et al.  The Index of Cognitive Activity: measuring cognitive workload , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[28]  S. Steinhauer,et al.  Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[29]  Sidney J Segalowitz,et al.  Autonomic predictors of Stroop performance in young and middle-aged adults. , 2010, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[30]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[31]  M. Just,et al.  Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work , 2003 .