The Index of Cognitive Activity as a Measure of Linguistic Processing

This paper reports experimental results on the Index of Cognitive Activity (ICA), a recent micro-level measure in pupillometry which relates processing load to the frequency of rapid small variations in pupil diameter. We collected pupil size data during three language processing tasks (German subject vs. object relative clauses, a grammatical gender violation, and semantic anomalies). We report the first results on the Index of Cognitive Activity for language processing and show that the ICA is responsive to all of our manipulations. We also compare the ICA results to overall pupil dilations and self-paced reading as a measure of processing difficulty. Overall, the use of the ICA as opposed to traditional pupillometry seems promising, as our data provide initial evidence that the ICA may be a faster and more fine-grained measure of cognitive load than overall pupil dilation.

[1]  Elena G. Patsenko,et al.  The Quarterly Journal of Experimental Psychology Pupillometry Reveals Processing Load during Spoken Language Comprehension , 2022 .

[2]  Sandra P Marshall,et al.  Identifying cognitive state from eye metrics. , 2007, Aviation, space, and environmental medicine.

[3]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[4]  A. Friederici,et al.  Event-related brain potentials during natural speech processing: effects of semantic, morphological and syntactic violations. , 1993, Brain research. Cognitive brain research.

[5]  R. Baayen,et al.  Mixed-effects modeling with crossed random effects for subjects and items , 2008 .

[6]  Michael Schluroff.  Pupil responses to grammatical complexity of sentences , 1982, Brain and Language.

[7]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[8]  Markus Bader,et al.  Subject-Object Ambiguities in German Embedded Clauses: An Across-the-Board Comparison , 1999 .

[9]  S. P. Marshall,et al.  The Index of Cognitive Activity: measuring cognitive workload , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[10]  J Hyönä,et al.  Pupil Dilation as a Measure of Processing Load in Simultaneous Interpretation and Other Language Tasks , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[11]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[12]  Karel Brookhuis,et al.  Human Factors for Assistance and Automation , 2008 .

[13]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[14]  Vera Demberg,et al.  Language and cognitive load in a dual task environment , 2013, CogSci.

[15]  J. Beatty,et al.  The pupillary system. , 2000 .

[16]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[17]  P Hagoort,et al.  Gender Electrified: ERP Evidence on the Syntactic Nature of Gender Processing , 1999, Journal of psycholinguistic research.