Effects of visual and verbal presentation on cognitive load in vigilance, memory, and arithmetic tasks.

Degree of pupil dilation has been shown to be a valid and reliable measure of cognitive load, but the effect of aural versus visual task presentation on pupil dilation is unknown. To evaluate effects of presentation mode, pupil dilation was measured in three tasks spanning a range of cognitive activities: mental multiplication, digit sequence recall, and vigilance. Stimuli were presented both aurally and visually, controlling for all known visual influences on pupil diameter. The patterns of dilation were similar for both aural and visual presentation for all three tasks, but the magnitudes of pupil response were greater for aural presentation. Accuracy was higher for visual presentation for mental arithmetic and digit recall. The findings can be accounted for in terms of dual codes in working memory and suggest that cognitive load is lower for visual than for aural presentation.

[1]  Charles S. Myers,et al.  On reaction times. , 1909 .

[2]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.

[3]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[4]  D. Kahneman,et al.  Pupillary changes in two memory tasks , 1966 .

[5]  J. Bradshaw,et al.  Pupil Size as a Measure of Arousal during Information Processing , 1967, Nature.

[6]  J. Bradshaw.  Pupil Size and Problem Solving , 1968, The Quarterly journal of experimental psychology.

[7]  D. Kahneman,et al.  Effects of Grouping on the Pupillary Response in a Short-Term Memory Task , 1968, The Quarterly journal of experimental psychology.

[8]  J. Bradshaw.  Background light intensity and the pupillary response in a reaction time task , 1969 .

[9]  M Clynes,et al.  COLOR DYNAMICS OF THE PUPIL , 1969, Annals of the New York Academy of Sciences.

[10]  F. Boersma,et al.  Effects of arithmetic problem difficulty on pupillary dilation in normals and educable retardates. , 1970, Journal of experimental child psychology.

[11]  J. Bradshaw.  Pupil size and drag state in a reaction time task , 1970 .

[12]  P Wright,et al.  Changes of Pupil Size and Rehearsal Strategies in a Short-Term Memory Task , 1971, The Quarterly journal of experimental psychology.

[13]  B. Goldwater.  Psychological significance of pupillary movements. , 1972, Psychological bulletin.

[14]  D. Kahneman.  Attention and Effort , 1973 .

[15]  B. C. Lacey,et al.  Pupillary and cardiac activity during visual attention. , 1973, Psychophysiology.

[16]  W. S. Peavler,et al.  Pupil size, information overload, and performance differences. , 1974, Psychophysiology.

[17]  W. Becker,et al.  Bereitschaftspotential Preceding Voluntary Slow and Rapid Hand Movements , 1976 .

[18]  H. Huynh,et al.  Performance of traditional f tests in repeated measures designs under covariance heterogeneity , 1980 .

[19]  J. Beatty,et al.  Phasic not tonic pupillary responses vary with auditory vigilance performance. , 1982, Psychophysiology.

[20]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982 .

[21]  J Beatty,et al.  Response selection and initiation in speeded reactions: a pupillometric analysis. , 1983, Journal of experimental psychology. Human perception and performance.

[22]  M Nurminen,et al.  Comparative analysis of two rates. , 1985, Statistics in medicine.

[23]  K. Ukai,et al.  Spatial pattern as a stimulus to the pupillary system. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[24]  J. Beatty,et al.  Pupillary dilations in movement preparation and execution. , 1985, Psychophysiology.

[25]  A. Paivio.  Mental Representations: A Dual Coding Approach , 1986 .

[26]  J. Richard Jennings,et al.  Editorial Policy on Analyses of Variance With Repeated Measures , 1987 .

[27]  C. Penney.  Modality effects and the structure of short-term verbal memory , 1989, Memory & cognition.

[28]  K. M. Spyer,et al.  Central regulation of autonomic functions , 1990 .

[29]  A. Paivio,et al.  Dual coding theory and education , 1991 .

[30]  L. Walrath,et al.  Eye movement and pupillary response indices of mental workload during visual search of symbolic displays. , 1992, Applied ergonomics.

[31]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[32]  F. Paas,et al.  Instructional control of cognitive load in the training of complex cognitive tasks , 1994 .

[33]  R H Logie,et al.  Counting on working memory in arithmetic problem solving , 1994, Memory & cognition.

[34]  E. Granholm,et al.  Pupillary responses index cognitive resource limitations. , 1996, Psychophysiology.

[35]  M J Moseley,et al.  Development of pupillary responses to grating stimuli. , 1996, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[36]  Rhonda Milun,et al.  Pupil dilation when viewing strangers: Can testosterone moderate prejudice? , 1999 .

[37]  A. Parkin,et al.  Human memory , 1999, Current Biology.

[38]  I. E. Loewenfeld,et al.  The Pupil: Anatomy, Physiology, and Clinical Applications , 1999 .

[39]  J. Beatty,et al.  The pupillary system. , 2000 .

[40]  K. Misulis,et al.  Spehlmann's Evoked Potential Primer , 2001 .

[41]  Scott Makeig,et al.  Eye Activity Correlates of Workload during a Visuospatial Memory Task , 2001, Hum. Factors.

[42]  R. Kardon.  The Pupil: Anatomy, Physiology, and Clinical Applications, 2nd Ed. , 2001 .

[43]  E. Granholm,et al.  Pupillary responses and processing resources on the visual backward masking task. , 2001, Psychophysiology.

[44]  Ganesh S. Oak.  Information Visualization Introduction , 2022 .

[45]  C. Philip Beaman,et al.  Inverting the modality effect in serial recall , 2002, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[46]  S. P. Marshall,et al.  The Index of Cognitive Activity: measuring cognitive workload , 2002, Proceedings of the IEEE 7th Conference on Human Factors and Power Plants.

[47]  Vincent G. Duffy,et al.  Human centred computing : cognitive, social and ergonomic aspects , 2003 .

[48]  M. Pomplun,et al.  Pupil Dilation as an Indicator of Cognitive Workload in Human-Computer Interaction , 2003 .

[49]  J. Barbur,et al.  Pupil response triggered by the onset of coherent motion , 1997, Graefe's Archive for Clinical and Experimental Ophthalmology.

[50]  Todd C. Handy,et al.  Event-related potentials : a methods handbook , 2005 .

[51]  Chaomei Chen,et al.  Information Visualization: Beyond the Horizon , 2006 .

[52]  T. Troscianko,et al.  Effort during visual search and counting: Insights from pupillometry , 2007, Quarterly journal of experimental psychology.

[53]  J. Cacioppo,et al.  Handbook Of Psychophysiology , 2019 .

[54]  A. Baddeley.  Working Memory, Thought, and Action , 2007 .

[55]  Manfred Herrmann,et al.  Auditory task presentation reveals predominantly right hemispheric fMRI activation patterns during mental calculation , 2008, Neuroscience Letters.

[56]  Richard P. Heitz,et al.  Effects of incentive on working memory capacity: behavioral and pupillometric data. , 2007, Psychophysiology.

[57]  Pat Hanrahan,et al.  Measuring the task-evoked pupillary response with a remote eye tracker , 2008, ETRA.

[58]  J. Jolles,et al.  Pupil dilation in response preparation. , 2008, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[59]  R. Ornstein,et al.  Pupillary Responses During Information Processing Vary with Scholastic Aptitude Test Scores , 2022 .