Neuroindices of cognitive workload: Neuroimaging, pupillometric and event-related potential studies of brain work

This article is a selective theory-driven review that synthesizes recent neuroscience findings concerning mental workload during complex cognition from the perspective of a functional resource theory called 3CAPS, focusing on the concept of capacity utilization . Capacity utilization refers to the proportion of resources that is being consumed in a given time interval in a given cognitive system. This definition integrates the dynamic effects of (a) the computational demand imposed by a task, and (b) the resource supply in an individual that is available to meet that demand. The analysis reveals that the functional relations between capacity utilization and measures of neural activity are similar across three different cognitive systems (language comprehension, visuospatial processing and executive processing). The measures of neural activity include functional neuroimaging, pupillary dilation and event-related potentials. The construct of capacity utilization provides a mapping between a functional architecture of cognition and aspects of its neural implementation.

[1]  Per Capita,et al.  About the authors , 1995, Machine Vision and Applications.

[2]  Marcel Adam Just,et al.  A hybrid architecture for working memory: Reply to MacDonald and Christiansen (2002). , 2002 .

[3]  M. Kutas,et al.  The Potentials for Basic Sentence Processing : Differentiating Integrative Processes , 2002 .

[4]  José J. Cañas,et al.  Differential Roles for Visuospatial and Verbal Working Memory in the Construction of Mental Models of Physical Systems , 2002 .

[5]  S. Laughlin.  Energy as a constraint on the coding and processing of sensory information , 2001, Current Opinion in Neurobiology.

[6]  M. Just,et al.  Interdependence of Nonoverlapping Cortical Systems in Dual Cognitive Tasks , 2001, NeuroImage.

[7]  Newell,et al.  A neural basis for general intelligence , 2000, American journal of ophthalmology.

[8]  Newell,et al.  A neural basis for general intelligence , 2000, American journal of ophthalmology-glaucoma.

[9]  A. Miyake,et al.  Differential roles for visuospatial and verbal working memory in situation model construction. , 2000, Journal of experimental psychology. General.

[10]  David A. Rettinger,et al.  Individual differences in integrating and coordinating multiple sources of information , 1999 .

[11]  A. Miyake,et al.  Models of Working Memory: Mechanisms of Active Maintenance and Executive Control , 1999 .

[12]  M. Just,et al.  Computational modeling of high‐level cognition and brain function , 1999, Human brain mapping.

[13]  M. Just,et al.  Graded Functional Activation in the Visuospatial System with the Amount of Task Demand , 1999, Journal of Cognitive Neuroscience.

[14]  Michael C. Pyryt.  Human cognitive abilities: A survey of factor analytic studies , 1998 .

[15]  M. Just,et al.  Aphasic Sentence Comprehension as a Resource Deficit: A Computational Approach , 1997, Brain and Language.

[16]  Robert E. Kass,et al.  Working-memory failure in phone-based interaction , 1997, TCHI.

[17]  J. Fuster.  The Prefrontal Cortex , 1997 .

[18]  M. Petrides,et al.  Functional activation of the human brain during mental rotation , 1997, Neuropsychologia.

[19]  Edward E. Smith,et al.  A Parametric Study of Prefrontal Cortex Involvement in Human Working Memory , 1996, NeuroImage.

[20]  Michael D. Byrne,et al.  A Working Memory Model of a Common Procedural Error , 1997, Cogn. Sci..

[21]  M. Just,et al.  Brain Activation Modulated by Sentence Comprehension , 1996, Science.

[22]  M A Just,et al.  The capacity theory of comprehension: new frontiers of evidence and arguments. , 1996, Psychological review.

[23]  J. Duncan,et al.  Intelligence and the Frontal Lobe: The Organization of Goal-Directed Behavior , 1996, Cognitive Psychology.

[24]  R. Dolan,et al.  Neural systems engaged by planning: a PET study of the Tower of London task , 1996, Neuropsychologia.

[25]  D Shapiro,et al.  The role of the right hemisphere in the physiological and cognitive components of emotional processing. , 1996, Psychophysiology.

[26]  Mark S. Cohen,et al.  Changes in cortical activity during mental rotation. A mapping study using functional MRI. , 1996, Brain : a journal of neurology.

[27]  A. Miyake,et al.  The separability of working memory resources for spatial thinking and language processing: an individual differences approach. , 1996, Journal of experimental psychology. General.

[28]  M. D’Esposito,et al.  The neural basis of the central executive system of working memory , 1995, Nature.

[29]  M. Kutas,et al.  Who Did What and When? Using Word- and Clause-Level ERPs to Monitor Working Memory Usage in Reading , 1995, Journal of Cognitive Neuroscience.

[30]  A D Friederici,et al.  Processing relative clauses varying on syntactic and semantic dimensions: An analysis with event-related potentials , 1995, Memory & cognition.

[31]  S. Monsell,et al.  Costs of a predictible switch between simple cognitive tasks. , 1995 .

[32]  M. Taylor,et al.  Stimulus and Sex-Differences in Performance of Mental Rotation - Evidence from Event-Related Potentials , 1995, Brain and Cognition.

[33]  G. Mulder,et al.  Language, memory, and aging: an electrophysiological exploration of the N400 during reading of memory-demanding sentences. , 1995, Psychophysiology.

[34]  F. Rösler,et al.  Patterns of cerebral activation while mental images are rotated and changed in size. , 1995, Psychophysiology.

[35]  M Petrides,et al.  Impairments on nonspatial self-ordered and externally ordered working memory tasks after lesions of the mid-dorsal part of the lateral frontal cortex in the monkey , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[36]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[37]  M. Just,et al.  A capacity approach to syntactic comprehension disorders: making normal adults perform like aphasic patients , 1994 .

[38]  R. Roberts,et al.  Prefrontal cognitive processes: Working memory and inhibition in the antisaccade task. , 1994 .

[39]  Richard S. J. Frackowiak,et al.  The role of the right hemisphere in the interpretation of figurative aspects of language. A positron emission tomography activation study. , 1994, Brain : a journal of neurology.

[40]  Karl J. Friston,et al.  A graded task approach to the functional mapping of brain areas implicated in auditory-verbal memory. , 1994, Brain : a journal of neurology.

[41]  Eric Reuland,et al.  PET studies of language: An assessment of the reliability of the technique , 1994 .

[42]  J. Sergent.  Brain-imaging studies of cognitive functions , 1994, Trends in Neurosciences.

[43]  J. Binder,et al.  Functional magnetic resonance imaging of human auditory cortex , 1994, Annals of neurology.

[44]  P. Goldman-Rakic,et al.  Coactivation of prefrontal cortex and inferior parietal cortex in working memory tasks revealed by 2DG functional mapping in the rhesus monkey , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  M. Just,et al.  Working Memory Constraints on the Resolution of Lexical Ambiguity: Maintaining Multiple Interpretations in Neutral Contexts , 1994 .

[46]  Christoph M. Michel,et al.  Duration of EEG and MEG Suppression Increases with Angle in a Mental Rotation Task , 1994, Journal of Cognitive Neuroscience.

[47]  R. Plomin.  Biological approaches to the study of human intelligence , 1994 .

[48]  S. Petersen,et al.  Practice-related changes in human brain functional anatomy during nonmotor learning. , 1994, Cerebral cortex.

[49]  Suzanne Mannes,et al.  Global Semantic Expectancy and Language Comprehension , 1994, Journal of Cognitive Neuroscience.

[50]  M. Just,et al.  The intensity dimension of thought: pupillometric indices of sentence processing. , 1993, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[51]  Karl J. Friston,et al.  Functional mapping of brain areas implicated in auditory--verbal memory function. , 1993, Brain : a journal of neurology.

[52]  P. Vernon,et al.  Biological Approaches to the Study of Human Intelligence , 1993 .

[53]  G E Raney,et al.  Monitoring changes in cognitive load during reading: an event-related brain potential and reaction time analysis. , 1993, Journal of experimental psychology. Learning, memory, and cognition.

[54]  Karl J. Friston,et al.  The cortical localization of the lexicons. Positron emission tomography evidence. , 1992, Brain : a journal of neurology.

[55]  M. Buchsbaum,et al.  Intelligence and changes in regional cerebral glucose metabolic rate following learning , 1992 .

[56]  N. Tzourio,et al.  Different mental imagery abilities result in different regional cerebral blood flow activation patterns during cognitive tasks , 1992, Neuropsychologia.

[57]  M. Just,et al.  Working memory constraints on the processing of syntactic ambiguity , 1992, Cognitive Psychology.

[58]  M. Just,et al.  From the SelectedWorks of Marcel Adam Just 1992 A capacity theory of comprehension : Individual differences in working memory , 2017 .

[59]  Cheryl L. Grady,et al.  Mapping the functional neuroanatomy of the intact human brain with brain work imaging , 1991, Neuropsychologia.

[60]  M. Just,et al.  Individual differences in syntactic processing: The role of working memory , 1991 .

[61]  G. Ojemann.  Cortical organization of language , 1991, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[62]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[63]  M A Just,et al.  From the SelectedWorks of Marcel Adam Just 1990 What one intelligence test measures : A theoretical account of the processing in the Raven Progressive Matrices Test , 2016 .

[64]  Raja Parasuraman,et al.  Event-related brain potentials and human factors research. , 1990 .

[65]  A. A. Wijers,et al.  Brain potentials during selective attention, memory search, and mental rotation. , 1989, Psychophysiology.

[66]  M. Farah,et al.  Mental rotation: An event-related potential study with a validated mental rotation task , 1989, Brain and Cognition.

[67]  B. L. Beattie,et al.  Neuropsychological "systems efficiency" and positron emission tomography. , 1989, The Journal of neuropsychiatry and clinical neurosciences.

[68]  T. Shallice.  From Neuropsychology to Mental Structure , 1988 .

[69]  D. Loewenstein,et al.  Cerebral metabolic effects of a verbal fluency test: a PET scan study. , 1988, Journal of clinical and experimental neuropsychology.

[70]  M. Buchsbaum,et al.  Cortical glucose metabolic rate correlates of abstract reasoning and attention studied with positron emission tomography , 1988 .

[71]  Thomas E. Nygren,et al.  The Subjective Workload Assessment Technique: A Scaling Procedure for Measuring Mental Workload , 1988 .

[72]  Y. Ben-nun.  The use of pupillometry in the study of on-line verbal processing: Evidence for depths of processing , 1986, Brain and Language.

[73]  Klaus Hofmeister,et al.  Pupillary responses to syntactic ambiguity of sentences , 1986, Brain and Language.

[74]  R. Parasuraman.  Event-Related Brain Potentials and Intermodal Divided Attention , 1985 .

[75]  M. Just,et al.  Cognitive coordinate systems: accounts of mental rotation and individual differences in spatial ability. , 1985, Psychological review.

[76]  C. Mateer,et al.  Right hemisphere appreciation of prosodic and linguistic indications of implicit attitude , 1985, Brain and Language.

[77]  D. Navon.  Resources—a theoretical soup stone? , 1984 .

[78]  Michael Schluroff.  Pupil responses to grammatical complexity of sentences , 1982, Brain and Language.

[79]  J. Beatty.  Task-evoked pupillary responses, processing load, and the structure of processing resources. , 1982, Psychological bulletin.

[80]  R. Sternberg.  Advances in the psychology of human intelligence , 1982 .

[81]  Leslie G. Ungerleider.  Two cortical visual systems , 1982 .

[82]  O. Andy.  The prefrontal cortex: Anatomy, physiology and neuropsychology of the frontal lobe , 1981 .

[83]  P. Carpenter,et al.  Individual differences in working memory and reading , 1980 .

[84]  C D Wickens,et al.  The Event-Related Brain Potential as an Index of Display-Monitoring Workload , 1980, Human factors.

[85]  E. Hess,et al.  Pupillometry: The Psychology of the Pupillary Response , 1978 .

[86]  P. Carpenter,et al.  Mental rotation and the frame of reference in blind and sighted individuals , 1978, Perception & psychophysics.

[87]  Daniel Gopher,et al.  On the Economy of the Human Processing System: A Model of Multiple Capacity. , 1977 .

[88]  Daniel G Bobrow,et al.  On data-limited and resource-limited processes , 1975, Cognitive Psychology.

[89]  D. Kahneman.  Attention and Effort , 1973 .

[90]  R. F. Stanners,et al.  The pupillary response to sentences: Influences of listening set and deep structure , 1972 .