EEG-Informed fMRI Reveals Spatiotemporal Characteristics of Perceptual Decision Making

Single-unit and multiunit recordings in primates have already established that decision making involves at least two general stages of neural processing: representation of evidence from early sensory areas and accumulation of evidence to a decision threshold from decision-related regions. However, the relay of information from early sensory to decision areas, such that the accumulation process is instigated, is not well understood. Using a cued paradigm and single-trial analysis of electroencephalography (EEG), we previously reported on temporally specific components related to perceptual decision making. Here, we use information derived from our previous EEG recordings to inform the analysis of fMRI data collected for the same behavioral task to ascertain the cortical origins of each of these EEG components. We demonstrate that a cascade of events associated with perceptual decision making takes place in a highly distributed neural network. Of particular importance is an activation in the lateral occipital complex implicating perceptual persistence as a mechanism by which object decision making in the human brain is instigated.

[1]  V. Lollo,et al.  Temporal characteristics of iconic memory , 1977, Nature.

[2]  M Coltheart,et al.  The persistences of vision. , 1980, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  M. Mesulam,et al.  Insula of the old world monkey. III: Efferent cortical output and comments on function , 1982, The Journal of comparative neurology.

[4]  M. Mesulam,et al.  Insula of the old world monkey. II: Afferent cortical input and comments on the claustrum , 1982, The Journal of comparative neurology.

[5]  P. Goldman-Rakic,et al.  Common cortical and subcortical targets of the dorsolateral prefrontal and posterior parietal cortices in the rhesus monkey: evidence for a distributed neural network subserving spatially guided behavior , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  D C Van Essen,et al.  Information processing in the primate visual system: an integrated systems perspective. , 1992, Science.

[7]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[8]  R. Malach,et al.  Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[9]  Edward E. Smith,et al.  Temporal dynamics of brain activation during a working memory task , 1997, Nature.

[10]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[11]  P. Lennie.  Single Units and Visual Cortical Organization , 1998, Perception.

[12]  M. Botvinick,et al.  Anterior cingulate cortex, error detection, and the online monitoring of performance. , 1998, Science.

[13]  Leslie G. Ungerleider,et al.  A neural system for human visual working memory. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[14]  T. Allison,et al.  Temporal Cortex Activation in Humans Viewing Eye and Mouth Movements , 1998, The Journal of Neuroscience.

[15]  M. Corbetta,et al.  A Common Network of Functional Areas for Attention and Eye Movements , 1998, Neuron.

[16]  A. Leventhal,et al.  Signal timing across the macaque visual system. , 1998, Journal of neurophysiology.

[17]  T. Allison,et al.  Electrophysiological studies of human face perception. I: Potentials generated in occipitotemporal cortex by face and non-face stimuli. , 1999, Cerebral cortex.

[18]  T. Allison,et al.  Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. , 1999, Cerebral cortex.

[19]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[20]  T. Allison,et al.  Electrophysiological studies of human face perception. II: Response properties of face-specific potentials generated in occipitotemporal cortex. , 1999, Cerebral cortex.

[21]  E. Halgren,et al.  Location of human face‐selective cortex with respect to retinotopic areas , 1999, Human brain mapping.

[22]  S. Edelman,et al.  Differential Processing of Objects under Various Viewing Conditions in the Human Lateral Occipital Complex , 1999, Neuron.

[23]  K. Grill-Spector,et al.  The dynamics of object-selective activation correlate with recognition performance in humans , 2000, Nature Neuroscience.

[24]  C. Cavada,et al.  The anatomical connections of the macaque monkey orbitofrontal cortex. A review. , 2000, Cerebral cortex.

[25]  J. Cohen,et al.  Dissociating the role of the dorsolateral prefrontal and anterior cingulate cortex in cognitive control. , 2000, Science.

[26]  J. Haxby,et al.  The distributed human neural system for face perception , 2000, Trends in Cognitive Sciences.

[27]  J. Haxby,et al.  Distinct representations of eye gaze and identity in the distributed human neural system for face perception , 2000, Nature Neuroscience.

[28]  Ravi S. Menon,et al.  The effects of visual object priming on brain activation before and after recognition , 2000, Current Biology.

[29]  Vinod Goel,et al.  Anatomical Segregation of Component Processes in an Inductive Inference Task , 2000, Journal of Cognitive Neuroscience.

[30]  N. Cohen,et al.  The relative involvement of anterior cingulate and prefrontal cortex in attentional control depends on nature of conflict. , 2001, Brain research. Cognitive brain research.

[31]  R. Rafal,et al.  Neural fate of seen and unseen faces in visuospatial neglect: A combined event-related functional MRI and event-related potential study , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[32]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[33]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[34]  Ravi S. Menon,et al.  Differential Effects of Viewpoint on Object-Driven Activation in Dorsal and Ventral Streams , 2002, Neuron.

[35]  Joshua W. Brown,et al.  Monitoring and Control of Action by the Frontal Lobes , 2002, Neuron.

[36]  Michael Petrides,et al.  The Mid-ventrolateral Prefrontal Cortex and Active Mnemonic Retrieval , 2002, Neurobiology of Learning and Memory.

[37]  R. Hess,et al.  What causes non-monotonic tuning of fMRI response to noisy images? , 2002, Current Biology.

[38]  Gregory G. Brown,et al.  Error Rate and Outcome Predictability Affect Neural Activation in Prefrontal Cortex and Anterior Cingulate during Decision-Making , 2002, NeuroImage.

[39]  Leslie G. Ungerleider,et al.  Neural Correlates of Visual Working Memory fMRI Amplitude Predicts Task Performance , 2002, Neuron.

[40]  R. Passingham,et al.  Active maintenance in prefrontal area 46 creates distractor-resistant memory , 2002, Nature Neuroscience.

[41]  Katherine M. Armstrong,et al.  Selective gating of visual signals by microstimulation of frontal cortex , 2003, Nature.

[42]  C. Koch,et al.  Visual Selective Behavior Can Be Triggered by a Feed-Forward Process , 2003, Journal of Cognitive Neuroscience.

[43]  Thomas E. Nichols,et al.  Optimization of experimental design in fMRI: a general framework using a genetic algorithm , 2003, NeuroImage.

[44]  Katherine M. Armstrong,et al.  Visuomotor Origins of Covert Spatial Attention , 2003, Neuron.

[45]  J. Duncan,et al.  Encoding Strategies Dissociate Prefrontal Activity from Working Memory Demand , 2003, Neuron.

[46]  Tutis Vilis,et al.  The lateral occipital complex subserves the perceptual persistence of motion-defined groupings. , 2003, Cerebral cortex.

[47]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[48]  T. Klingberg,et al.  Increased prefrontal and parietal activity after training of working memory , 2004, Nature Neuroscience.

[49]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.

[50]  N. Kanwisher,et al.  The fusiform face area subserves face perception, not generic within-category identification , 2004, Nature Neuroscience.

[51]  Samuel M. McClure,et al.  Separate Neural Systems Value Immediate and Delayed Monetary Rewards , 2004, Science.

[52]  Jonathan D. Cohen,et al.  Anterior Cingulate Conflict Monitoring and Adjustments in Control , 2004, Science.

[53]  S. Kosslyn,et al.  Brain areas underlying visual mental imagery and visual perception: an fMRI study. , 2004, Brain research. Cognitive brain research.

[54]  Bruno Rossion,et al.  Parametric design and correlational analyses help integrating fMRI and electrophysiological data during face processing , 2004, NeuroImage.

[55]  Philip L. Smith,et al.  Attention orienting and the time course of perceptual decisions: response time distributions with masked and unmasked displays , 2004, Vision Research.

[56]  Joshua W. Brown,et al.  Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex , 2005, Science.

[57]  M. Hallett,et al.  Brain activity during visuomotor behavior triggered by arbitrary and spatially constrained cues: an fMRI study in humans , 2006, Experimental Brain Research.

[58]  Tutis Vilis,et al.  Perceptual continuity and the emergence of perceptual persistence in the ventral visual pathway. , 2005, Journal of neurophysiology.

[59]  Roberto Cabeza,et al.  Neural Correlates of Relational Memory: Successful Encoding and Retrieval of Semantic and Perceptual Associations , 2005, The Journal of Neuroscience.

[60]  Michael X. Cohen,et al.  Functional connectivity with anterior cingulate and orbitofrontal cortices during decision-making. , 2005, Brain research. Cognitive brain research.

[61]  Christian Büchel,et al.  The functional and temporal characteristics of top-down modulation in visual selection. , 2005, Cerebral cortex.

[62]  Hans-Jochen Heinze,et al.  The Neural Site of Attention Matches the Spatial Scale of Perception , 2006, The Journal of Neuroscience.

[63]  Karl J. Friston,et al.  Acute Changes in Frontoparietal Activity after Repetitive Transcranial Magnetic Stimulation over the Dorsolateral Prefrontal Cortex in a Cued Reaction Time Task , 2006, The Journal of Neuroscience.

[64]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[65]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[66]  Karl J. Friston,et al.  A critique of functional localisers , 2006, NeuroImage.

[67]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[68]  Tutis Vilis,et al.  Task-related laterality effects in the lateral occipital complex , 2007, Brain Research.

[69]  T. A. Kelley,et al.  Cortical mechanisms for shifting and holding visuospatial attention. , 2008, Cerebral cortex.