Evidence Accumulation and the Moment of Recognition: Dissociating Perceptual Recognition Processes Using fMRI

Decision making can be conceptualized as the culmination of an integrative process in which evidence supporting different response options accumulates gradually over time. We used functional magnetic resonance imaging to investigate brain activity leading up to and during decisions about perceptual object identity. Pictures were revealed gradually and subjects signaled the time of recognition (TR) with a button press. We examined the time course of TR-dependent activity to determine how brain regions tracked the timing of recognition. In several occipital regions, activity increased primarily as stimulus information increased, suggesting a role in lower-level sensory processing. In inferior temporal, frontal, and parietal regions, a gradual buildup in activity peaking in correspondence with TR suggested that these regions participated in the accumulation of evidence supporting object identity. In medial frontal cortex, anterior insula/frontal operculum, and thalamus, activity remained near baseline until TR, suggesting a relation to the moment of recognition or the decision itself. The findings dissociate neural processes that function in concert during perceptual recognition decisions.

[1]  B. J. Winer.  Statistical Principles in Experimental Design , 1992 .

[2]  M. Kligerman.  PRESENT STATUS OF COMBINED RADIATION THERAPY AND CHEMOTHERAPY. , 1965, Progress in radiation therapy.

[3]  R. Audley,et al.  SOME ALTERNATIVE STOCHASTIC MODELS OF CHOICE1 , 1965 .

[4]  R. Kinchla,et al.  A diffusion model of perceptual memory , 1967 .

[5]  B. J. Winer,et al.  Statistical Principles in Experimental Design, 2nd Edition. , 1973 .

[6]  D. Rubin.  Within word structure in the tip-of-the-tongue phenomenon. , 1975 .

[7]  S. Link,et al.  A sequential theory of psychological discrimination , 1975 .

[8]  J. Frederiksen,et al.  Spelling and sound: Approaches to the internal lexicon. , 1976 .

[9]  I. Lieblich,et al.  A study of memory pointers , 1977 .

[10]  Roger Ratcliff,et al.  A Theory of Memory Retrieval. , 1978 .

[11]  R. Ratcliff,et al.  Speed and Accuracy in the Processing of False Statements About Semantic Information , 1982 .

[12]  H. Charles Romesburg,et al.  Cluster analysis for researchers , 1984 .

[13]  J. Busemeyer.  Decision making under uncertainty: a comparison of simple scalability, fixed-sample, and sequential-sampling models. , 1985, Journal of experimental psychology. Learning, memory, and cognition.

[14]  J. Metcalfe.  Feeling of knowing in memory and problem solving. , 1986 .

[15]  G. Cohen,et al.  Memory for proper names: age differences in retrieval , 1986 .

[16]  I. Biederman.  Recognition-by-components: a theory of human image understanding. , 1987, Psychological review.

[17]  J. Metcalfe,et al.  Intuition in insight and noninsight problem solving , 1987, Memory & cognition.

[18]  B. Murdock,et al.  A decision model for accuracy and response latency in recognition memory. , 1987 .

[19]  Philip L. Smith,et al.  The accumulator model of two-choice discrimination , 1988 .

[20]  M. Posner,et al.  Localization of cognitive operations in the human brain. , 1988, Science.

[21]  D. Tank,et al.  Brain magnetic resonance imaging with contrast dependent on blood oxygenation. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[22]  M. Torrens.  Co-Planar Stereotaxic Atlas of the Human Brain—3-Dimensional Proportional System: An Approach to Cerebral Imaging, J. Talairach, P. Tournoux. Georg Thieme Verlag, New York (1988), 122 pp., 130 figs. DM 268 , 1990 .

[23]  C. Bundesen.  A theory of visual attention. , 1990, Psychological review.

[24]  M. Posner,et al.  The attention system of the human brain. , 1990, Annual review of neuroscience.

[25]  Alan S. Brown,et al.  A review of the tip-of-the-tongue experience. , 1991, Psychological bulletin.

[26]  R. Turner,et al.  Dynamic magnetic resonance imaging of human brain activity during primary sensory stimulation. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[27]  Ravi S. Menon,et al.  Intrinsic signal changes accompanying sensory stimulation: functional brain mapping with magnetic resonance imaging. , 1992, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Matthew Flatt,et al.  PsyScope: An interactive graphic system for designing and controlling experiments in the psychology laboratory using Macintosh computers , 1993 .

[29]  M. Posner,et al.  Localization of a Neural System for Error Detection and Compensation , 1994 .

[30]  Dauid F. Percy.  Cluster Analysis (3rd Edition) , 1994 .

[31]  Karl J. Friston,et al.  Analysis of functional MRI time‐series , 1994, Human Brain Mapping.

[32]  Jack L. Lancaster,et al.  A modality‐independent approach to spatial normalization of tomographic images of the human brain , 1995 .

[33]  J. Schall,et al.  Neural Control of Voluntary Movement Initiation , 1996, Science.

[34]  D. Heeger,et al.  Linear Systems Analysis of Functional Magnetic Resonance Imaging in Human V1 , 1996, The Journal of Neuroscience.

[35]  R. Myers.  Quantification of brain function using PET , 1996 .

[36]  M. Raichle,et al.  Anatomic Localization and Quantitative Analysis of Gradient Refocused Echo-Planar fMRI Susceptibility Artifacts , 1997, NeuroImage.

[37]  A. Dale,et al.  Selective averaging of rapidly presented individual trials using fMRI , 1997, Human brain mapping.

[38]  R. Nosofsky,et al.  An exemplar-based random walk model of speeded classification. , 1997, Psychological review.

[39]  J. Jonides,et al.  Spatial working memory and spatial selective attention. , 1998 .

[40]  R. Parasuraman.  The attentive brain , 1998 .

[41]  Jeffrey N. Rouder,et al.  Modeling Response Times for Two-Choice Decisions , 1998 .

[42]  S. Rauch,et al.  The counting stroop: An interference task specialized for functional neuroimaging—validation study with functional MRI , 1998, Human brain mapping.

[43]  Michael L. Platt,et al.  Neural correlates of decision variables in parietal cortex , 1999, Nature.

[44]  Jonathan D. Cohen,et al.  Conflict monitoring versus selection-for-action in anterior cingulate cortex , 1999, Nature.

[45]  T. Robbins,et al.  Choosing between Small, Likely Rewards and Large, Unlikely Rewards Activates Inferior and Orbital Prefrontal Cortex , 1999, The Journal of Neuroscience.

[46]  D. Botstein,et al.  Cluster analysis and display of genome-wide expression patterns. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[47]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[48]  Karl J. Friston,et al.  Stochastic Designs in Event-Related fMRI , 1999, NeuroImage.

[49]  R. Buckner,et al.  Neural Correlates of Episodic Retrieval Success , 2000, NeuroImage.

[50]  R. Romo,et al.  Neuronal correlates of sensory discrimination in the somatosensory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[51]  R. Romo,et al.  Periodicity and Firing Rate As Candidate Neural Codes for the Frequency of Vibrotactile Stimuli , 2000, The Journal of Neuroscience.

[52]  S. Petersen,et al.  Characterizing the Hemodynamic Response: Effects of Presentation Rate, Sampling Procedure, and the Possibility of Ordering Brain Activity Based on Relative Timing , 2000, NeuroImage.

[53]  Ravi S. Menon,et al.  The effects of visual object priming on brain activation before and after recognition , 2000, Current Biology.

[54]  S. Petersen,et al.  Retrieval Success is Accompanied by Enhanced Activation in Anterior Prefrontal Cortex During Recognition Memory: An Event-Related fMRI Study , 2000, Journal of Cognitive Neuroscience.

[55]  M. Botvinick,et al.  Conflict monitoring and cognitive control. , 2001, Psychological review.

[56]  R. D. Gordon,et al.  Executive control of visual attention in dual-task situations. , 2001, Psychological review.

[57]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.

[58]  Talma Hendler,et al.  Center–periphery organization of human object areas , 2001, Nature Neuroscience.

[59]  P. Strick,et al.  Imaging the premotor areas , 2001, Current Opinion in Neurobiology.

[60]  Z Kourtzi,et al.  Representation of Perceived Object Shape by the Human Lateral Occipital Complex , 2001, Science.

[61]  M. Corbetta,et al.  Separating Processes within a Trial in Event-Related Functional MRI II. Analysis , 2001, NeuroImage.

[62]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[63]  R. Buckner,et al.  Dissociating Memory Retrieval Processes Using fMRI Evidence that Priming Does Not Support Recognition Memory , 2001, Neuron.

[64]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[65]  H. Burton,et al.  Neural correlates for roughness choice in monkey second somatosensory cortex (SII). , 2001, Journal of neurophysiology.

[66]  J. Gold,et al.  Neural computations that underlie decisions about sensory stimuli , 2001, Trends in Cognitive Sciences.

[67]  R. Buckner,et al.  Cluster size thresholds for assessment of significant activation in fMRI , 2001, NeuroImage.

[68]  D. Schacter,et al.  On the Tip of the Tongue An Event-Related fMRI Study of Semantic Retrieval Failure and Cognitive Conflict , 2001, Neuron.

[69]  M. Corbetta,et al.  Separating Processes within a Trial in Event-Related Functional MRI I. The Method , 2001, NeuroImage.

[70]  R. Buckner,et al.  Dissociating State and Item Components of Recognition Memory Using fMRI , 2001, NeuroImage.

[71]  A. Dale,et al.  Dorsal anterior cingulate cortex: A role in reward-based decision making , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[72]  Kristina M. Visscher,et al.  Functional Neuroanatomical Differences Between Adults and School-Age Children in the Processing of Single Words , 2002, Science.

[73]  Karl J. Friston,et al.  The Neural Structures Expressing Perceptual Hysteresis in Visual Letter Recognition , 2002, Neuron.

[74]  R. Ratcliff.  A diffusion model account of response time and accuracy in a brightness discrimination task: Fitting real data and failing to fit fake but plausible data , 2002, Psychonomic bulletin & review.

[75]  John H. R. Maunsell,et al.  Dynamics of neuronal responses in macaque MT and VIP during motion detection , 2002, Nature Neuroscience.

[76]  Dietmar Cordes,et al.  Hierarchical clustering to measure connectivity in fMRI resting-state data. , 2002, Magnetic resonance imaging.

[77]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[78]  D. Attwell,et al.  The neural basis of functional brain imaging signals , 2002, Trends in Neurosciences.

[79]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[80]  Robert L. Mason,et al.  Statistical Principles in Experimental Design , 2003 .

[81]  R. Ratcliff,et al.  A comparison of macaque behavior and superior colliculus neuronal activity to predictions from models of two-choice decisions. , 2003, Journal of neurophysiology.

[82]  R. Buckner,et al.  Functional Dissociation among Components of Remembering: Control, Perceived Oldness, and Content , 2003, The Journal of Neuroscience.

[83]  J. Gold,et al.  The Neurophysiology of Decision Making as a Window on Cognition , 2003 .

[84]  Jeffrey M. Zacks,et al.  Neural correlates of incongruous visual information An event-related fMRI study , 2003, NeuroImage.

[85]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[86]  Jonathan D. Cohen,et al.  The Neural Basis of Economic Decision-Making in the Ultimatum Game , 2003, Science.

[87]  J. White,et al.  Epilepsy in Small World Networks the Journal of Neuroscience for Peer Review Only , 2004 .

[88]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[89]  B. Rossion,et al.  Revisiting Snodgrass and Vanderwart's Object Pictorial Set: The Role of Surface Detail in Basic-Level Object Recognition , 2004, Perception.

[90]  Mark E Wheeler,et al.  Functional-anatomic correlates of remembering and knowing , 2004, NeuroImage.

[91]  L. Davachi,et al.  Behavioral/systems/cognitive Functional–neuroanatomic Correlates of Recollection: Implications for Models of Recognition Memory , 2022 .

[92]  Edward M. Bowden,et al.  Neural Activity When People Solve Verbal Problems with Insight , 2004, PLoS biology.

[93]  Roger Ratcliff,et al.  A diffusion model account of the lexical decision task. , 2004, Psychological review.

[94]  M. Gazzaniga.  The cognitive neurosciences, 3rd edition , 2004 .

[95]  Abraham Z. Snyder,et al.  Transient BOLD responses at block transitions , 2005, NeuroImage.

[96]  Douglas B. Kell,et al.  Computational cluster validation in post-genomic data analysis , 2005, Bioinform..

[97]  Joshua W. Brown,et al.  Learned Predictions of Error Likelihood in the Anterior Cingulate Cortex , 2005, Science.

[98]  M. Shadlen,et al.  Neural Activity in Macaque Parietal Cortex Reflects Temporal Integration of Visual Motion Signals during Perceptual Decision Making , 2005, The Journal of Neuroscience.

[99]  M. Shadlen,et al.  The effect of stimulus strength on the speed and accuracy of a perceptual decision. , 2005, Journal of vision.

[100]  E. Bullmore,et al.  Neurophysiological architecture of functional magnetic resonance images of human brain. , 2005, Cerebral cortex.

[101]  R. Cabeza,et al.  Cerebral Cortex doi:10.1093/cercor/bhj097 Role of Prefrontal and Anterior Cingulate Regions in Decision-Making Processes Shared by Memory and Nonmemory Tasks , 2005 .

[102]  J. Hirsch,et al.  A Neural Representation of Categorization Uncertainty in the Human Brain , 2006, Neuron.

[103]  G. Shulman,et al.  Evidence for separate perceptual reactivation and search processes during remembering. , 2006, Cerebral cortex.

[104]  Frans A. J. Verstraten,et al.  Dynamics of visual recognition revealed by fMRI , 2006, NeuroImage.

[105]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[106]  Justin L. Vincent,et al.  Distinct brain networks for adaptive and stable task control in humans , 2007, Proceedings of the National Academy of Sciences.

[107]  L. Pessoa,et al.  Neural Correlates of Perceptual Choice and Decision Making during Fear–Disgust Discrimination , 2007, The Journal of Neuroscience.

[108]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[109]  F. Tong,et al.  The timing of perceptual decisions for ambiguous face stimuli in the human ventral visual cortex. , 2006, Cerebral cortex.

[110]  J. O'Doherty,et al.  Decoding the neural substrates of reward-related decision making with functional MRI , 2007, Proceedings of the National Academy of Sciences.