Temporal characterization of the neural correlates of perceptual decision making in the human brain.

Single and multi-unit recordings in primates have identified spatially localized neuronal activity correlating with an animal's behavioral performance. Due to the invasive nature of these experiments, it has been difficult to identify such correlates in humans. We report the first non-invasive neural measurements of perceptual decision making, via single-trial EEG analysis, that lead to neurometric functions predictive of psychophysical performance for a face versus car categorization task. We identified two major discriminating components. The earliest correlating with psychophysical performance was consistent with the well-known face-selective N170. The second component, which was a better match to the psychometric function, did not occur until at least 130 ms later. As evidence for faces versus cars decreased, onset of the later, but not the earlier, component systematically shifted forward in time. In addition, a choice probability analysis indicated strong correlation between the neural responses of the later component and our subjects' behavioral judgements. These findings demonstrate a temporal evolution of component activity indicative of an evidence accumulation process which begins after early visual perception and has a processing time that depends on the strength of the evidence.

[1]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[2]  David G. Stork,et al.  Pattern Classification , 1973 .

[3]  Quick Rf A vector-magnitude model of contrast detection. , 1974 .

[4]  K. M. L. Suxena,et al.  Introduction to Statistical Theory , 1976 .

[5]  A. Watson Probability summation over time , 1979, Vision Research.

[6]  E. G. Jones Cerebral Cortex , 1987, Cerebral Cortex.

[7]  K. H. Britten,et al.  Neuronal correlates of a perceptual decision , 1989, Nature.

[8]  J. Movshon,et al.  The analysis of visual motion: a comparison of neuronal and psychophysical performance , 1992, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[9]  Robert A. Jacobs,et al.  Hierarchical Mixtures of Experts and the EM Algorithm , 1993, Neural Computation.

[10]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[11]  Josh H. McDermott,et al.  Functional imaging of human visual recognition. , 1996, Brain research. Cognitive brain research.

[12]  T. Allison,et al.  Functional magnetic resonance imaging of the differential sensitivity of human visual cortex to faces, letterstrings, and textures , 1996, NeuroImage.

[13]  M N Shadlen,et al.  Motion perception: seeing and deciding. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[14]  D. Jeffreys Evoked Potential Studies of Face and Object Processing , 1996 .

[15]  T. Allison,et al.  Differential Sensitivity of Human Visual Cortex to Faces, Letterstrings, and Textures: A Functional Magnetic Resonance Imaging Study , 1996, The Journal of Neuroscience.

[16]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[17]  K. H. Britten,et al.  A relationship between behavioral choice and the visual responses of neurons in macaque MT , 1996, Visual Neuroscience.

[18]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[19]  J. A. Pruszynski,et al.  Neural correlates , 2023 .

[20]  Victor A. F. Lamme,et al.  Feedforward, horizontal, and feedback processing in the visual cortex , 1998, Current Opinion in Neurobiology.

[21]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[22]  M. Shadlen,et al.  Neural correlates of a decision in the dorsolateral prefrontal cortex of the macaque , 1999, Nature Neuroscience.

[23]  E. Halgren,et al.  Cognitive response profile of the human fusiform face area as determined by MEG. , 2000, Cerebral cortex.

[24]  R. Romo,et al.  Neuronal correlates of sensory discrimination in the somatosensory cortex. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[25]  N. Kanwisher,et al.  The selectivity of the occipitotemporal M170 for faces , 2000, Neuroreport.

[26]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[27]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[28]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[29]  P. Fldik,et al.  The Speed of Sight , 2001, Journal of Cognitive Neuroscience.

[30]  S. Thorpe,et al.  The Time Course of Visual Processing: From Early Perception to Decision-Making , 2001, Journal of Cognitive Neuroscience.

[31]  Talma Hendler,et al.  Eccentricity Bias as an Organizing Principle for Human High-Order Object Areas , 2002, Neuron.

[32]  Emilio Salinas,et al.  Exploring the cortical evidence of a sensory-discrimination process. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[33]  R. Hess,et al.  What causes non-monotonic tuning of fMRI response to noisy images? , 2002, Current Biology.

[34]  Christian Keysers,et al.  Visual masking and RSVP reveal neural competition , 2002, Trends in Cognitive Sciences.

[35]  N. Kanwisher,et al.  Stages of processing in face perception: an MEG study , 2002, Nature Neuroscience.

[36]  Barak A. Pearlmutter,et al.  Linear Spatial Integration for Single-Trial Detection in Encephalography , 2002, NeuroImage.

[37]  Bruno Rossion,et al.  Early lateralization and orientation tuning for face, word, and object processing in the visual cortex , 2003, NeuroImage.

[38]  Bruno A Olshausen,et al.  Timecourse of neural signatures of object recognition. , 2003, Journal of vision.

[39]  C. Koch,et al.  Visual Selective Behavior Can Be Triggered by a Feed-Forward Process , 2003, Journal of Cognitive Neuroscience.

[40]  P. Sajda,et al.  Response error correction-a demonstration of improved human-machine performance using real-time EEG monitoring , 2003, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[41]  M. Shadlen,et al.  A role for neural integrators in perceptual decision making. , 2003, Cerebral cortex.

[42]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[43]  K. Bötzel,et al.  Scalp topography and analysis of intracranial sources of face-evoked potentials , 2004, Experimental Brain Research.

[44]  D. Jeffreys A face-responsive potential recorded from the human scalp , 2004, Experimental Brain Research.