Un co rre cte d Pr oo f RT for Object Categorization Is Predicted by Representational Distance

■ How does the brain translate an internal representation of an object into a decision about the objectʼs category? Recent studies have uncovered the structure of object representations in inferior temporal cortex (IT) using multivariate pattern analysis methods. These studies have shown that representations of individual object exemplars in IT occupy distinct locations in a high-dimensional activation space, with object exemplar representations clustering into distinguishable regions based on category (e.g., animate vs. inanimate objects). In this study, we hypothesized that a representational boundary between category representations in this activation space also constitutes a decision boundary for categorization. We show that behavioral RTs for categorizing objects are well described by our activation space hypothesis. Interpreted in terms of classical and contemporary models of decision-making, our results suggest that the process of settling on an internal representation of a stimulus is itself partially constitutive of decisionmaking for object categorization. ■

[1]  T. Carlson,et al.  Patterns of Activity in the Categorical Representations of Objects , 2003 .

[2]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[3]  David D. Cox,et al.  Untangling invariant object recognition , 2007, Trends in Cognitive Sciences.

[4]  M. Shadlen,et al.  Response of Neurons in the Lateral Intraparietal Area during a Combined Visual Discrimination Reaction Time Task , 2002, The Journal of Neuroscience.

[5]  N. Kriegeskorte,et al.  Revealing representational content with pattern-information fMRI--an introductory guide. , 2009, Social cognitive and affective neuroscience.

[6]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[7]  Emilio Salinas,et al.  Cognitive neuroscience: Flutter Discrimination: neural codes, perception, memory and decision making , 2003, Nature Reviews Neuroscience.

[8]  J. Gold,et al.  The neural basis of decision making. , 2007, Annual review of neuroscience.

[9]  Gustavo Deco,et al.  Synaptic dynamics and decision making , 2010, Proceedings of the National Academy of Sciences.

[10]  Timothy D. Hanks,et al.  Microstimulation of macaque area LIP affects decision-making in a motion discrimination task , 2006, Nature Neuroscience.

[11]  Philip L. Smith,et al.  Psychology and neurobiology of simple decisions , 2004, Trends in Neurosciences.

[12]  M. Potter Short-term conceptual memory for pictures. , 1976, Journal of experimental psychology. Human learning and memory.

[13]  S. Thorpe,et al.  Speed of processing in the human visual system , 1996, Nature.

[14]  N. Kanwisher,et al.  The lateral occipital complex and its role in object recognition , 2001, Vision Research.

[15]  Keiji Tanaka,et al.  Matching Categorical Object Representations in Inferior Temporal Cortex of Man and Monkey , 2008, Neuron.

[16]  Timothy J. Pleskac,et al.  Two-stage dynamic signal detection: a theory of choice, decision time, and confidence. , 2010, Psychological review.

[17]  S. Thorpe,et al.  Surfing a spike wave down the ventral stream , 2002, Vision Research.

[18]  M. Shadlen,et al.  Representation of Confidence Associated with a Decision by Neurons in the Parietal Cortex , 2009, Science.

[19]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[20]  Philip L. Smith,et al.  A comparison of sequential sampling models for two-choice reaction time. , 2004, Psychological review.

[21]  Timothy D. Hanks,et al.  Neurobiology of decision making: An intentional framework , 2008 .

[22]  Neil A. Macmillan,et al.  Detection Theory: A User's Guide , 1991 .

[23]  Keiji Tanaka,et al.  Differences in onset latency of macaque inferotemporal neural responses to primate and non-primate faces. , 2005, Journal of neurophysiology.

[24]  James J DiCarlo,et al.  Using neuronal latency to determine sensory-motor processing pathways in reaction time tasks. , 2005, Journal of neurophysiology.

[25]  Tomaso Poggio,et al.  Fast Readout of Object Identity from Macaque Inferior Temporal Cortex , 2005, Science.

[26]  Roger Ratcliff,et al.  The Diffusion Decision Model: Theory and Data for Two-Choice Decision Tasks , 2008, Neural Computation.

[27]  W. Singer,et al.  Better than conscious? : decision making, the human mind, and implications for institutions , 2008 .

[28]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[29]  Leslie G. Ungerleider,et al.  A general mechanism for perceptual decision-making in the human brain , 2004, Nature.

[30]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[31]  N. Kanwisher,et al.  Only some spatial patterns of fMRI response are read out in task performance , 2007, Nature Neuroscience.

[32]  N. Kanwisher,et al.  Domain specificity in visual cortex. , 2006, Cerebral cortex.

[33]  R. VanRullen,et al.  Faces in the cloud: Fourier power spectrum biases ultrarapid face detection. , 2008, Journal of vision.

[34]  Neil A. Macmillan,et al.  Detection theory: A user's guide, 2nd ed. , 2005 .

[35]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[36]  Simon J. Thorpe,et al.  Ultra-rapid object detection with saccadic eye movements: Visual processing speed revisited , 2006, Vision Research.

[37]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[38]  Keiji Tanaka,et al.  Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. , 2007, Journal of neurophysiology.

[39]  J. Gold,et al.  Banburismus and the Brain Decoding the Relationship between Sensory Stimuli, Decisions, and Reward , 2002, Neuron.

[40]  James L. McClelland,et al.  The time course of perceptual choice: the leaky, competing accumulator model. , 2001, Psychological review.