From a face to its category via a few information processing states in the brain

Cognitive neuroscience assumes a correspondence between specific spatio-temporal patterns of neural activity and the states of a mechanism that processes cognitive information. Mechanistic explanations of cognition should therefore translate patterns of neural activity into the components of a formal mechanism: a set of information processing states and their transitions. For the first time, we carried out this research programme with four naive observers instructed to categorise randomly presented face information. With classification image techniques, we revealed the diagnostic features that the brain requires to produce correct behaviour (i.e., two eyes for gender categorisation in one session; the mouth for expression in the other session). With the same techniques applied to brain signals, we revealed the features processing states associated with modulations of oscillatory EEG energy (measured on occipito-temporal face-sensitive electrodes). Here we show how transitions between distinct feature processing states in the theta/alpha [4-12 Hz] oscillatory bands implement two face categorisations. On the left and right occipito-temporal electrodes of each observer, processing of the contra-lateral eye precedes bilateral integration of the features required for behaviour. For the first time, we relate stimulus information to behaviour via sequences of categorisation-specific feature processing states in the brain.

[1]  E. Basar,et al.  Brain oscillations in perception and memory. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[2]  M. Seghier,et al.  A network of occipito-temporal face-sensitive areas besides the right middle fusiform gyrus is necessary for normal face processing. , 2003, Brain : a journal of neurology.

[3]  M. Eimer Effects of face inversion on the structural encoding and recognition of faces. Evidence from event-related brain potentials. , 2000, Brain research. Cognitive brain research.

[4]  V. Goffaux,et al.  Spatio-temporal localization of the face inversion effect: an event-related potentials study , 1999, Biological Psychology.

[5]  W. Klimesch EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[6]  L. M. Ward,et al.  Synchronous neural oscillations and cognitive processes , 2003, Trends in Cognitive Sciences.

[7]  G. Buzsáki Theta Oscillations in the Hippocampus , 2002, Neuron.

[8]  S. Jeune,et al.  Diagnostic , 1982, Thromboses Veineuses Distales et Superficielles.

[9]  T. Sejnowski,et al.  Synchronous oscillatory activity in sensory systems: new vistas on mechanisms , 1997, Current Opinion in Neurobiology.

[10]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[11]  E. Large,et al.  The dynamics of attending: How people track time-varying events. , 1999 .

[12]  N. Sigala,et al.  Visual categorization shapes feature selectivity in the primate temporal cortex , 2002, Nature.

[13]  O. Bertrand,et al.  Oscillatory gamma activity in humans and its role in object representation , 1999, Trends in Cognitive Sciences.

[14]  Philippe G Schyns,et al.  Accurate statistical tests for smooth classification images. , 2005, Journal of vision.

[15]  F. Varela,et al.  A quantitative assessment of the dependency of the visual temporal frame upon the cortical rhythm. , 1988, Journal de physiologie.

[16]  Garrison W. Cottrell,et al.  Transmitting and Decoding Facial Expressions , 2005, Psychological science.

[17]  A. Burton,et al.  Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. , 2002, Brain research. Cognitive brain research.

[18]  Dawn R. Collins,et al.  Amygdala oscillations and the consolidation of emotional memories , 2002, Trends in Cognitive Sciences.

[19]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[20]  Spatz Wb Unipolar brush cells in marmoset cerebellum and cochlear nuclei express calbindin. , 2000 .

[21]  John J. Foxe,et al.  Attention-dependent suppression of distracter visual input can be cross-modally cued as indexed by anticipatory parieto-occipital alpha-band oscillations. , 2001, Brain research. Cognitive brain research.

[22]  Frédéric Gosselin,et al.  A Principled Method for Determining the Functionality of ERP Components. , 2003 .

[23]  Kristina J. Nielsen,et al.  Dissociation Between Local Field Potentials and Spiking Activity in Macaque Inferior Temporal Cortex Reveals Diagnosticity-Based Encoding of Complex Objects , 2006, The Journal of Neuroscience.

[24]  J. Fell,et al.  Memory formation by neuronal synchronization , 2006, Brain Research Reviews.

[25]  Kristina J. Nielsen,et al.  Object Recognition: Similar Visual Strategies of Birds and Mammals , 2007, Current Biology.

[26]  P König,et al.  Synchronization of oscillatory neuronal responses between striate and extrastriate visual cortical areas of the cat. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[27]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[28]  Philippe G Schyns,et al.  Perceptual moments of conscious visual experience inferred from oscillatory brain activity. , 2006, Proceedings of the National Academy of Sciences of the United States of America.

[29]  E. John,et al.  Perceptual framing and cortical alpha rhythm , 1981, Neuropsychologia.

[30]  David J. Freedman,et al.  A Comparison of Primate Prefrontal and Inferior Temporal Cortices during Visual Categorization , 2003, The Journal of Neuroscience.

[31]  C. Koch,et al.  Is perception discrete or continuous? , 2003, Trends in Cognitive Sciences.

[32]  G. V. Simpson,et al.  Parieto‐occipital ∼1 0Hz activity reflects anticipatory state of visual attention mechanisms , 1998 .

[33]  N. Ambady,et al.  Effects of Gaze on Amygdala Sensitivity to Anger and Fear Faces , 2003, Science.

[34]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[35]  P. Schyns,et al.  A mechanism for impaired fear recognition after amygdala damage , 2005, Nature.

[36]  P. Schyns,et al.  Receptive Fields for Flexible Face Categorizations , 2004, Psychological science.

[37]  Wolf Singer,et al.  Time as coding space? , 1999, Current Opinion in Neurobiology.

[38]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[39]  Charles A. Nelson,et al.  Hemispheric differences in brain activity related to the recognition of emotional expressions by 5‐year‐old children , 1998 .

[40]  Clara D. Martin,et al.  Controlling for interstimulus perceptual variance abolishes N170 face selectivity , 2007, Nature Neuroscience.

[41]  M. Tarr,et al.  The N170 occipito‐temporal component is delayed and enhanced to inverted faces but not to inverted objects: an electrophysiological account of face‐specific processes in the human brain , 2000, Neuroreport.

[42]  P. Schyns,et al.  Show Me the Features! Understanding Recognition From the Use of Visual Information , 2002, Psychological science.

[43]  P. Schyns,et al.  A principled method for determining the functionality of brain responses , 2003, Neuroreport.

[44]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[45]  K. Rayner Eye movements in reading and information processing: 20 years of research. , 1998, Psychological bulletin.

[46]  Philippe G Schyns,et al.  Diagnostic recognition: task constraints, object information, and their interactions , 1998, Cognition.

[47]  B. Rossion,et al.  Spatial attention triggered by eye gaze increases and speeds up early visual activity , 2001, Neuroreport.

[48]  M. Tarr,et al.  Expertise Training with Novel Objects Leads to Left-Lateralized Facelike Electrophysiological Responses , 2002, Psychological science.

[49]  Frédéric Gosselin,et al.  Bubbles: a technique to reveal the use of information in recognition tasks , 2001, Vision Research.

[50]  N. Sagiv,et al.  Structural Encoding of Human and Schematic Faces: Holistic and Part-Based Processes , 2001, Journal of Cognitive Neuroscience.

[51]  J. Gambini,et al.  Hippocampal theta rhythm synchronizes visual neurons in sleep and waking , 2002, Brain Research.

[52]  W. Singer,et al.  Rapid feature selective neuronal synchronization through correlated latency shifting , 2001, Nature Neuroscience.

[53]  M. Eimer,et al.  An ERP study on the time course of emotional face processing , 2002, Neuroreport.

[54]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.