Fast temporal dynamics and causal relevance of face processing in the human temporal cortex

Recordings with a large number of intracranial electrodes in eight neurosurgical subjects offered a unique opportunity to examine the fast temporal dynamics of face processing simultaneously across a relatively large extent of the human temporal cortex (TC). Measuring the power of slow oscillatory bands of activity (θ, α, β, and γ) as well as High-Frequency Broadband (HFB, 70-177 Hz) signal, we found that the HFB showed the strongest univariate and multivariate changes in response to face compared to non-face stimuli. Using the HFB signal as a surrogate marker for local cortical engagement, we identified recording sites with selective responses to faces that were anatomically consistent across subjects and responded with graded strength to human, mammal, bird, and marine animal faces. Importantly, the most face selective sites were located more posteriorly and responded earlier than those with less selective responses to faces. Using machine learning based methods, we demonstrated that a sparse model focusing on information from the human face selective sites performed as well as, or better than, anatomically distributed models of face processing when discriminating faces from non-faces stimuli. Lastly, we identified the posterior fusiform (pFUS) site as causally the most relevant node for inducing distortion of face perception by direct electrical stimulation. Our findings support the notion of face information being processed first in the most selective sites - that are anatomically discrete and localizable within individual brains and anatomically consistent across subjects – which is then distributed in time to less selective anterior temporal sites within a time window that is too fast to be detected by current neuroimaging methods. The new information about the fast spatio-temporal dynamics of face processing across multiple sites of the human brain provides a new common ground for unifying the seemingly contradictory modular and distributed models of face processing in the human brain.

[1]  J. Sergent,et al.  Functional neuroanatomy of face and object processing. A positron emission tomography study. , 1992, Brain : a journal of neurology.

[2]  Zarrar Shehzad,et al.  Category representations in the brain are both discretely localized and widely distributed. , 2018, Journal of neurophysiology.

[3]  M M Mesulam,et al.  Large‐scale neurocognitive networks and distributed processing for attention, language, and memory , 1990, Annals of neurology.

[4]  Nancy Kanwisher,et al.  Facephenes and rainbows: Causal evidence for functional and anatomical specificity of face and color processing in the human brain , 2017, Proceedings of the National Academy of Sciences.

[5]  Bruno Rossion,et al.  Beyond the core face-processing network: Intracerebral stimulation of a face-selective area in the right anterior fusiform gyrus elicits transient prosopagnosia , 2015, Cortex.

[6]  David M. Groppe,et al.  Exemplar selectivity reflects perceptual similarities in the human fusiform cortex. , 2014, Cerebral cortex.

[7]  John A. Pyles,et al.  Exploring the spatio-temporal neural basis of face learning , 2017, Journal of Vision.

[8]  James J. DiCarlo,et al.  How Does the Brain Solve Visual Object Recognition? , 2012, Neuron.

[9]  Wei Ji Ma,et al.  Bayesian microsaccade detection , 2017, Journal of vision.

[10]  Stefan Haufe,et al.  On the interpretation of weight vectors of linear models in multivariate neuroimaging , 2014, NeuroImage.

[11]  T. Allison,et al.  Face-sensitive regions in human extrastriate cortex studied by functional MRI. , 1995, Journal of neurophysiology.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  R. Desimone,et al.  Visual properties of neurons in a polysensory area in superior temporal sulcus of the macaque. , 1981, Journal of neurophysiology.

[14]  R. Lesser,et al.  Functional mapping of human sensorimotor cortex with electrocorticographic spectral analysis. II. Event-related synchronization in the gamma band. , 1998, Brain : a journal of neurology.

[15]  V. Rangarajan,et al.  Functional asymmetry between the left and right human fusiform gyrus explored through electrical brain stimulation , 2016, Neuropsychologia.

[16]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[17]  Josef Parvizi,et al.  Decoding intracranial EEG data with multiple kernel learning method , 2016, Journal of Neuroscience Methods.

[18]  Nick F. Ramsey,et al.  Automated electrocorticographic electrode localization on individually rendered brain surfaces , 2010, Journal of Neuroscience Methods.

[19]  J. C. Meadows The anatomical basis of prosopagnosia , 1974, Journal of neurology, neurosurgery, and psychiatry.

[20]  T. Poggio,et al.  Object Selectivity of Local Field Potentials and Spikes in the Macaque Inferior Temporal Cortex , 2006, Neuron.

[21]  Janaina Mourão Miranda,et al.  PRoNTo: Pattern Recognition for Neuroimaging Toolbox , 2013, Neuroinformatics.

[22]  D. Plaut,et al.  Spatiotemporal dynamics of similarity-based neural representations of facial identity , 2016, Proceedings of the National Academy of Sciences.

[23]  W. Singer,et al.  Hemodynamic Signals Correlate Tightly with Synchronized Gamma Oscillations , 2005, Science.

[24]  D. Plaut,et al.  Distributed circuits, not circumscribed centers, mediate visual recognition , 2013, Trends in Cognitive Sciences.

[25]  Philippe Kahane,et al.  Functional selectivity in the human occipitotemporal cortex during natural vision: Evidence from combined intracranial EEG and eye-tracking , 2014, NeuroImage.

[26]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[27]  Tonio Ball,et al.  Causal interpretation rules for encoding and decoding models in neuroimaging , 2015, NeuroImage.

[28]  John A. Pyles,et al.  Dynamic Encoding of Face Information in the Human Fusiform Gyrus , 2014, Nature Communications.

[29]  Jeremy R. Manning,et al.  Broadband Shifts in Local Field Potential Power Spectra Are Correlated with Single-Neuron Spiking in Humans , 2009, The Journal of Neuroscience.

[30]  W. Newsome,et al.  Local Field Potential in Cortical Area MT: Stimulus Tuning and Behavioral Correlations , 2006, The Journal of Neuroscience.

[31]  K. Grill-Spector,et al.  Electrical Stimulation of the Left and Right Human Fusiform Gyrus Causes Different Effects in Conscious Face Perception , 2014, The Journal of Neuroscience.

[32]  I. Fried,et al.  Interhemispheric correlations of slow spontaneous neuronal fluctuations revealed in human sensory cortex , 2008, Nature Neuroscience.

[33]  Doris Y. Tsao,et al.  Faces and objects in macaque cerebral cortex , 2003, Nature Neuroscience.

[34]  K. Grill-Spector,et al.  Electrical Stimulation of Human Fusiform Face-Selective Regions Distorts Face Perception , 2012, The Journal of Neuroscience.

[35]  N. Logothetis,et al.  Neurophysiology of the BOLD fMRI Signal in Awake Monkeys , 2008, Current Biology.

[36]  J. Maunsell,et al.  Different Origins of Gamma Rhythm and High-Gamma Activity in Macaque Visual Cortex , 2011, PLoS biology.

[37]  G. V. Van Hoesen,et al.  Prosopagnosia , 1982, Neurology.

[38]  Janaina Mourão Miranda,et al.  Interpreting weight maps in terms of cognitive or clinical neuroscience: nonsense? , 2018, 2018 International Workshop on Pattern Recognition in Neuroimaging (PRNI).

[39]  Joseph R. Madsen,et al.  Spatiotemporal Dynamics Underlying Object Completion in Human Ventral Visual Cortex , 2014, Neuron.

[40]  Tom M. Mitchell,et al.  Machine learning classifiers and fMRI: A tutorial overview , 2009, NeuroImage.

[41]  Leslie G. Ungerleider,et al.  Face encoding and recognition in the human brain. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Leslie G. Ungerleider,et al.  ‘What’ and ‘where’ in the human brain , 1994, Current Opinion in Neurobiology.

[43]  J. Winawer,et al.  Linking Electrical Stimulation of Human Primary Visual Cortex, Size of Affected Cortical Area, Neuronal Responses, and Subjective Experience , 2016, Neuron.

[44]  Ashesh D. Mehta,et al.  Tuning face perception with electrical stimulation of the fusiform gyrus , 2017, Human brain mapping.

[45]  T. Allison,et al.  Electrophysiological studies of human face perception. III: Effects of top-down processing on face-specific potentials. , 1999, Cerebral cortex.

[46]  R. Kiani,et al.  Microstimulation of inferotemporal cortex influences face categorization , 2006, Nature.

[47]  Janaina Mourão Miranda,et al.  Embedding Anatomical or Functional Knowledge in Whole-Brain Multiple Kernel Learning Models , 2018, Neuroinformatics.

[48]  B. A. Baldwin,et al.  Cells in temporal cortex of conscious sheep can respond preferentially to the sight of faces. , 1987, Science.

[49]  Katrin Amunts,et al.  The Cytoarchitecture of Domain-specific Regions in Human High-level Visual Cortex , 2016, Cerebral cortex.

[50]  I. Fried,et al.  Coupling Between Neuronal Firing, Field Potentials, and fMRI in Human Auditory Cortex , 2005, Science.

[51]  Kalanit Grill-Spector,et al.  On object selectivity and the anatomy of the human fusiform gyrus , 2018, NeuroImage.

[52]  Josef Parvizi,et al.  Corresponding ECoG and fMRI category-selective signals in human ventral temporal cortex , 2016, Neuropsychologia.

[53]  R. Knight,et al.  The functional role of cross-frequency coupling , 2010, Trends in Cognitive Sciences.

[54]  N. Logothetis,et al.  Neurophysiological investigation of the basis of the fMRI signal , 2001, Nature.

[55]  David A. Leopold,et al.  Functional Subpopulations of Neurons in a Macaque Face Patch Revealed by Single-Unit fMRI Mapping , 2017, Neuron.

[56]  I. Fried,et al.  Coupling between Neuronal Firing Rate, Gamma LFP, and BOLD fMRI Is Related to Interneuronal Correlations , 2007, Current Biology.

[57]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[58]  Doris Y. Tsao,et al.  The effect of face patch microstimulation on perception of faces and objects , 2017, Nature Neuroscience.

[59]  Daniel Yoshor,et al.  Perceiving Electrical Stimulation of Identified Human Visual Areas , 2009, NeuroImage.

[60]  Josef Parvizi,et al.  Promises and limitations of human intracranial electroencephalography , 2018, Nature Neuroscience.

[61]  Self-face hallucination evoked by electrical stimulation of the human brain , 2014, Neurology.

[62]  E. Niebur,et al.  Neural Correlates of High-Gamma Oscillations (60–200 Hz) in Macaque Local Field Potentials and Their Potential Implications in Electrocorticography , 2008, The Journal of Neuroscience.