Facephenes and rainbows: Causal evidence for functional and anatomical specificity of face and color processing in the human brain

Significance Are some regions of the human brain exclusively engaged in a single specific mental process? Here we test this question in a neurosurgery patient implanted with electrodes for clinical reasons. When electrically stimulated in the fusiform face area while viewing objects, the patient reported illusory faces while the objects remained unchanged. When stimulated in nearby color-preferring sites, he reported seeing rainbows. The fact that stimulation of face-selective sites affected only face percepts and stimulation of color-preferring sites affected only color percepts, in both cases independent of the object being viewed, supports the view that some regions of cortex are indeed exclusively causally engaged in a single mental process and highlights the risks entailed in standard interpretations of neural decoding results. Neuroscientists have long debated whether some regions of the human brain are exclusively engaged in a single specific mental process. Consistent with this view, fMRI has revealed cortical regions that respond selectively to certain stimulus classes such as faces. However, results from multivoxel pattern analyses (MVPA) challenge this view by demonstrating that category-selective regions often contain information about “nonpreferred” stimulus dimensions. But is this nonpreferred information causally relevant to behavior? Here we report a rare opportunity to test this question in a neurosurgical patient implanted for clinical reasons with strips of electrodes along his fusiform gyri. Broadband gamma electrocorticographic responses in multiple adjacent electrodes showed strong selectivity for faces in a region corresponding to the fusiform face area (FFA), and preferential responses to color in a nearby site, replicating earlier reports. To test the causal role of these regions in the perception of nonpreferred dimensions, we then electrically stimulated individual sites while the patient viewed various objects. When stimulated in the FFA, the patient reported seeing an illusory face (or “facephene”), independent of the object viewed. Similarly, stimulation of color-preferring sites produced illusory “rainbows.” Crucially, the patient reported no change in the object viewed, apart from the facephenes and rainbows apparently superimposed on them. The functional and anatomical specificity of these effects indicate that some cortical regions are exclusively causally engaged in a single specific mental process, and prompt caution about the widespread assumption that any information scientists can decode from the brain is causally relevant to behavior.

[1]  Alex R. Wade,et al.  Functional measurements of human ventral occipital cortex: retinotopy and colour. , 2002, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[2]  N. Kanwisher Functional specificity in the human brain: A window into the functional architecture of the mind , 2010, Proceedings of the National Academy of Sciences.

[3]  J. Wagemans,et al.  Is neuroimaging measuring information in the brain? , 2016, Psychonomic Bulletin & Review.

[4]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[5]  S. Zeki,et al.  The architecture of the colour centre in the human visual brain: new results and a review * , 2000, The European journal of neuroscience.

[6]  P. Cavanagh,et al.  Retinotopy and color sensitivity in human visual cortical area V8 , 1998, Nature Neuroscience.

[7]  J. Devlin,et al.  Triple Dissociation of Faces, Bodies, and Objects in Extrastriate Cortex , 2009, Current Biology.

[8]  Daniel Yoshor,et al.  Perceiving Electrical Stimulation of Identified Human Visual Areas , 2009, NeuroImage.

[9]  Wilbert Zarco,et al.  A causal relationship between face-patch activity and face-detection behavior , 2017, eLife.

[10]  R. Kiani,et al.  Microstimulation of inferotemporal cortex influences face categorization , 2006, Nature.

[11]  Viv Wright Over here. , 2004, British journal of perioperative nursing : the journal of the National Association of Theatre Nurses.

[12]  J. Duncan,et al.  Common regions of the human frontal lobe recruited by diverse cognitive demands , 2000, Trends in Neurosciences.

[13]  Mehrdad Jazayeri,et al.  Navigating the Neural Space in Search of the Neural Code , 2017, Neuron.

[14]  N. Kanwisher,et al.  Repetition blindness and illusory conjunctions: errors in binding visual types with visual tokens. , 1991, Journal of experimental psychology. Human perception and performance.

[15]  Tolga Çukur,et al.  Functional Subdomains within Human FFA , 2013, The Journal of Neuroscience.

[16]  Bevil R. Conway,et al.  Color-tuned neurons are spatially clustered according to color preference within alert macaque posterior inferior temporal cortex , 2009, Proceedings of the National Academy of Sciences.

[17]  S. Zeki,et al.  The position and topography of the human colour centre as revealed by functional magnetic resonance imaging. , 1997, Brain : a journal of neurology.

[18]  Charles Pelizzari,et al.  Transient Inability to Distinguish Between Faces: Electrophysiologic Studies , 2003, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[19]  K. Grill-Spector,et al.  Electrical Stimulation of Human Fusiform Face-Selective Regions Distorts Face Perception , 2012, The Journal of Neuroscience.

[20]  J. DiCarlo,et al.  Optogenetic and pharmacological suppression of spatial clusters of face neurons reveal their causal role in face gender discrimination , 2015, Proceedings of the National Academy of Sciences.

[21]  Leila Reddy,et al.  Category Selectivity in the Ventral Visual Pathway Confers Robustness to Clutter and Diverted Attention , 2007, Current Biology.

[22]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[23]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[24]  N. Kanwisher,et al.  Only some spatial patterns of fMRI response are read out in task performance , 2007, Nature Neuroscience.

[25]  Elias B. Issa,et al.  Precedence of the Eye Region in Neural Processing of Faces , 2012, The Journal of Neuroscience.

[26]  T Yamamoto,et al.  Selective impairment of facial recognition due to a haematoma restricted to the right fusiform and lateral occipital region , 2001, Journal of neurology, neurosurgery, and psychiatry.

[27]  Bevil R. Conway,et al.  Color-Biased Regions of the Ventral Visual Pathway Lie between Face- and Place-Selective Regions in Humans, as in Macaques , 2016, The Journal of Neuroscience.

[28]  D. Kahneman,et al.  The reviewing of object files: Object-specific integration of information , 1992, Cognitive Psychology.

[29]  Doris Y. Tsao,et al.  The effect of face patch microstimulation on perception of faces and objects , 2017, Nature Neuroscience.

[30]  Bevil R. Conway,et al.  Specialized Color Modules in Macaque Extrastriate Cortex , 2007, Neuron.

[31]  Nancy Kanwisher,et al.  Broad domain generality in focal regions of frontal and parietal cortex , 2013, Proceedings of the National Academy of Sciences.

[32]  N. Kanwisher,et al.  Visual word processing and experiential origins of functional selectivity in human extrastriate cortex , 2007, Proceedings of the National Academy of Sciences.

[33]  Stanley Finger,et al.  Origins of neuroscience: A history of explorations into brain function. , 1994 .

[34]  T A Polk,et al.  The neural development and organization of letter recognition: evidence from functional neuroimaging, computational modeling, and behavioral studies. , 1998, Proceedings of the National Academy of Sciences of the United States of America.

[35]  K. Grill-Spector,et al.  Electrical Stimulation of the Left and Right Human Fusiform Gyrus Causes Different Effects in Conscious Face Perception , 2014, The Journal of Neuroscience.

[36]  Nancy Kanwisher,et al.  The Quest for the FFA and Where It Led , 2017, The Journal of Neuroscience.