Perceptual difficulty modulates the direction of information flow in familiar face recognition

Humans are fast and accurate when they recognize familiar faces. Previous neurophysiological studies have shown enhanced representations for the dichotomy of familiar vs. unfamiliar faces. As familiarity is a spectrum, however, any neural correlate should reflect graded representations for more vs. less familiar faces along the spectrum. By systematically varying familiarity across stimuli, we show a neural familiarity spectrum using electroencephalography. We then evaluated the spatiotemporal dynamics of familiar face recognition across the brain. Specifically, we developed a novel informational connectivity method to test whether peri-frontal brain areas contribute to familiar face recognition. Results showed that feed-forward flow dominates for the most familiar faces and top-down flow was only dominant when sensory evidence was insufficient to support face recognition. These results demonstrate that perceptual difficulty and the level of familiarity influence the neural representation of familiar faces and the degree to which peri-frontal neural networks contribute to familiar face recognition.

[1]  Mohammad Bagher Menhaj,et al.  Spatiotemporal analysis of category and target-related information processing in the brain during object detection , 2018, Behavioural Brain Research.

[2]  C. Gilbert,et al.  Brain States: Top-Down Influences in Sensory Processing , 2007, Neuron.

[3]  Hamid Karimi-Rouzbahani,et al.  Three-stage processing of category and variation information by entangled interactive mechanisms of peri-occipital and peri-frontal cortices , 2018, Scientific Reports.

[4]  A. Young,et al.  Understanding face familiarity , 2018, Cognition.

[5]  Radoslaw Martin Cichy,et al.  The Neural Dynamics of Familiar Face Recognition. , 2019, Cerebral cortex.

[6]  M. Fabre-Thorpe,et al.  From face processing to face recognition: Comparing three different processing levels , 2017, Cognition.

[7]  Laura Marzetti,et al.  Multi-dimensional connectivity: a conceptual and mathematical review , 2020, NeuroImage.

[8]  Marcia K. Johnson,et al.  A brief thought can modulate activity in extrastriate visual areas: Top-down effects of refreshing just-seen visual stimuli , 2007, NeuroImage.

[9]  Nasour Bagheri,et al.  Hard-wired feed-forward visual mechanisms of the brain compensate for affine variations in object recognition , 2017, Neuroscience.

[10]  A. Burton,et al.  Event-related brain potential evidence for a response of inferior temporal cortex to familiar face repetitions. , 2002, Brain research. Cognitive brain research.

[11]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[12]  Harvey A Swadlow,et al.  Task difficulty modulates the activity of specific neuronal populations in primary visual cortex , 2008, Nature Neuroscience.

[13]  Dimitrios Pantazis,et al.  Ultra-Rapid serial visual presentation reveals dynamics of feedforward and feedback processes in the ventral visual pathway , 2018, bioRxiv.

[14]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[15]  Gyula Kovács,et al.  Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain , 2020, Journal of Cognitive Neuroscience.

[16]  Sean M. Polyn,et al.  Beyond mind-reading: multi-voxel pattern analysis of fMRI data , 2006, Trends in Cognitive Sciences.

[17]  Marc N. Coutanche,et al.  Beyond Functional Connectivity: Investigating Networks of Multivariate Representations , 2018, Trends in Cognitive Sciences.

[18]  Tai Sing Lee,et al.  Hierarchical Bayesian inference in the visual cortex. , 2003, Journal of the Optical Society of America. A, Optics, image science, and vision.

[19]  Karla K. Evans,et al.  Spontaneous retrieval of affective person knowledge in face perception , 2007, Neuropsychologia.

[20]  Anina N. Rich,et al.  Neural signatures of vigilance decrements predict behavioural errors before they occur , 2020, bioRxiv.

[21]  Richard N. A. Henson,et al.  Electrophysiological correlates of masked face priming , 2008, NeuroImage.

[22]  W. Newsome,et al.  Neural basis of a perceptual decision in the parietal cortex (area LIP) of the rhesus monkey. , 2001, Journal of neurophysiology.

[23]  M. Bar,et al.  Top-down predictions in the cognitive brain , 2007, Brain and Cognition.

[24]  Margot J. Taylor,et al.  Neural correlates of personally familiar faces: Parents, partner and own faces , 2009, Human brain mapping.

[25]  Alex Clarke,et al.  Oscillatory dynamics of perceptual to conceptual transformations in the ventral visual pathway , 2018, bioRxiv.

[26]  M. Bar,et al.  Top-down facilitation of visual object recognition: object-based and context-based contributions. , 2006, Progress in brain research.

[27]  Jennifer A. Mangels,et al.  Predictive Codes for Forthcoming Perception in the Frontal Cortex , 2006, Science.

[28]  H. Karimi-Rouzbahani,et al.  Temporal variabilities provide additional category-related information 1 in object category decoding : a systematic comparison of informative 2 EEG features 3 4 , 2021 .

[29]  Marlene Behrmann,et al.  Distinct neural processes for the perception of familiar versus unfamiliar faces along the visual hierarchy revealed by EEG , 2018, NeuroImage.

[30]  Nasour Bagheri,et al.  Average activity, but not variability, is the dominant factor in the representation of object categories in the brain , 2017, Neuroscience.

[31]  A. Mognon,et al.  ADJUST: An automatic EEG artifact detector based on the joint use of spatial and temporal features. , 2011, Psychophysiology.

[32]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[33]  Nikolaus Kriegeskorte,et al.  Recurrence is required to capture the representational dynamics of the human visual system , 2019, Proceedings of the National Academy of Sciences.

[34]  Zhe Qu,et al.  Revisiting the earliest electrophysiological correlate of familiar face recognition. , 2017, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[35]  Ellen Leibenluft,et al.  Social and emotional attachment in the neural representation of faces , 2004, NeuroImage.

[36]  D. Heeger,et al.  Activity in primary visual cortex predicts performance in a visual detection task , 2000, Nature Neuroscience.

[37]  P. Sajda,et al.  Temporal characterization of the neural correlates of perceptual decision making in the human brain. , 2006, Cerebral cortex.

[38]  Takayuki Nozawa,et al.  Neural Mechanism for Mirrored Self-face Recognition , 2014, Cerebral cortex.

[39]  Michèle Fabre-Thorpe,et al.  Interaction of top-down and bottom-up processing in the fast visual analysis of natural scenes. , 2004, Brain research. Cognitive brain research.

[40]  Timothy D. Hanks,et al.  Perceptual Decision Making in Rodents, Monkeys, and Humans , 2017, Neuron.

[41]  A. Young,et al.  Are We Face Experts? , 2018, Trends in Cognitive Sciences.

[42]  T. Andrews,et al.  Intra- and interhemispheric connectivity between face-selective regions in the human brain. , 2012, Journal of neurophysiology.

[43]  Florence Thibaut,et al.  ERPs ASSOCIATED WITH FAMILIARITY AND DEGREE OF FAMILIARITY DURING FACE RECOGNITION , 2002, The International journal of neuroscience.

[44]  Peng Zhang,et al.  The bottom-up and top-down processing of faces in the human occipitotemporal cortex , 2020, eLife.

[45]  H. Ellis,et al.  Identification of Familiar and Unfamiliar Faces from Internal and External Features: Some Implications for Theories of Face Recognition , 1979, Perception.

[46]  R. Hess,et al.  What causes non-monotonic tuning of fMRI response to noisy images? , 2002, Current Biology.

[47]  M. Ida Gobbini,et al.  Familiar Face Detection in 180ms , 2015, PloS one.

[48]  R. Desimone,et al.  High-Frequency, Long-Range Coupling Between Prefrontal and Visual Cortex During Attention , 2009, Science.

[49]  J. Duncan,et al.  Adaptive Coding of Task-Relevant Information in Human Frontoparietal Cortex , 2011, The Journal of Neuroscience.

[50]  D G Pelli,et al.  The VideoToolbox software for visual psychophysics: transforming numbers into movies. , 1997, Spatial vision.

[51]  L. Busse,et al.  Robust effects of cortical feedback on thalamic firing mode during naturalistic stimulation , 2019 .

[52]  E. Leibenluft,et al.  Mothers' neural activation in response to pictures of their children and other children , 2004, Biological Psychiatry.

[53]  Nasour Bagheri,et al.  Invariant object recognition is a personalized selection of invariant features in humans, not simply explained by hierarchical feed-forward vision models , 2017, Scientific Reports.

[54]  N. Kanwisher,et al.  How face perception unfolds over time , 2018, Nature Communications.

[55]  C. Gilbert,et al.  Top-down influences on visual processing , 2013, Nature Reviews Neuroscience.

[56]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[57]  Vaidehi S. Natu,et al.  Category-Specific Cortical Activity Precedes Retrieval During Memory Search , 2005, Science.

[58]  Manfred Fahle,et al.  Ultra Rapid Object Categorization: Effects of Level, Animacy and Context , 2013, PloS one.

[59]  Karl J. Friston,et al.  Where bottom-up meets top-down: neuronal interactions during perception and imagery. , 2004, Cerebral cortex.

[60]  Thomas A. Carlson,et al.  Representational dynamics of object recognition: Feedforward and feedback information flows , 2016, NeuroImage.

[61]  Kendrick N Kay,et al.  Bottom-up and top-down computations in word- and face-selective cortex , 2017, eLife.

[62]  Thomas A. Carlson,et al.  Spatial and feature-selective attention have distinct effects on population-level tuning , 2019, bioRxiv.

[63]  Michael S. Pratte,et al.  How attention extracts objects from noise. , 2013, Journal of neurophysiology.

[64]  R. Ratcliff,et al.  Neural Representation of Task Difficulty and Decision Making during Perceptual Categorization: A Timing Diagram , 2006, The Journal of Neuroscience.

[65]  Bruno Rossion,et al.  Neural microgenesis of personally familiar face recognition , 2015, Proceedings of the National Academy of Sciences.

[66]  H. Spekreijse,et al.  Masking Interrupts Figure-Ground Signals in V1 , 2002, Journal of Cognitive Neuroscience.

[67]  Radoslaw Martin Cichy,et al.  The representational dynamics of task and object processing in humans , 2018, eLife.

[68]  Galit Yovel,et al.  A Revised Neural Framework for Face Processing. , 2015, Annual review of vision science.

[69]  C. Summerfield,et al.  Expectation (and attention) in visual cognition , 2009, Trends in Cognitive Sciences.

[70]  Andrew W. Young,et al.  A Robust Neural Index of High Face Familiarity , 2018, Psychological science.

[71]  S. Kelly,et al.  Internal and External Influences on the Rate of Sensory Evidence Accumulation in the Human Brain , 2013, The Journal of Neuroscience.

[72]  Ingrid R. Olson,et al.  Beyond the FFA: The role of the ventral anterior temporal lobes in face processing , 2014, Neuropsychologia.

[73]  Patrik Vuilleumier,et al.  Processing social aspects of human gaze: A combined fMRI-DTI study , 2011, NeuroImage.

[74]  M. Gobbini,et al.  Familiarity matters: A review on prioritized processing of personally familiar faces , 2018 .

[75]  P. Banks,et al.  Neuroscience and Biobehavioral Reviews in Search of a Recognition Memory Engram , 2022 .

[76]  D H Brainard,et al.  The Psychophysics Toolbox. , 1997, Spatial vision.

[77]  H. Spekreijse,et al.  Two distinct modes of sensory processing observed in monkey primary visual cortex (V1) , 2001, Nature Neuroscience.

[78]  G. V. Simpson,et al.  Flow of activation from V1 to frontal cortex in humans , 2001, Experimental Brain Research.

[79]  J. M. Hupé,et al.  Cortical feedback improves discrimination between figure and background by V1, V2 and V3 neurons , 1998, Nature.

[80]  Anina N. Rich,et al.  Flexible Coding of Task Rules in Frontoparietal Cortex: An Adaptive System for Flexible Cognitive Control , 2015, Journal of Cognitive Neuroscience.

[81]  C. Nelson,et al.  Tuning the developing brain to social signals of emotions , 2009, Nature Reviews Neuroscience.

[82]  A. Mike Burton,et al.  N250 ERP Correlates of the Acquisition of Face Representations across Different Images , 2009, Journal of Cognitive Neuroscience.

[83]  Winrich A Freiwald,et al.  Two areas for familiar face recognition in the primate brain , 2017, Science.