The Neural Mechanisms of Face Ensemble Processing: Decoding Facial Summary Statistics from ERP Signals

Previous behavioural work has demonstrated our ability to extract summary statistics from groups of faces such as identity. Because we know very little how the extraction of summary statistics for identity occurs in the cortex, I used electroencephalography (EEG) to explore the neural basis of identity summary statistics . I collected EEG data while participants viewed face ensembles or single faces presented one at a time. Different ensembles were designed so that they contained the same average face. Pattern analyses were then conducted across signals recorded from 12 occipitotemporal electrodes. The analyses revealed that ensembles with different averages could be decoded from one another suggesting that we possess a mechanism capable of summarizing identity well enough that the neural signal for one ensemble is decodable from that of an ensemble with a different average. This thesis investigation sheds new light on the neural basis of ensemble processing of identity.

[1]  G. Kovács,et al.  Neural correlates of after-effects caused by adaptation to multiple face displays , 2012, Experimental Brain Research.

[2]  M. Herrmann,et al.  Early stages (P100) of face perception in humans as measured with event-related potentials (ERPs) , 2004, Journal of Neural Transmission.

[3]  T. Sejnowski,et al.  Removal of eye activity artifacts from visual event-related potentials in normal and clinical subjects , 2000, Clinical Neurophysiology.

[4]  Timothy D. Sweeny,et al.  Detecting and categorizing fleeting emotions in faces. , 2013, Emotion.

[5]  Jason M Haberman,et al.  Seeing the mean: ensemble coding for sets of faces. , 2009, Journal of experimental psychology. Human perception and performance.

[6]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[7]  J. D. de Fockert,et al.  Rapid extraction of mean identity from sets of faces. , 2009, Quarterly journal of experimental psychology.

[8]  Matthias Niemeier,et al.  The time course of individual face recognition: A pattern analysis of ERP signals , 2016, NeuroImage.

[9]  Radoslaw Martin Cichy,et al.  Resolving human object recognition in space and time , 2014, Nature Neuroscience.

[10]  T. Allison,et al.  Face recognition in human extrastriate cortex. , 1994, Journal of neurophysiology.

[11]  Bao-Liang Lu,et al.  EEG-based emotion recognition during watching movies , 2011, 2011 5th International IEEE/EMBS Conference on Neural Engineering.

[12]  N. Kanwisher,et al.  The Fusiform Face Area: A Module in Human Extrastriate Cortex Specialized for Face Perception , 1997, The Journal of Neuroscience.

[13]  Marie E. McNeely,et al.  Multiple faces elicit augmented neural activity , 2013, Front. Hum. Neurosci..

[14]  T. Allison,et al.  Electrophysiological Studies of Face Perception in Humans , 1996, Journal of Cognitive Neuroscience.

[15]  Mariano Sigman,et al.  Looking for a face in the crowd: Fixation-related potentials in an eye-movement visual search task , 2014, NeuroImage.

[16]  N. Kanwisher,et al.  The fusiform face area: a cortical region specialized for the perception of faces , 2006, Philosophical Transactions of the Royal Society B: Biological Sciences.

[17]  J. Satheesh Kumar,et al.  Support Vector Machine Technique for EEG Signals , 2013 .

[18]  Pawan Sinha,et al.  EEG responses to facial contrast-chimeras. , 2012, Journal of integrative neuroscience.

[19]  V. Barnett,et al.  Applied Linear Statistical Models , 1975 .

[20]  R. Aslin,et al.  PSYCHOLOGICAL SCIENCE Research Article UNSUPERVISED STATISTICAL LEARNING OF HIGHER-ORDER SPATIAL STRUCTURES FROM VISUAL SCENES , 2022 .

[21]  Jason M Haberman,et al.  Correspondences Rapid extraction of mean emotion and gender from sets of faces , 2007 .

[22]  A. Ishai,et al.  Distributed and Overlapping Representations of Faces and Objects in Ventral Temporal Cortex , 2001, Science.

[23]  C. Nelson,et al.  An event-related potential study of the impact of institutional rearing on face recognition , 2005, Development and Psychopathology.