Investigating the Influence of Prior Expectation in Face Pareidolia using Spatial Pattern

The perception of an external stimulus is not just stimulus-dependent but is also influenced by the ongoing brain activity prior to the presentation of stimulus. In this work, we directly tested whether spontaneous electroencephalogram (EEG) signal in prestimulus period could predict perceptual outcome in face pareidolia (visualizing face in noise images) on a trial-by-trial basis using machine learning framework. Participants were presented with only noise images but with the prior information that some faces would be hidden in these images while their electrical brain activities were recorded; participants reported their perceptual decision, face or no-face, on each trial. Using features based on the Regularized Common Spatial Patterns (RCSP) in a machine learning classifier, we demonstrated that prestimulus brain activities could discriminate face and no-face perception with an accuracy of 73.15%. The channels corresponding to the maximal coefficients of spatial pattern vectors may be the channels most correlated with the task-specific sources, i.e., frontal and parieto-occipital regions activate for ‘face’ and ‘no-face’ imagery class, respectively. These findings suggest a mechanism of how prior expectations in the prestimulus period may affect post-stimulus decision-making.

[1]  K.-R. Muller,et al.  Optimizing Spatial filters for Robust EEG Single-Trial Analysis , 2008, IEEE Signal Processing Magazine.

[2]  P. Rossini,et al.  Pre- and poststimulus alpha rhythms are related to conscious visual perception: a high-resolution EEG study. , 2005, Cerebral cortex.

[3]  Jie Tian,et al.  Seeing Jesus in toast: Neural and behavioral correlates of face pareidolia , 2014, Cortex.

[4]  Haiping Lu,et al.  Regularized common spatial patterns with generic learning for EEG signal classification , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  K. Linkenkaer-Hansen,et al.  Prestimulus Oscillations Enhance Psychophysical Performance in Humans , 2004, The Journal of Neuroscience.

[6]  Karl J. Friston,et al.  Frontiers in Systems Neuroscience Systems Neuroscience the Temporal Structure of Ongoing Brain Activity , 2022 .

[7]  Simon D Lilburn,et al.  Predicting Perceptual Decision Biases from Early Brain Activity , 2012, The Journal of Neuroscience.

[8]  Stan Matwin,et al.  Addressing the Curse of Imbalanced Training Sets: One-Sided Selection , 1997, ICML.

[9]  Jie Wang,et al.  On solving the face recognition problem with one training sample per subject , 2006, Pattern Recognit..

[10]  Goutam Saha,et al.  How We Choose One over Another: Predicting Trial-by-Trial Preference Decision , 2012, PloS one.

[11]  Caspar M. Schwiedrzik,et al.  Expecting to See a Letter: Alpha Oscillations as Carriers of Top-Down Sensory Predictions. , 2016, Cerebral cortex.

[12]  Karl J. Friston,et al.  The influence of spontaneous activity on stimulus processing in primary visual cortex , 2012, NeuroImage.

[13]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[14]  Andreas Stolcke,et al.  A study in machine learning from imbalanced data for sentence boundary detection in speech , 2006, Comput. Speech Lang..

[15]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[16]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[17]  N. Kanwisher,et al.  Pre-stimulus pattern of activity in the fusiform face area predicts face percepts during binocular rivalry , 2011, Neuropsychologia.

[18]  Michael S. Lazar,et al.  Spatial patterns underlying population differences in the background EEG , 2005, Brain Topography.

[19]  C. Summerfield,et al.  Expectation in perceptual decision making: neural and computational mechanisms , 2014, Nature Reviews Neuroscience.

[20]  F. D. de Lange,et al.  Prior Expectations Bias Sensory Representations in Visual Cortex , 2013, The Journal of Neuroscience.

[21]  A. von Stein,et al.  Different frequencies for different scales of cortical integration: from local gamma to long range alpha/theta synchronization. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  Robert Oostenveld,et al.  FieldTrip: Open Source Software for Advanced Analysis of MEG, EEG, and Invasive Electrophysiological Data , 2010, Comput. Intell. Neurosci..

[23]  Seungjin Choi,et al.  Composite Common Spatial Pattern for Subject-to-Subject Transfer , 2009, IEEE Signal Processing Letters.

[24]  G. Pfurtscheller,et al.  Optimal spatial filtering of single trial EEG during imagined hand movement. , 2000, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[25]  Cuntai Guan,et al.  Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms , 2011, IEEE Transactions on Biomedical Engineering.

[26]  C. Peterson Faces in the Clouds , 2015 .