Biological Computation Indexes of Brain Oscillations in Unattended Facial Expression Processing Based on Event-Related Synchronization/Desynchronization

Estimation of human emotions from Electroencephalogram (EEG) signals plays a vital role in affective Brain Computer Interface (BCI). The present study investigated the different event-related synchronization (ERS) and event-related desynchronization (ERD) of typical brain oscillations in processing Facial Expressions under nonattentional condition. The results show that the lower-frequency bands are mainly used to update Facial Expressions and distinguish the deviant stimuli from the standard ones, whereas the higher-frequency bands are relevant to automatically processing different Facial Expressions. Accordingly, we set up the relations between each brain oscillation and processing unattended Facial Expressions by the measures of ERD and ERS. This research first reveals the contributions of each frequency band for comprehension of Facial Expressions in preattentive stage. It also evidences that participants have emotional experience under nonattentional condition. Therefore, the user's emotional state under nonattentional condition can be recognized in real time by the ERD/ERS computation indexes of different frequency bands of brain oscillations, which can be used in affective BCI to provide the user with more natural and friendly ways.

[1]  Febo Cincotti,et al.  Sub-second "temporal attention" modulates alpha rhythms. A high-resolution EEG study. , 2004, Brain research. Cognitive brain research.

[2]  Olga Sourina,et al.  Real-time EEG-based user's valence monitoring , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[3]  István Czigler,et al.  Processing of unattended facial emotions: A visual mismatch negativity study , 2012, NeuroImage.

[4]  Matthew Garner,et al.  When is a Face a Face? Schematic Faces, Emotion, Attention and the N170 , 2015 .

[5]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[6]  W. Klimesch,et al.  Upper alpha ERD and absolute power: their meaning for memory performance. , 2006, Progress in brain research.

[7]  W. Klimesch,et al.  Intelligence related upper alpha desynchronization in a semantic memory task , 2005, Brain Research Bulletin.

[8]  I. Gorodnitsky,et al.  EEG mu component responses to viewing emotional faces , 2012, Behavioural Brain Research.

[9]  E. Schröger,et al.  Measuring duration mismatch negativity , 2003, Clinical Neurophysiology.

[10]  W. Klimesch.  EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis , 1999, Brain Research Reviews.

[11]  Manuel Schabus,et al.  A shift of visual spatial attention is selectively associated with human EEG alpha activity , 2005, The European journal of neuroscience.

[12]  Stéphane Canu,et al.  Emotional Influence on SSVEP Based BCI , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[13]  E. Basar,et al.  Event-related beta oscillations are affected by emotional eliciting stimuli , 2010, Neuroscience Letters.

[14]  G. Rhodes,et al.  Are you always on my mind? A review of how face perception and attention interact , 2007, Neuropsychologia.

[15]  F. McGlone,et al.  The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions , 2003, Cognitive, affective & behavioral neuroscience.

[16]  A. Jedynak,et al.  Rapid extraction of emotional expression: evidence from evoked potential fields during brief presentation of face stimuli , 2003, Neuropsychologia.

[17]  Erol Basar,et al.  Emotional face expressions are differentiated with brain oscillations. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[18]  D. Lehmann,et al.  Rapid emotional face processing in the human right and left brain hemispheres: an ERP study. , 1999, Neuroreport.

[19]  G. Knyazev,et al.  Event-related delta and theta synchronization during explicit and implicit emotion processing , 2009, Neuroscience.

[20]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[21]  L. Aftanas,et al.  Time-dependent cortical asymmetries induced by emotional arousal: EEG analysis of event-related synchronization and desynchronization in individually defined frequency bands. , 2002, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  F. L. D. Silva,et al.  Event-related EEG/MEG synchronization and desynchronization: basic principles , 1999, Clinical Neurophysiology.

[23]  D Popivanov,et al.  Assessment of EEG frequency dynamics using complex demodulation. , 1999, Physiological research.

[24]  N. V. Lotova,et al.  Event-related desynchronization (ERD) patterns to emotion-related feedback stimuli. , 1996, The International journal of neuroscience.

[25]  R. Nagarajan,et al.  Combining Spatial Filtering and Wavelet Transform for Classifying Human Emotions Using EEG Signals , 2011 .

[26]  J. Hodges,et al.  Brain correlates of musical and facial emotion recognition: Evidence from the dementias , 2012, Neuropsychologia.

[27]  L. Aftanas,et al.  Affective picture processing: event-related synchronization within individually defined human theta band is modulated by valence dimension. , 2001, Neuroscience Letters.

[28]  M. Balconi,et al.  EEG correlates (event-related desynchronization) of emotional face elaboration: A temporal analysis , 2006, Neuroscience Letters.

[29]  Jing Xu,et al.  Dysfunction of processing task-irrelevant emotional faces in major depressive disorder patients revealed by expression-related visual MMN , 2010, Neuroscience Letters.

[30]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions: new evidence from the equiprobable paradigm , 2012, Behavioral and Brain Functions.

[31]  U. Dimberg,et al.  Facial reactions to happy and angry facial expressions: evidence for right hemisphere dominance. , 2000, Psychophysiology.

[32]  G. Pfurtscheller.  Event-related synchronization (ERS): an electrophysiological correlate of cortical areas at rest. , 1992, Electroencephalography and clinical neurophysiology.

[33]  Wenfeng Feng,et al.  Three stages of facial expression processing: ERP study with rapid serial visual presentation , 2010, NeuroImage.

[34]  Niels Birbaumer,et al.  Insula and inferior frontal triangularis activations distinguish between conditioned brain responses using emotional sounds for basic BCI communication , 2014, Front. Behav. Neurosci..

[35]  Michela Balconi,et al.  Arousal effect on emotional face comprehension Frequency band changes in different time intervals , 2009, Physiology & Behavior.

[36]  Lun Zhao,et al.  Visual mismatch negativity elicited by facial expressions under non-attentional condition , 2006, Neuroscience Letters.

[37]  Michela Sarlo,et al.  Changes in EEG alpha power to different disgust elicitors: the specificity of mutilations , 2005, Neuroscience Letters.

[38]  Ehsan Tarkesh Esfahani,et al.  Using Brain-Computer Interfaces to Detect Human Satisfaction in Human-Robot Interaction , 2011, Int. J. Humanoid Robotics.

[39]  Wolfram Boucsein,et al.  Modification of N170 by different emotional expression of schematic faces , 2007, Biological Psychology.

[40]  Stefano Federici,et al.  Extracting neurophysiological signals reflecting users' emotional and affective responses to BCI use: A systematic literature review. , 2015, NeuroRehabilitation.

[41]  Christina M Krause,et al.  Test-retest consistency of the event-related desynchronization/event-related synchronization of the 4–6, 6–8, 8–10 and 10–12 Hz frequency bands during a memory task , 2001, Clinical Neurophysiology.

[42]  Lihua Mao,et al.  Event-related theta and alpha oscillations mediate empathy for pain , 2008, Brain Research.

[43]  V. Jousmäki,et al.  Modulation of Human Cortical Rolandic Rhythms during Natural Sensorimotor Tasks , 1997, NeuroImage.

[44]  Piia Astikainen,et al.  This Reprint May Differ from the Original in Pagination and Typographic Detail. Event-related Potentials to Task-irrelevant Changes in Facial Expressions Behavioral and Brain Functions Event-related Potentials to Task-irrelevant Changes in Facial Expressions , 2022 .

[45]  M. Tamietto,et al.  Neural bases of the non-conscious perception of emotional signals , 2010, Nature Reviews Neuroscience.

[46]  M. Codispoti,et al.  Affective modulation of the LPP and α-ERD during picture viewing. , 2011, Psychophysiology.

[47]  E. Basar,et al.  Gender differences influence brain's beta oscillatory responses in recognition of facial expressions , 2007, Neuroscience Letters.

[48]  Panagiotis D. Bamidis,et al.  A Framework Combining Delta Event-Related Oscillations (EROs) and Synchronisation Effects (ERD/ERS) to Study Emotional Processing , 2009, Comput. Intell. Neurosci..

[49]  Lun Zhao,et al.  Gender Differences in Preattentive Processing of Facial Expressions: An ERP Study , 2013, Brain Topography.

[50]  Michela Balconi,et al.  Event-Related Oscillations (ERO) and Event-Related Potentials (ERP) in Emotional Face Recognition , 2008, The International journal of neuroscience.

[51]  E. Basar,et al.  Principles of oscillatory brain dynamics and a treatise of recognition of faces and facial expressions. , 2006, Progress in brain research.

[52]  G. Pfurtscheller,et al.  Event-related cortical desynchronization detected by power measurements of scalp EEG. , 1977, Electroencephalography and clinical neurophysiology.

[53]  Marie L. Smith,et al.  Rapid processing of emotional expressions without conscious awareness. , 2012, Cerebral cortex.