Prediction of Human Empathy based on EEG Cortical Asymmetry

Humans constantly interact with digital devices that disregard their feelings. However, the synergy between human and technology can be strengthened if the technology is able to distinguish and react to human emotions. Models that rely on unconscious indications of human emotions, such as (neuro)physiological signals, hold promise in personalization of feedback and adaptation of the interaction. The current study elaborated on adopting a predictive approach in studying human emotional processing based on brain activity. More specifically, we investigated the proposition of predicting self-reported human empathy based on EEG cortical asymmetry in different areas of the brain. Different types of predictive models i.e. multiple linear regression analyses as well as binary classifications were evaluated. Results showed that lateralization of brain oscillations at specific frequency bands is an important predictor of self-reported empathy scores. Additionally, prominent classification performance was found during resting-state which suggests that emotional stimulation is not required for accurate prediction of empathy -as a personality trait- based on EEG data. Our findings not only contribute to the general understanding of the mechanisms of empathy, but also facilitate a better grasp on the advantages of applying a predictive approach compared to hypothesis-driven studies in neuropsychological research. More importantly, our results could be employed in the development of brain-computer interfaces that assist people with difficulties in expressing or recognizing emotions.

[1]  Richard J. Davidson,et al.  Asymmetric brain function, affective style, and psychopathology: The role of early experience and plasticity , 1994, Development and Psychopathology.

[2]  Moïra Mikolajczak,et al.  Association between frontal EEG asymmetries and emotional intelligence among adults , 2010 .

[3]  Isabella C. Wagner,et al.  Imaging empathy and prosocial emotions , 2017, Neuroscience Letters.

[4]  Fabio Celli,et al.  Automatic Personality and Interaction Style Recognition from Facebook Profile Pictures , 2014, ACM Multimedia.

[5]  M. Balconi,et al.  Empathy in Negative and Positive Interpersonal Interactions. What is the Relationship Between Central (EEG, fNIRS) and Peripheral (Autonomic) Neurophysiological Responses? , 2017, Advances in cognitive psychology.

[6]  Raul Vicente,et al.  Personality cannot be predicted from the power of resting state EEG , 2014, Front. Hum. Neurosci..

[7]  Angelica M. Tinga,et al.  Assessment of Empathy in an Affective VR Environment using EEG Signals , 2020, ArXiv.

[8]  B. Laeng,et al.  Right hemisphere or valence hypothesis, or both? The processing of hybrid faces in the intact and callosotomized brain , 2015, Neuropsychologia.

[9]  Rosalind W. Picard,et al.  Affective Computing and Autism , 2006, Annals of the New York Academy of Sciences.

[10]  A. Angrilli,et al.  Affective and cortical EEG gamma responses to emotional movies in women with high vs low traits of empathy , 2019, Neuropsychologia.

[11]  Jiahui Pan,et al.  An EEG-Based Brain Computer Interface for Emotion Recognition and Its Application in Patients with Disorder of Consciousness , 2019, IEEE Transactions on Affective Computing.

[12]  Soraia M. Alarcão,et al.  Emotions Recognition Using EEG Signals: A Survey , 2019, IEEE Transactions on Affective Computing.

[13]  Stefan Winkler,et al.  ASCERTAIN: Emotion and Personality Recognition Using Commercial Sensors , 2018, IEEE Transactions on Affective Computing.

[14]  Yong Peng,et al.  EEG-based emotion classification using deep belief networks , 2014, 2014 IEEE International Conference on Multimedia and Expo (ICME).

[15]  R. N. Spreng,et al.  The Toronto Empathy Questionnaire: Scale Development and Initial Validation of a Factor-Analytic Solution to Multiple Empathy Measures , 2009, Journal of personality assessment.

[16]  Loïc Kessous,et al.  Emotion Recognition through Multiple Modalities: Face, Body Gesture, Speech , 2008, Affect and Emotion in Human-Computer Interaction.

[17]  Michael C. Frank,et al.  Estimating the reproducibility of psychological science , 2015, Science.

[18]  G. Ironson,et al.  Interhemispheric Asymmetries and Theta Activity in the Rostral Anterior Cingulate Cortex as EEG Signature of HIV-Related Depression , 2016, Clinical EEG and neuroscience.

[19]  Marius Vollberg,et al.  The neuroscience of intergroup emotion. , 2018, Current opinion in psychology.

[20]  Guillaume Chanel,et al.  Guest Editorial: Toward Commercial Applications of Affective Computing , 2017, IEEE Trans. Affect. Comput..

[21]  J. Aharon-Peretz,et al.  Two systems for empathy: a double dissociation between emotional and cognitive empathy in inferior frontal gyrus versus ventromedial prefrontal lesions. , 2009, Brain : a journal of neurology.

[22]  M. Balconi,et al.  Resting lateralized activity predicts the cortical response and appraisal of emotions: an fNIRS study. , 2015, Social cognitive and affective neuroscience.

[23]  Michael Inzlicht,et al.  Right frontal cortical asymmetry predicts empathic reactions: support for a link between withdrawal motivation and empathy. , 2012, Psychophysiology.

[24]  John J. B. Allen,et al.  Frontal asymmetry as a mediator and moderator of emotion: An updated review. , 2018, Psychophysiology.

[25]  Anton Aluja,et al.  Relationship between Empathy and the Big Five Personality Traits in a Sample of Spanish Adolescents , 2004 .

[26]  R. E. Wheeler,et al.  Individual differences in anterior brain asymmetry and fundamental dimensions of emotion. , 1992, Journal of personality and social psychology.

[27]  James C. Lester,et al.  Early Prediction of Student Frustration , 2007, ACII.

[28]  Yan Ge,et al.  Emotion Analysis for Personality Inference from EEG Signals , 2018, IEEE Transactions on Affective Computing.

[29]  Kimberly L. Meidenbauer,et al.  The development of cognitive empathy and concern in preschool children: A behavioral neuroscience investigation. , 2018, Developmental Science.

[30]  Marc Cavazza,et al.  Towards Empathic Neurofeedback for Interactive Storytelling , 2014, CMN.

[31]  Wei Zhang,et al.  Cross-Subject EEG Feature Selection for Emotion Recognition Using Transfer Recursive Feature Elimination , 2017, Front. Neurorobot..

[32]  G. Schwartz,et al.  Differential lateralization for positive versus negative emotion , 1979, Neuropsychologia.

[33]  A. Zangen,et al.  The role of medial prefrontal cortex in theory of mind: A deep rTMS study , 2012, Behavioural Brain Research.

[34]  Rodolfo Abreu,et al.  EEG-Informed fMRI: A Review of Data Analysis Methods , 2018, Front. Hum. Neurosci..

[35]  P. Lockwood The anatomy of empathy: Vicarious experience and disorders of social cognition , 2016, Behavioural Brain Research.

[36]  Erol Başar,et al.  Brain oscillations in neuropsychiatric disease , 2013, Dialogues in clinical neuroscience.

[37]  M. Salminen,et al.  Evoking Physiological Synchrony and Empathy Using Social VR With Biofeedback , 2019, IEEE Transactions on Affective Computing.

[38]  Zhi Chen,et al.  Automatic personality identification using writing behaviours: an exploratory study , 2017, Behav. Inf. Technol..

[39]  T. Yarkoni,et al.  Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[40]  J. Decety,et al.  The complex relation between morality and empathy , 2014, Trends in Cognitive Sciences.

[41]  Shihui Han,et al.  Temporal dynamic of neural mechanisms involved in empathy for pain: An event-related brain potential study , 2008, Neuropsychologia.

[42]  H. Lackner,et al.  Prefrontal EEG alpha asymmetry changes while observing disaster happening to other people: Cardiac correlates and prediction of emotional impact , 2014, Biological Psychology.