Artificial Neural Networks Can Distinguish Genuine and Acted Anger by Synthesizing Pupillary Dilation Signals from Different Participants

Previous research has revealed that people are generally poor at distinguishing genuine and acted anger facial expressions, with a mere 65% accuracy of verbal answers. We aim to investigate whether a group of feedforward neural networks can perform better using raw pupillary dilation signals from individuals. Our results show that a single neural network cannot accurately discern the veracity of an emotion based on raw physiological signals, with an accuracy of 50.5%. Nonetheless, distinct neural networks using pupillary dilation signals from different individuals display a variety of genuineness for discerning the anger emotion, from 27.8% to 83.3%. By leveraging these differences, our novel Misaka neural networks can compose predictions using different individuals’ pupillary dilation signals to give a more accurate overall prediction than even from the highest performing single individual, reaching an accuracy of 88.9%. Further research will involve the investigation of the correlation between two groups of high-performing predictors using verbal answers and pupillary dilation signals.

[1]  Veikko Surakka,et al.  Pupillary responses to emotionally provocative stimuli , 2000, ETRA.

[2]  Yaacov Trope,et al.  Putting Facial Expressions Back in Context , 2008 .

[3]  J. Andreassi Psychophysiology: Human Behavior and Physiological Response , 1980 .

[4]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[5]  Anne M. Scheel,et al.  Intrinsic Altruism or Social Motivation—What Does Pupil Dilation Tell Us about Children's Helping Behavior? , 2017, Front. Psychol..

[6]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[7]  C. Manski Interpreting the Predictions of Prediction Markets , 2004 .

[8]  P. Ekman An argument for basic emotions , 1992 .

[9]  Philip Tetlock,et al.  Identifying and Cultivating Superforecasters as a Method of Improving Probabilistic Predictions , 2015, Perspectives on psychological science : a journal of the Association for Psychological Science.

[10]  Ruchuan Wang,et al.  Distributed Soft Fault Detection for Interval Type-2 Fuzzy-Model-Based Stochastic Systems With Wireless Sensor Networks , 2018, IEEE Transactions on Industrial Informatics.

[11]  Arran Frood Work the crowd , 2018 .

[12]  Margot J. Taylor,et al.  Early processing of the six basic facial emotional expressions. , 2003, Brain research. Cognitive brain research.

[13]  Thierry Pun,et al.  Valence-arousal evaluation using physiological signals in an emotion recall paradigm , 2007, 2007 IEEE International Conference on Systems, Man and Cybernetics.

[14]  T. Knapen,et al.  Decision-related pupil dilation reflects upcoming choice and individual bias , 2014, Proceedings of the National Academy of Sciences.

[15]  Megan H. Papesh,et al.  Pupil Dilation Reflects the Creation and Retrieval of Memories , 2012 .

[16]  Edwin S. Dalmaijer,et al.  Is the low-cost EyeTribe eye tracker any good for research? , 2014 .

[17]  K. H. Kim,et al.  Emotion recognition system using short-term monitoring of physiological signals , 2004, Medical and Biological Engineering and Computing.

[18]  F. Nelson,et al.  Use of prediction markets to forecast infectious disease activity. , 2007, Clinical infectious diseases : an official publication of the Infectious Diseases Society of America.

[19]  D Kahneman,et al.  Pupil Diameter and Load on Memory , 1966, Science.

[20]  P. Lang The emotion probe. Studies of motivation and attention. , 1995, The American psychologist.

[21]  Michael C. Hout,et al.  Memory strength and specificity revealed by pupillometry. , 2012, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[22]  Johannes Wagner,et al.  From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[23]  Pasin Israsena,et al.  EEG-Based Emotion Recognition Using Deep Learning Network with Principal Component Based Covariate Shift Adaptation , 2014, TheScientificWorldJournal.

[24]  Tamás D. Gedeon,et al.  Are you really angry?: detecting emotion veracity as a proposed tool for interaction , 2017, OZCHI.

[25]  S. Steinhauer,et al.  Sympathetic and parasympathetic innervation of pupillary dilation during sustained processing. , 2004, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[26]  Tamás D. Gedeon,et al.  Neural Networks Assist Crowd Predictions in Discerning the Veracity of Emotional Expressions , 2018, ICONIP.

[27]  E. Hess,et al.  Pupil Size in Relation to Mental Activity during Simple Problem-Solving , 1964, Science.