A biologically inspired model of emotion eliciting from visual stimuli

Several emotion eliciting models have been proposed in the literature, however most of them are still artificial models which ignore the biological basis. We propose an emotion (without awareness) eliciting model from visual stimuli, which is inspired by biology: we describe an emotion eliciting process that follows the circuits of emotion in the brain derived through the results of neuroscience and the three major modules in the process, visual perception, emotion-eliciting region and emotional valence elicited by the region, are all supported by biology research. In our work, visual perception works with visual stimuli from coarse to the finer level according to human visual system. The elicited emotion in coarse level is also capable of affecting the emotion valence in the finer level. Based on psychophysical research, the emotion-eliciting region is selected out through color preference. The emotion is elicited by the emotion-eliciting region rather than overall visual context, which has been first introduced to computational modeling of emotion eliciting from image stimuli. The emotional valence elicited by the region is calculated on coarseness and directionality by comparing with stored image representations. In the experiments, two types of visual stimuli are considered: (1) natural scenes stimuli and (2) natural scenes and mutilation scenes stimuli. We compare the performance of our model with International Affective Picture System (IAPS), a large set of emotionally evocative color photographs that includes pleasure and arousal ratings made by men and women. Experimental results show that our model can generate human-like emotion based on natural scenes stimuli and obtain the positive or negative emotion as people feel on natural scenes and mutilation scenes stimuli.

[1]  Joseph E LeDoux Emotion Circuits in the Brain , 2000 .

[2]  M. Tamietto,et al.  Neural bases of the non-conscious perception of emotional signals , 2010, Nature Reviews Neuroscience.

[3]  Zhifeng Zhang,et al.  Adaptive time-frequency decompositions , 1994 .

[4]  B. Baars The conscious access hypothesis: origins and recent evidence , 2002, Trends in Cognitive Sciences.

[5]  E. Vesterinen,et al.  Affective Computing , 2009, Encyclopedia of Biometrics.

[6]  P. Ekman Are there basic emotions? , 1992, Psychological review.

[7]  Larry W Swanson,et al.  Dissecting the brain's fear system reveals the hypothalamus is critical for responding in subordinate conspecific intruders , 2009, Proceedings of the National Academy of Sciences.

[8]  L Weiskrantz,et al.  Non-conscious recognition of affect in the absence of striate cortex. , 1999, Neuroreport.

[9]  CHUA Cellular Neural Networks : Theory LEON 0 , 2004 .

[10]  L. Ou,et al.  A study of colour emotion and colour preference. Part III: Colour preference modeling , 2004 .

[11]  A. Sloman HOW MANY SEPARATELY EVOLVED EMOTIONAL BEASTIES LIVE WITHIN US , 2002 .

[12]  Andrew Ortony,et al.  The Cognitive Structure of Emotions , 1988 .

[13]  R. Gunderman,et al.  Emotional intelligence. , 2011, Journal of the American College of Radiology : JACR.

[14]  K. Luan Phan,et al.  Functional Neuroanatomy of Emotion: A Meta-Analysis of Emotion Activation Studies in PET and fMRI , 2002, NeuroImage.

[15]  Vera Ferrari,et al.  The influence of color on emotional perception of natural scenes. , 2012, Psychophysiology.

[16]  S. Wiens Interoception in emotional experience , 2005, Current opinion in neurology.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Lin Chen The topological approach to perceptual organization , 2005 .

[19]  Brian A. Wandell,et al.  A spatial extension of CIELAB for digital color‐image reproduction , 1997 .

[20]  Sigal G. Barsade,et al.  Human abilities: emotional intelligence. , 2008, Annual review of psychology.

[21]  Stacy Marsella,et al.  A domain-independent framework for modeling emotion , 2004, Cognitive Systems Research.

[22]  J. Fellous,et al.  Emotions: from brain to robot , 2004, Trends in Cognitive Sciences.

[23]  Theo Gevers,et al.  Texture affects color emotion , 2011 .

[24]  Stefano Fusi,et al.  Emotion, cognition, and mental state representation in amygdala and prefrontal cortex. , 2010, Annual review of neuroscience.

[25]  R. Dolan,et al.  Conscious and unconscious emotional learning in the human amygdala , 1998, Nature.

[26]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[27]  Zidong Wang,et al.  Cellular Neural Networks, the Navier–Stokes Equation, and Microarray Image Reconstruction , 2011, IEEE Transactions on Image Processing.

[28]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[29]  Patrik Vuilleumier,et al.  Beware and be aware: Capture of spatial attention by fear-related stimuli in neglect , 2001, Neuroreport.

[30]  J. Schwerdtner,et al.  fMRI an der Forensischen Klinik am Bezirksklinikum Regensburg - Neuroanatomische Grundlagen der Emotionsverarbeitung , 2004 .

[31]  Eun Yi Kim,et al.  Automatic textile image annotation by predicting emotional concepts from visual features , 2010, Image Vis. Comput..

[32]  Zidong Wang,et al.  A Hybrid EKF and Switching PSO Algorithm for Joint State and Parameter Estimation of Lateral Flow Immunoassay Models , 2012, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[33]  J. Changeux,et al.  Opinion TRENDS in Cognitive Sciences Vol.10 No.5 May 2006 Conscious, preconscious, and subliminal processing: a testable taxonomy , 2022 .

[34]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[35]  David Sander,et al.  A systems approach to appraisal mechanisms in emotion , 2005, Neural Networks.

[36]  Narayanan Srinivasan,et al.  Rapid communication: Global–local processing affects recognition of distractor emotional faces , 2011, Quarterly journal of experimental psychology.

[37]  L. F. Barrett Valence is a basic building block of emotional life , 2006 .

[38]  Nicu Sebe,et al.  Emotional valence categorization using holistic image features , 2008, 2008 15th IEEE International Conference on Image Processing.

[39]  B. Fredrickson The role of positive emotions in positive psychology. The broaden-and-build theory of positive emotions. , 2001, The American psychologist.

[40]  R. Dolan,et al.  Emotion, Cognition, and Behavior , 2002, Science.

[41]  J. Russell Core affect and the psychological construction of emotion. , 2003, Psychological review.

[42]  L. F. Barrett,et al.  Affect is a form of cognition: A neurobiological analysis , 2007, Cognition & emotion.

[43]  Zhihong Zeng,et al.  Audio-Visual Affect Recognition , 2007, IEEE Transactions on Multimedia.

[44]  Joonwhoan Lee,et al.  Fuzzy Similarity-Based Emotional Classification of Color Images , 2011, IEEE Transactions on Multimedia.

[45]  Jason B. Mattingley,et al.  Differential amygdala responses to happy and fearful facial expressions depend on selective attention , 2005, NeuroImage.

[46]  E. Hess,et al.  Pupil Size as Related to Interest Value of Visual Stimuli , 1960, Science.

[47]  M. Bradley,et al.  Activation of the visual cortex in motivated attention. , 2003, Behavioral neuroscience.

[48]  P. Salovey,et al.  TARGET ARTICLES: "Emotional Intelligence: Theory, Findings, and Implications" , 2004 .

[49]  R. Dolan,et al.  Common effects of emotional valence, arousal and attention on neural activation during visual processing of pictures , 1999, Neuropsychologia.

[50]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[51]  W. Einhäuser,et al.  Animal detection and identification in natural scenes: image statistics and emotional valence. , 2012, Journal of vision.

[52]  Qing Zhang,et al.  Autonomous emotion development using incremental modified adaptive neuro-fuzzy inference system , 2012, Neurocomputing.

[53]  Sravanti L. Sanivarapu Emotion , 2020, Indian journal of psychiatry.

[54]  Kostas Karpouzis,et al.  User and context adaptive neural networks for emotion recognition , 2008, Neurocomputing.

[55]  M. Bradley,et al.  The neural basis of narrative imagery: emotion and action. , 2006, Progress in brain research.