Can Salient Interest Regions Resume Emotional Impact of an Image?

The salient regions of interest are supposed to contain the interesting keypoints for analysis and understanding. We studied in this paper the impact of image reduction to the region of interest on the emotion recognition. We chose a bottom-up visual attention model because we addressed emotions on a new low-semantic data set SENSE Studies of Emotion on Natural image databaSE. We organized two experimentations. The first one has been conducted on the whole images called SENSE1 and the second on reduced images named SENSE2. These latter are obtained with a visual attention model and their size varies from 3% to 100% of the size of the original ones. The information collected during these evaluations are the nature and the power of emotions. For the nature observers have choice between "Negative", "Neutral" and "Positive" and the power varies from "Weak" to "Strong". On the both experimentations some images have ambiguous categorization. In fact, the participants were not able to decide on their emotional class Negative, Neutral ans Positive. The evaluations on reduced images showed that average 79% of the uncategorised images during SENSE1 are categorized during SENSE2 in one of the both major classes. Reducing the size of the area to be observed leads to a better evaluation maybe because some semantic content are attenuated.

[1]  Matthieu Perreira Da Silva,et al.  Evaluation of Preys / Predators Systems for Visual Attention Simulation , 2010, VISAPP.

[2]  P. Lang International affective picture system (IAPS) : affective ratings of pictures and instruction manual , 2005 .

[3]  Tao Zhang,et al.  Image Emotional Classification Based on Color Semantic Description , 2008, ADMA.

[4]  Marcel P. Lucassen,et al.  Adding texture to color: quantitative analysis of color emotions , 2010, CGIV/MCS.

[5]  Emmanuel Dellandréa,et al.  Evaluation of Features and Combination Approaches for the Classification of Emotional Semantics in Images , 2011, VISAPP.

[6]  Wei-Ning Wang,et al.  Image emotional semantic query based on color semantic description , 2005, 2005 International Conference on Machine Learning and Cybernetics.

[7]  Matthieu Perreira Da Silva,et al.  Implementation and evaluation of a computational model of attention for computer vision , 2013 .

[8]  L. Ou,et al.  A study of colour emotion and colour preference. Part I: Colour emotions for single colours , 2004 .

[9]  P. Lang,et al.  International Affective Picture System (IAPS): Instruction Manual and Affective Ratings (Tech. Rep. No. A-4) , 1999 .

[10]  Christine Fernandez-Maloigne,et al.  Extraction of emotional impact in colour images , 2012, CGIV.

[11]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[12]  Benoit Huet,et al.  Toward emotion indexing of multimedia excerpts , 2008, 2008 International Workshop on Content-Based Multimedia Indexing.

[13]  Allan Hanbury,et al.  Affective image classification using features inspired by psychology and art theory , 2010, ACM Multimedia.