Image Sentiment Analysis Using Convolutional Neural Network

Visual media is one of the most powerful channel for expressing emotions and sentiments. Social media users are gradually using multimedia like images, videos etc. for expressing their opinions, views and experiences. Sentiment analysis of this vast user generated visual content can aid in better and improved extraction of user sentiments. This motivated us to focus on determining ‘image sentiment analyses’. Significant advancement has been made in this area, however, there is lot more to focus on visual sentiment analysis using deep learning techniques. In our study, we aim to design a visual sentiment framework using a convolutional neural network. For experimentation, we employ the use of Flickr images for training purposes and Twitter images for testing purposes. The results depict that the proposed ‘visual sentiment framework using convolutional neural network’ shows improved performance for analyzing the sentiments associated with the images.

[1]  Akshi Kumar,et al.  A Survey on Sentiment Analysis using Swarm Intelligence , 2016 .

[2]  Yong Zhang,et al.  Sentiment classification using Comprehensive Attention Recurrent models , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[3]  Guoyong Cai,et al.  Convolutional Neural Networks for Multimedia Sentiment Analysis , 2015, NLPCC.

[4]  Hrishikesh B. Aradhye,et al.  Video2Text: Learning to Annotate Video Content , 2009, 2009 IEEE International Conference on Data Mining Workshops.

[5]  Li-Jia Li,et al.  Visual Sentiment Prediction with Deep Convolutional Neural Networks , 2014, ArXiv.

[6]  Jie Tang,et al.  Understanding the emotional impact of images , 2012, ACM Multimedia.

[7]  Mike Thelwall,et al.  Sentiment in short strength detection informal text , 2010 .

[8]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[9]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[10]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[11]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[12]  Rongrong Ji,et al.  Large-scale visual sentiment ontology and detectors using adjective noun pairs , 2013, ACM Multimedia.

[13]  Sanjay Singh,et al.  Image sentiment analysis using deep convolutional neural networks with domain specific fine tuning , 2015, 2015 International Conference on Information Processing (ICIP).

[14]  Mike Thelwall,et al.  Sentiment in Twitter events , 2011, J. Assoc. Inf. Sci. Technol..

[15]  Jiebo Luo,et al.  Robust Image Sentiment Analysis Using Progressively Trained and Domain Transferred Deep Networks , 2015, AAAI.

[16]  Yanqing Zhang,et al.  Visual Sentiment Analysis for Social Images Using Transfer Learning Approach , 2016, 2016 IEEE International Conferences on Big Data and Cloud Computing (BDCloud), Social Computing and Networking (SocialCom), Sustainable Computing and Communications (SustainCom) (BDCloud-SocialCom-SustainCom).

[17]  Shih-Fu Chang,et al.  Consumer video understanding: a benchmark database and an evaluation of human and machine performance , 2011, ICMR.

[18]  Babar Hayat,et al.  Sentiment Analysis Using Deep Learning Techniques: A Review , 2017, International Journal of Advanced Computer Science and Applications.

[19]  Stefan Winkler,et al.  Emotion-based sequence of family photos , 2012, ACM Multimedia.

[20]  Akshi Kumar,et al.  Sentiment Analysis: A Perspective on its Past, Present and Future , 2012 .

[21]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[22]  Nicu Sebe,et al.  In the eye of the beholder: employing statistical analysis and eye tracking for analyzing abstract paintings , 2012, ACM Multimedia.