A Deep Architecture for Sentiment Analysis of News Articles

In this paper, we present a deep architecture to perform aspect-level sentiment analysis for news articles. We combine some neural networks models proposed in various deep learning approaches, aiming at tackling specific issues commonly occurring for news articles. In this paper, we explain why our architecture can handle typically-long and content-specific news articles, which often cause overfitting when trained with neural networks. Moreover, the proposed architecture can also effectively process the case when the subject to be analyzed sentimentally is not the main topic of the concerned article, which is also a common issue when performing aspect-level sentiment processing. Experimental results with real dataset demonstrated advantages of our approach as compared to the existing approaches.

[1]  Geoffrey E. Hinton.  Mapping Part-Whole Hierarchies into Connectionist Networks , 1990, Artif. Intell..

[2]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[3]  Christopher Potts,et al.  Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank , 2013, EMNLP.

[4]  Xiaoyan Zhu,et al.  Sentiment Analysis with Global Topics and Local Dependency , 2010, AAAI.

[5]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.

[6]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[7]  Hongfei Yan,et al.  Jointly Modeling Aspects and Opinions with a MaxEnt-LDA Hybrid , 2010, EMNLP.

[8]  Regina Barzilay,et al.  Content Models with Attitude , 2011, ACL.

[9]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[10]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[11]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[12]  Lakhmi C. Jain,et al.  Recurrent Neural Networks: Design and Applications , 1999 .

[13]  Ivan Titov,et al.  A Joint Model of Text and Aspect Ratings for Sentiment Summarization , 2008, ACL.

[14]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[15]  Xu Ling,et al.  Topic sentiment mixture: modeling facets and opinions in weblogs , 2007, WWW '07.

[16]  F. Gers,et al.  Long short-term memory in recurrent neural networks , 2001 .

[17]  Jeonghee Yi,et al.  Sentiment analysis: capturing favorability using natural language processing , 2003, K-CAP '03.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Nicolas Le Roux,et al.  A latent factor model for highly multi-relational data , 2012, NIPS.

[20]  Arjun Mukherjee,et al.  Aspect Extraction through Semi-Supervised Modeling , 2012, ACL.

[21]  S Padmaja,et al.  Opinion Mining and Sentiment Analysis - An Assessment of Peoples' Belief: A Survey , 2013 .

[22]  Zhiyong Luo,et al.  Combination of Convolutional and Recurrent Neural Network for Sentiment Analysis of Short Texts , 2016, COLING.