Aspect Extraction with Bidirectional GRU and CRF

Opinion mining or sentiment analysis used to understand the community's opinions on a particular product. Sentiment analysis involves building the opinion collection and classification system. One of the most crucial tasks of sentiment analysis is the ability to extract aspects or features that opinions expressed on. There are many approaches and techniques used to explore these features from unstructured comments. We proposed a different approach to the above mentioned aspect extraction task in sentiment analysis using a deep learning model combining Bidirectional Gated Recurrent Unit (BiGRU) and Conditional Random Field (CRF). This model is trained on labeled data to extract and classify feature sets in comments. Our model uses a BiGRU neural network with word embeddings achieved by training GloVe on the SemEval 2014 dataset. The SemEval 2014 dataset include 7,686 reviews on two domains, Laptop and Restaurant. Experimental results showed that our aspect extraction model in sentiment analysis using BiGRU-CRF achieved significantly better accuracy than the state-of-the-art methods.

[1]  Yue Lu,et al.  Rated aspect summarization of short comments , 2009, WWW '09.

[2]  Hao Yu,et al.  Structure-Aware Review Mining and Summarization , 2010, COLING.

[3]  Claire Cardie,et al.  Investigating LSTMs for Joint Extraction of Opinion Entities and Relations , 2016, ACL.

[4]  Eric Chang,et al.  Red Opal: product-feature scoring from reviews , 2007, EC '07.

[5]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[6]  Yue Zhang,et al.  Neural Networks for Open Domain Targeted Sentiment , 2015, EMNLP.

[7]  Chun Chen,et al.  Opinion Word Expansion and Target Extraction through Double Propagation , 2011, CL.

[8]  Noémie Elhadad,et al.  An Unsupervised Aspect-Sentiment Model for Online Reviews , 2010, NAACL.

[9]  Jeffrey Dean,et al.  Efficient Estimation of Word Representations in Vector Space , 2013, ICLR.

[10]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[11]  Iryna Gurevych,et al.  Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields , 2010, EMNLP.

[12]  Claire Cardie,et al.  Opinion Mining with Deep Recurrent Neural Networks , 2014, EMNLP.

[13]  Xu Ling,et al.  Topic sentiment mixture: modeling facets and opinions in weblogs , 2007, WWW '07.

[14]  Claire Cardie,et al.  Extracting Opinion Expressions with semi-Markov Conditional Random Fields , 2012, EMNLP.

[15]  Oren Etzioni,et al.  Extracting Product Features and Opinions from Reviews , 2005, HLT.

[16]  Yuji Matsumoto,et al.  Extracting Aspect-Evaluation and Aspect-Of Relations in Opinion Mining , 2007, EMNLP.

[17]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[18]  Chong Long,et al.  A Review Selection Approach for Accurate Feature Rating Estimation , 2010, COLING.

[19]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[20]  Xuanjing Huang,et al.  Phrase Dependency Parsing for Opinion Mining , 2009, EMNLP.

[21]  Erik Cambria,et al.  Aspect extraction for opinion mining with a deep convolutional neural network , 2016, Knowl. Based Syst..

[22]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[23]  J. Keziya Rani,et al.  Mining Opinion Features in Customer Reviews. , 2016 .

[24]  Yulan He,et al.  Joint sentiment/topic model for sentiment analysis , 2009, CIKM.