Learning to recognize opinion targets using recurrent neural networks

Abstract Opinion target recognition can be deemed a problem of token-level sequence labelling, and each word in the sentence is assigned to a label with the standard BIO tagging scheme. Among a variety of methods, recently emerged recurrent neural network (RNN) is considered more effective to deal with such kinds of sequence annotation problem. Whereas existing RNN models mainly focus on learning the dependency relationships in the input sequence while ignoring the ones in the output sequence. To this end, we proposed an augmented RNN model called OLSRNN. The OLSRNN model adds self-connections to the output layer on the basics of conventional RNN models to further capture output temporal dependencies. Over the benchmark customer review datasets, experiment results demonstrate the effectiveness of the proposed approach in opinion target recognition in comparison with other baseline methods.

[1]  Zhiqiang Toh,et al.  DLIREC: Aspect Term Extraction and Term Polarity Classification System , 2014, *SEMEVAL.

[2]  Bing Liu,et al.  Mining Opinion Features in Customer Reviews , 2004, AAAI.

[3]  Soo-Min Kim,et al.  Identifying and Analyzing Judgment Opinions , 2006, NAACL.

[4]  Khin Thidar Lynn,et al.  Extracting Product Features and Opinion Words Using Pattern Knowledge in Customer Reviews , 2013, TheScientificWorldJournal.

[5]  Michael I. Jordan Serial Order: A Parallel Distributed Processing Approach , 1997 .

[6]  Maryna Chernyshevich,et al.  IHS R&D Belarus: Cross-domain Extraction of Product Features using Conditional Random Fields , 2014 .

[7]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[8]  Iryna Gurevych,et al.  Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields , 2010, EMNLP.

[9]  Jürgen Schmidhuber,et al.  Offline Handwriting Recognition with Multidimensional Recurrent Neural Networks , 2008, NIPS.

[10]  Shiliang Sun,et al.  A review of natural language processing techniques for opinion mining systems , 2017, Inf. Fusion.

[11]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[12]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[13]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[14]  Zhihua Zhang,et al.  ECNU: A Combination Method and Multiple Features for Aspect Extraction and Sentiment Polarity Classification , 2014, SemEval@COLING.

[15]  Wai Lam,et al.  Hot item mining and summarization from multiple auction Web sites , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[16]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[17]  Alex Graves,et al.  Supervised Sequence Labelling , 2012 .

[18]  Yoshua Bengio,et al.  Learning long-term dependencies with gradient descent is difficult , 1994, IEEE Trans. Neural Networks.

[19]  Claire Cardie,et al.  Opinion Mining with Deep Recurrent Neural Networks , 2014, EMNLP.

[20]  Shafiq R. Joty,et al.  Fine-grained Opinion Mining with Recurrent Neural Networks and Word Embeddings , 2015, EMNLP.

[21]  Roman Klinger,et al.  Classical Probabilistic Models and Conditional Random Fields , 2007 .

[22]  Razvan C. Bunescu,et al.  Sentiment analyzer: extracting sentiments about a given topic using natural language processing techniques , 2003, Third IEEE International Conference on Data Mining.

[23]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[24]  Lei Zhang,et al.  A Survey of Opinion Mining and Sentiment Analysis , 2012, Mining Text Data.