An Investigation of Recursive Auto-associative Memory in Sentiment Detection

The rise of blogs, forums, social networks and review websites in recent years has provided very accessible and convenient platforms for people to express thoughts, views or attitudes about topics of interest. In order to collect and analyse opinionated content on the Internet, various sentiment detection techniques have been developed based on an integration of part-of-speech tagging, negation handling, lexicons and classifiers. A popular unsupervised approach, SO-LSA (Semantic Orientation from Latent Semantic Analysis), uses a term-document matrix to detect the semantic orientation of words according to their similarities to a predefined set of seed terms. This paper proposes a novel and subsymbolic approach in sentiment detection, with a level of accuracy comparable to the baseline, SO-LSA, using a special type of Artificial Neural Networks (ANN), an auto-encoder called Recursive Auto-Associative Memory (RAAM).

[1]  Jordan B. Pollack,et al.  Recursive Distributed Representations , 1990, Artif. Intell..

[2]  Bo Pang,et al.  Seeing Stars: Exploiting Class Relationships for Sentiment Categorization with Respect to Rating Scales , 2005, ACL.

[3]  R. Miikkulainen,et al.  Forming global representations with extended backpropagation , 1988, IEEE 1988 International Conference on Neural Networks.

[4]  T. Landauer,et al.  A Solution to Plato's Problem: The Latent Semantic Analysis Theory of Acquisition, Induction, and Representation of Knowledge. , 1997 .

[5]  Christiane Fellbaum,et al.  Book Reviews: WordNet: An Electronic Lexical Database , 1999, CL.

[6]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[7]  David J. Chalmers,et al.  Syntactic Transformations on Distributed Representations , 1990 .

[8]  Alistair Kennedy,et al.  SENTIMENT CLASSIFICATION of MOVIE REVIEWS USING CONTEXTUAL VALENCE SHIFTERS , 2006, Comput. Intell..

[9]  Janyce Wiebe,et al.  Learning Subjective Language , 2004, CL.

[10]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[11]  Bo Pang,et al.  A Sentimental Education: Sentiment Analysis Using Subjectivity Summarization Based on Minimum Cuts , 2004, ACL.

[12]  Casey Whitelaw Using Appraisal Taxonomies for Sentiment Analysis , 2005 .

[13]  Hermann Moisl,et al.  Artificial Neural Networks and Natural Language Processing , 2010 .

[14]  Chun Kit Wong Recursive auto-associative memory as connectionist language processing model : training improvements via hybrid neural-genetic schemata , 2004 .

[15]  D. Mladení,et al.  TRIPLET EXTRACTION FROM SENTENCES , 2007 .

[16]  Andrea Esuli,et al.  SENTIWORDNET: A Publicly Available Lexical Resource for Opinion Mining , 2006, LREC.

[17]  Michael L. Littman,et al.  Measuring praise and criticism: Inference of semantic orientation from association , 2003, TOIS.