SSN-SPARKS at SemEval-2019 Task 9: Mining Suggestions from Online Reviews using Deep Learning Techniques on Augmented Data

This paper describes the work on mining the suggestions from online reviews and forums. Opinion mining detects whether the comments are positive, negative or neutral, while suggestion mining explores the review content for the possible tips or advice. The system developed by SSN-SPARKS team in SemEval-2019 for task 9 (suggestion mining) uses a rule-based approach for feature selection, SMOTE technique for data augmentation and deep learning technique (Convolutional Neural Network) for classification. We have compared the results with Random Forest classifier (RF) and MultiLayer Perceptron (MLP) model. Results show that the CNN model performs better than other models for both the subtasks.

[1]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[2]  Paul Buitelaar,et al.  Towards the Extraction of Customer-to-Customer Suggestions from Reviews , 2015, EMNLP.

[3]  Benno Stein,et al.  A Review Corpus for Argumentation Analysis , 2014, CICLing.

[4]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[5]  Pushpak Bhattacharyya,et al.  IITP at IJCNLP-2017 Task 4: Auto Analysis of Customer Feedback using CNN and GRU Network , 2017, IJCNLP.

[6]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[7]  Paul Buitelaar,et al.  Inducing Distant Supervision in Suggestion Mining through Part-of-Speech Embeddings , 2017, ArXiv.

[8]  T. T. Mirnalinee,et al.  SSN MLRG1 at SemEval-2018 Task 1: Emotion and Sentiment Intensity Detection Using Rule Based Feature Selection , 2018, *SEMEVAL.

[9]  Lokendra Shastri,et al.  Suggestion Mining from Customer Reviews , 2011, AMCIS.

[10]  Paul Buitelaar,et al.  SemEval-2019 Task 9: Suggestion Mining from Online Reviews and Forums , 2019, *SEMEVAL.

[11]  Babis Theodoulidis,et al.  Analyzing Customer Experience Feedback Using Text Mining , 2014 .

[12]  Caroline Brun,et al.  Suggestion Mining: Detecting Suggestions for Improvement in Users' Comments , 2013, Res. Comput. Sci..

[13]  Paul Buitelaar,et al.  Open Domain Suggestion Mining: Problem Definition and Datasets , 2018, ArXiv.

[14]  Sapna Negi,et al.  Suggestion Mining from Opinionated Text , 2016, ACL.

[15]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[16]  Paul Buitelaar,et al.  A Study of Suggestions in Opinionated Texts and their Automatic Detection , 2016, *SEMEVAL.

[17]  Niranjan Pedanekar,et al.  Wishful Thinking - Finding suggestions and ’buy’ wishes from product reviews , 2010, HLT-NAACL 2010.

[18]  T. T. Mirnalinee,et al.  SSN MLRG1 at SemEval-2018 Task 3: Irony Detection in English Tweets Using MultiLayer Perceptron , 2018, SemEval@NAACL-HLT.