Helping each Other: A Framework for Customer-to-Customer Suggestion Mining using a Semi-supervised Deep Neural Network

Suggestion mining is increasingly becoming an important task along with sentiment analysis. In today's cyberspace world, people not only express their sentiments and dispositions towards some entities or services, but they also spend considerable time sharing their experiences and advice to fellow customers and the product/service providers with two-fold agenda: helping fellow customers who are likely to share a similar experience, and motivating the producer to bring specific changes in their offerings which would be more appreciated by the customers. In our current work, we propose a hybrid deep learning model to identify whether a review text contains any suggestion. The model employs semi-supervised learning to leverage the useful information from the large amount of unlabeled data. We evaluate the performance of our proposed model on a benchmark customer review dataset, comprising of the reviews of Hotel and Electronics domains. Our proposed approach shows the F-scores of 65.6% and 65.5% for the Hotel and Electronics review datasets, respectively. These performances are significantly better compared to the existing state-of-the-art system.

[1]  Paul Buitelaar,et al.  Towards the Extraction of Customer-to-Customer Suggestions from Reviews , 2015, EMNLP.

[2]  Bing Liu,et al.  Mining and summarizing customer reviews , 2004, KDD.

[3]  Christopher S. G. Khoo,et al.  Aspect-based sentiment analysis of movie reviews on discussion boards , 2010, J. Inf. Sci..

[4]  Deepak Kumar Gupta,et al.  PSO-ASent: Feature Selection Using Particle Swarm Optimization for Aspect Based Sentiment Analysis , 2015, NLDB.

[5]  Daniel P. W. Ellis,et al.  Feed-Forward Networks with Attention Can Solve Some Long-Term Memory Problems , 2015, ArXiv.

[6]  Pushpak Bhattacharyya,et al.  Combining Graph-based Dependency Features with Convolutional Neural Network for Answer Triggering , 2018, CICLing.

[7]  Anutosh Maitra,et al.  Semantic Question Matching in Data Constrained Environment , 2018, TSD.

[8]  Caroline Brun,et al.  Suggestion Mining: Detecting Suggestions for Improvement in Users' Comments , 2013, Res. Comput. Sci..

[9]  Paul Buitelaar,et al.  A Study of Suggestions in Opinionated Texts and their Automatic Detection , 2016, *SEMEVAL.

[10]  Pushpak Bhattacharyya,et al.  IITP at IJCNLP-2017 Task 4: Auto Analysis of Customer Feedback using CNN and GRU Network , 2017, IJCNLP.

[11]  Pushpak Bhattacharyya,et al.  A Deep Neural Network based Approach for Entity Extraction in Code-Mixed Indian Social Media Text , 2018, LREC.

[12]  Pushpak Bhattacharyya,et al.  Uncovering Code-Mixed Challenges: A Framework for Linguistically Driven Question Generation and Neural Based Question Answering , 2018, CoNLL.

[13]  Yajuan Duan,et al.  The Automated Acquisition of Suggestions from Tweets , 2013, AAAI.

[14]  Benno Stein,et al.  A Review Corpus for Argumentation Analysis , 2014, CICLing.

[15]  Deepak Kumar Gupta,et al.  IITP: Supervised Machine Learning for Aspect based Sentiment Analysis , 2014, SemEval@COLING.

[16]  Julian J. McAuley,et al.  Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering , 2016, WWW.

[17]  Hideaki Takeda,et al.  On the Identification of Suggestion Intents from Vietnamese Conversational Texts , 2017, SoICT.

[18]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[19]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Pushpak Bhattacharyya,et al.  Can Taxonomy Help? Improving Semantic Question Matching using Question Taxonomy , 2018, COLING.

[22]  Sung-Hyon Myaeng,et al.  Toward advice mining: conditional random fields for extracting advice-revealing text units , 2013, CIKM.