Answer Identification from Product Reviews for User Questions by Multi-Task Attentive Networks

Online Shopping has become a part of our daily routine, but it still cannot offer intuitive experience as store shopping. Nowadays, most e-commerce Websites offer a Question Answering (QA) system that allows users to consult other users who have purchased the product. However, users still need to wait patiently for others’ replies. In this paper, we investigate how to provide a quick response to the asker by plausible answer identification from product reviews. By analyzing the similarity and discrepancy between explicit answers and reviews that can be answers, a novel multi-task deep learning method with carefully designed attention mechanisms is developed. The method can well exploit large amounts of user generated QA data and a few manually labeled review data to address the problem. Experiments on data collected from Amazon demonstrate its effectiveness and superiority over competitive baselines.

[1]  Jianxin Li,et al.  Personalized Influential Topic Search via Social Network Summarization , 2016, IEEE Transactions on Knowledge and Data Engineering.

[2]  Bowen Zhou,et al.  Attentive Pooling Networks , 2016, ArXiv.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[5]  Julian J. McAuley,et al.  Addressing Complex and Subjective Product-Related Queries with Customer Reviews , 2015, WWW.

[6]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[7]  Martin Ester,et al.  AQA: Aspect-based Opinion Question Answering , 2011, 2011 IEEE 11th International Conference on Data Mining Workshops.

[8]  Preslav Nakov,et al.  SemEval-2017 Task 3: Community Question Answering , 2017, *SEMEVAL.

[9]  Yang Tang,et al.  Answering Opinion Questions with Random Walks on Graphs , 2009, ACL/IJCNLP.

[10]  Ming Zhou,et al.  Gated Self-Matching Networks for Reading Comprehension and Question Answering , 2017, ACL.

[11]  Yoshimasa Tsuruoka,et al.  A Joint Many-Task Model: Growing a Neural Network for Multiple NLP Tasks , 2016, EMNLP.

[12]  Min Chen,et al.  Deep Learning for Imbalanced Multimedia Data Classification , 2015, 2015 IEEE International Symposium on Multimedia (ISM).

[13]  Jason Weston,et al.  Question Answering with Subgraph Embeddings , 2014, EMNLP.

[14]  Lei Zhang,et al.  Sentiment Analysis and Opinion Mining , 2017, Encyclopedia of Machine Learning and Data Mining.

[15]  Seetha Hari,et al.  Learning From Imbalanced Data , 2019, Advances in Computer and Electrical Engineering.

[16]  Trevor Cohn,et al.  Low Resource Dependency Parsing: Cross-lingual Parameter Sharing in a Neural Network Parser , 2015, ACL.

[17]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[18]  Bowen Zhou,et al.  A Structured Self-attentive Sentence Embedding , 2017, ICLR.

[19]  Phil Blunsom,et al.  Reasoning about Entailment with Neural Attention , 2015, ICLR.

[20]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Chun Chen,et al.  Whom to mention: expand the diffusion of tweets by @ recommendation on micro-blogging systems , 2013, WWW '13.

[23]  Daniele Bonadiman,et al.  Effective shared representations with Multitask Learning for Community Question Answering , 2017, EACL.

[24]  Tat-Seng Chua,et al.  Answering Opinion Questions on Products by Exploiting Hierarchical Organization of Consumer Reviews , 2012, EMNLP.

[25]  Yongxin Yang,et al.  Trace Norm Regularised Deep Multi-Task Learning , 2016, ICLR.

[26]  Qiang Yang,et al.  An Overview of Multi-task Learning , 2018 .

[27]  Mengting Wan,et al.  Modeling Ambiguity, Subjectivity, and Diverging Viewpoints in Opinion Question Answering Systems , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[28]  Richard Socher,et al.  Dynamic Coattention Networks For Question Answering , 2016, ICLR.

[29]  Ali Farhadi,et al.  Bidirectional Attention Flow for Machine Comprehension , 2016, ICLR.