Understanding patient reviews with minimum supervision

Understanding patient opinions expressed towards healthcare services in online platforms could allow healthcare professionals to respond to address patients' concerns in a timely manner. Extracting patient opinion towards various aspects of health services is closely related to aspect-based sentiment analysis (ABSA) in which we need to identify both opinion targets and target-specific opinion expressions. The lack of aspect-level annotations however makes it difficult to build such an ABSA system. This paper proposes a joint learning framework for simultaneous unsupervised aspect extraction at the sentence level and supervised sentiment classification at the document level. It achieves 98.2% sentiment classification accuracy when tested on the reviews about healthcare services collected from Yelp, outperforming several strong baselines. Moreover, our model can extract coherent aspects and can automatically infer the distribution of aspects under different polarities without requiring aspect-level annotations for model learning.

[1]  Sinno Jialin Pan,et al.  Transition-based Adversarial Network for Cross-lingual Aspect Extraction , 2018, IJCAI.

[2]  Zhiyuan Liu,et al.  Neural Sentiment Classification with User and Product Attention , 2016, EMNLP.

[3]  Hwee Tou Ng,et al.  An Unsupervised Neural Attention Model for Aspect Extraction , 2017, ACL.

[4]  Qin Lu,et al.  Intersubjectivity and Sentiment: From Language to Knowledge , 2016, IJCAI.

[5]  Haris Papageorgiou,et al.  SemEval-2016 Task 5: Aspect Based Sentiment Analysis , 2016, *SEMEVAL.

[6]  A. Jha,et al.  A Changing Landscape of Physician Quality Reporting: Analysis of Patients’ Online Ratings of Their Physicians Over a 5-Year Period , 2012, Journal of medical Internet research.

[7]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[8]  Said Ouatik El Alaoui,et al.  SemBioNLQA: A semantic biomedical question answering system for retrieving exact and ideal answers to natural language questions , 2020, Artif. Intell. Medicine.

[9]  Simon M. Lin,et al.  Collecting and Analyzing Patient Experiences of Health Care From Social Media , 2015, JMIR research protocols.

[10]  Xuanjing Huang,et al.  A Lexicon-Based Supervised Attention Model for Neural Sentiment Analysis , 2018, COLING.

[11]  Lidong Bing,et al.  Recurrent Attention Network on Memory for Aspect Sentiment Analysis , 2017, EMNLP.

[12]  Xin Li,et al.  Aspect Term Extraction with History Attention and Selective Transformation , 2018, IJCAI.

[13]  Philip S. Yu,et al.  Double Embeddings and CNN-based Sequence Labeling for Aspect Extraction , 2018, ACL.

[14]  Yogesh Kumar Meena,et al.  A two-step hybrid unsupervised model with attention mechanism for aspect extraction , 2020, Expert Syst. Appl..

[15]  Jenni Burt,et al.  Web-Based Textual Analysis of Free-Text Patient Experience Comments From a Survey in Primary Care , 2015, JMIR medical informatics.

[16]  Mark Stevenson,et al.  Evaluating Topic Coherence Using Distributional Semantics , 2013, IWCS.

[17]  Adam Wright,et al.  Measuring patient-perceived quality of care in US hospitals using Twitter , 2015, BMJ Quality & Safety.

[18]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[19]  Suresh Manandhar,et al.  SemEval-2015 Task 12: Aspect Based Sentiment Analysis , 2015, *SEMEVAL.

[20]  Michael Röder,et al.  Exploring the Space of Topic Coherence Measures , 2015, WSDM.

[21]  Kam-Fai Wong,et al.  Convolution-based Memory Network for Aspect-based Sentiment Analysis , 2018, SIGIR.

[22]  Andreas Holzinger,et al.  Use of Sentiment Analysis for Capturing Patient Experience From Free-Text Comments Posted Online , 2013, Journal of medical Internet research.

[23]  Diyi Yang,et al.  Hierarchical Attention Networks for Document Classification , 2016, NAACL.

[24]  Ting Liu,et al.  Document Modeling with Gated Recurrent Neural Network for Sentiment Classification , 2015, EMNLP.

[25]  Hwee Tou Ng,et al.  Effective Attention Modeling for Aspect-Level Sentiment Classification , 2018, COLING.

[26]  Xin Wang,et al.  Predicting Polarities of Tweets by Composing Word Embeddings with Long Short-Term Memory , 2015, ACL.

[27]  Noah A. Smith,et al.  Neural Models for Documents with Metadata , 2017, ACL.

[28]  Christopher Millett,et al.  Consistently Increasing Numbers of Online Ratings of Healthcare in England , 2012, Journal of medical Internet research.

[29]  R. Fitzpatrick,et al.  Developing approaches to the collection and use of evidence of patient experience below the level of national surveys , 2016 .

[30]  Stefan M. Rüger,et al.  Weakly Supervised Joint Sentiment-Topic Detection from Text , 2012, IEEE Transactions on Knowledge and Data Engineering.

[31]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[32]  Phil Blunsom,et al.  Neural Variational Inference for Text Processing , 2015, ICML.

[33]  Ting Liu,et al.  Aspect Level Sentiment Classification with Deep Memory Network , 2016, EMNLP.

[34]  Luis Alfonso Ureña López,et al.  How do we talk about doctors and drugs? Sentiment analysis in forums expressing opinions for medical domain , 2019, Artif. Intell. Medicine.

[35]  Janyce Wiebe,et al.  Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis , 2005, HLT.

[36]  Suresh Manandhar,et al.  SemEval-2014 Task 4: Aspect Based Sentiment Analysis , 2014, *SEMEVAL.

[37]  Manabu Torii,et al.  Feasibility of Real-Time Satisfaction Surveys Through Automated Analysis of Patients' Unstructured Comments and Sentiments , 2012, Quality management in health care.

[38]  Timothy Baldwin,et al.  Automatic Evaluation of Topic Coherence , 2010, NAACL.

[39]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[40]  D. Barron,et al.  The National Adult Inpatient Survey conducted in the English National Health Service from 2002 to 2009: how have the data been used and what do we know as a result? , 2012, BMC Health Services Research.

[41]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[42]  Chengqing Zong,et al.  Document-level Multi-aspect Sentiment Classification by Jointly Modeling Users, Aspects, and Overall Ratings , 2018, COLING.

[43]  Louise Locock,et al.  Collecting data on patient experience is not enough: they must be used to improve care , 2014, BMJ : British Medical Journal.

[44]  Andreas van Cranenburgh,et al.  Embarrassingly Simple Unsupervised Aspect Extraction , 2020, ACL.