Enabling Deeper Linguistic-Based Text Analytics—Construct Development for the Criticality of Negative Service Experience

Significant progress has been made in linguistic-based text analytics particularly with the increasing availability of data and deep learning computational models for more accurate opinion analysis and domain-specific entity recognition. In understanding customer service experience from texts, analysis of sentiments associated with different stages of the service lifecycle is a useful starting point. However, when richer insights into issues associated with negative sentiments and experiences are desired to inform intervention, deeper linguistic analyses such as identifying specific touchpoints and the context of the service users become important. While research in this direction is beginning to emerge in some domains, we are yet to see similar efforts in the domain of healthcare. We present in this paper the results from our construct development effort for quantifying how critical a negative patient experience is using different elements of the available textual feedback as a key basis for prioritizing interventions by service providers. This involves the identification of the different dimensions of the construct, associated linguistic markers and metrics to compute the criticality index. We also present the results of the application of our developed conceptualization to linguistic-based text analysis of a small dataset of patient experience feedback.

[1]  Yu Zhang,et al.  Extracting implicit features in online customer reviews for opinion mining , 2013, WWW '13 Companion.

[2]  Sujin Kim,et al.  Content analysis of cancer blog posts. , 2009, Journal of the Medical Library Association : JMLA.

[3]  Christopher S. G. Khoo,et al.  Textual and Informational Characteristics of Health-Related Social Media Content: A Study of Drug Review Forums , 2011 .

[4]  Wu He,et al.  Actionable Social Media Competitive Analytics For Understanding Customer Experiences , 2016, J. Comput. Inf. Syst..

[5]  Sabine Bergler,et al.  Mining WordNet for a Fuzzy Sentiment: Sentiment Tag Extraction from WordNet Glosses , 2006, EACL.

[6]  P. Pasquini,et al.  Factors associated with patient satisfaction with care among dermatological outpatients , 2001, The British journal of dermatology.

[7]  Bing Liu,et al.  Sentiment Analysis and Opinion Mining , 2012, Synthesis Lectures on Human Language Technologies.

[8]  A. Choudhary,et al.  Mining millions of reviews: a technique to rank products based on importance of reviews , 2011, ICEC '11.

[9]  Bo Pang,et al.  Thumbs up? Sentiment Classification using Machine Learning Techniques , 2002, EMNLP.

[10]  S. Moore Commentary on "realist evaluation as a framework for the assessment of teaching about the improvement of care". , 2009, The Journal of nursing education.

[11]  Rashid Ali,et al.  Book recommendation system using opinion mining technique , 2013, 2013 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[12]  P. Escolar-Reina,et al.  Relevant patient perceptions and experiences for evaluating quality of interaction with physiotherapists during outpatient rehabilitation: a qualitative study. , 2014, Physiotherapy.

[13]  Simon M. Lin,et al.  Collecting and Analyzing Patient Experiences of Health Care From Social Media , 2015, JMIR research protocols.

[14]  G. Noci,et al.  How to Sustain the Customer Experience:: An Overview of Experience Components that Co-create Value With the Customer , 2007 .

[15]  Mark Greenwood,et al.  Text mining patient experiences from online health communities , 2015 .

[16]  Khairullah Khan,et al.  Mining opinion components from unstructured reviews: A review , 2014, J. King Saud Univ. Comput. Inf. Sci..

[17]  Sapna Negi,et al.  Suggestion Mining from Opinionated Text , 2016, ACL.

[18]  F. Misopoulos,et al.  Uncovering customer service experiences with Twitter: the case of airline industry , 2014 .

[19]  Paul Buitelaar,et al.  SemEval-2019 Task 9: Suggestion Mining from Online Reviews and Forums , 2019, *SEMEVAL.

[20]  Zillur Rahman,et al.  Evaluating a model for analyzing methods used for measuring customer experience , 2010 .

[21]  George Hripcsak,et al.  A temporal constraint structure for extracting temporal information from clinical narrative , 2006, J. Biomed. Informatics.

[22]  G. Higginbottom,et al.  The use of focused ethnography in nursing research. , 2013, Nurse researcher.

[23]  J. Goldim,et al.  Medication errors: classification of seriousness, type, and of medications involved in the reports from a university teaching hospital , 2013 .

[24]  Alexander Mikroyannidis,et al.  Heraclitus II: A Framework for Ontology Management and Evolution , 2006, 2006 IEEE/WIC/ACM International Conference on Web Intelligence (WI 2006 Main Conference Proceedings)(WI'06).

[25]  Shourya Roy,et al.  Text to Intelligence: Building and Deploying a Text Mining Solution in the Services Industry for Customer Satisfaction Analysis , 2008, 2008 IEEE International Conference on Services Computing.

[26]  V. Champion,et al.  Instrument development for health belief model constructs , 1984, ANS. Advances in nursing science.

[27]  Han Tong Loh,et al.  Gather customer concerns from online product reviews - A text summarization approach , 2009, Expert Syst. Appl..

[28]  Lillian Lee,et al.  Opinion Mining and Sentiment Analysis , 2008, Found. Trends Inf. Retr..

[29]  M. Al-Hussami,et al.  Patients' perception of the quality of nursing care and related hospital services , 2017 .

[30]  M. Fetters,et al.  Adverse events in primary care identified from a risk-management database. , 1997, The Journal of family practice.

[31]  Q. Ye,et al.  Determinants of Customer Satisfaction in the Hotel Industry: An Application of Online Review Analysis , 2013 .

[32]  Kerstin Denecke,et al.  Sentiment Analysis from Medical Texts , 2015 .

[33]  Vijay K. Vaishnavi,et al.  Design Science Research Methods and Patterns: Innovating Information and Communication Technology, 2nd Edition , 2007 .

[34]  Kathleen R. McKeown,et al.  Predicting the semantic orientation of adjectives , 1997 .

[35]  Niranjan Pedanekar,et al.  Wishful Thinking - Finding suggestions and ’buy’ wishes from product reviews , 2010, HLT-NAACL 2010.

[36]  K. Pritchard-Jones,et al.  Insights into the experiences of patients with cancer in London: framework analysis of free-text data from the National Cancer Patient Experience Survey 2012/2013 from the two London Integrated Cancer Systems , 2015, BMJ Open.

[37]  J. Algeo A Comprehensive Grammar of the English Language. By Randolph Quirk, Sidney Greenbaum, Geoffrey Leech, and Jan Svartvik. London: Longman. 1985. x + 1779 , 1987 .

[38]  Caroline Brun,et al.  Opinion and Suggestion Analysis for Expert Recommendations , 2012 .

[39]  G. C. Pascoe,et al.  Patient satisfaction in primary health care: a literature review and analysis. , 1983, Evaluation and program planning.

[40]  Wenji Mao,et al.  Polarity Classification of Public Health Opinions in Chinese , 2008, ISI Workshops.

[41]  Xue Xiao,et al.  Case-based reasoning and text mining for green building decision making , 2017 .

[42]  Alok N. Choudhary,et al.  Voice of the Customers: Mining Online Customer Reviews for Product Feature-based Ranking , 2010, WOSN.

[43]  P. Ting,et al.  Using Big Data and Text Analytics to Understand How Customer Experiences Posted on Yelp.com Impact the Hospitality Industry , 2017 .

[44]  V. Braun,et al.  Using thematic analysis in psychology , 2006 .

[45]  Burairah Hussin,et al.  Opinion Mining of Movie Review using Hybrid Method of Support Vector Machine and Particle Swarm Optimization , 2013 .

[46]  Ivan Titov,et al.  Modeling online reviews with multi-grain topic models , 2008, WWW.

[47]  Venky Shankararaman,et al.  Text analytics approach to extract course improvement suggestions from students’ feedback , 2018, Research and Practice in Technology Enhanced Learning.

[48]  Yibai Li,et al.  Business intelligence in online customer textual reviews: Understanding consumer perceptions and influential factors , 2017, Int. J. Inf. Manag..

[49]  L. Spencer,et al.  Qualitative data analysis for applied policy research , 2002 .

[50]  Caroline Brun,et al.  Suggestion Mining: Detecting Suggestions for Improvement in Users' Comments , 2013, Res. Comput. Sci..

[51]  Samaneh Moghaddam,et al.  Beyond Sentiment Analysis: Mining Defects and Improvements from Customer Feedback , 2015, ECIR.

[52]  G. Guest,et al.  Data Reduction Techniques for Large Qualitative Data Sets , 2007 .

[53]  Bing Liu,et al.  Sentiment Analysis and Subjectivity , 2010, Handbook of Natural Language Processing.

[54]  Vinodhini Gopalakrishnan,et al.  Patient opinion mining to analyze drugs satisfaction using supervised learning , 2017 .

[55]  Jenni Burt,et al.  Web-Based Textual Analysis of Free-Text Patient Experience Comments From a Survey in Primary Care , 2015, JMIR medical informatics.

[56]  Philip S. Yu,et al.  A holistic lexicon-based approach to opinion mining , 2008, WSDM '08.

[57]  Andy Koronios,et al.  Data, Information, Knowledge, Wisdom (DIKW): A Semiotic Theoretical and Empirical Exploration of the Hierarchy and its Quality Dimension , 2013, Australas. J. Inf. Syst..

[58]  A. Darzi,et al.  Machine learning and sentiment analysis of unstructured free-text information about patient experience online , 2012, The Lancet.

[59]  Xun Xu,et al.  Predicting overall customer satisfaction: Big data evidence from hotel online textual reviews , 2019, International Journal of Hospitality Management.

[60]  F. Wong,et al.  Patients' perceptions of their experiences with nurse-patient communication in oncology settings: A focused ethnographic study , 2018, PloS one.

[61]  Janyce Wiebe,et al.  Recognizing subjectivity: a case study in manual tagging , 1999, Natural Language Engineering.

[62]  Martin Ester,et al.  The FLDA model for aspect-based opinion mining: addressing the cold start problem , 2013, WWW.

[63]  Claire Cardie,et al.  Joint Extraction of Entities and Relations for Opinion Recognition , 2006, EMNLP.

[64]  Mehdi Yousefi,et al.  Feature Extraction and Classification of Movie Reviews , 2018, 2018 5th International Conference on Soft Computing & Machine Intelligence (ISCMI).

[65]  Janyce Wiebe,et al.  RECOGNIZING STRONG AND WEAK OPINION CLAUSES , 2006, Comput. Intell..

[66]  Rayid Ghani,et al.  Text mining for product attribute extraction , 2006, SKDD.

[67]  S. Chlabicz,et al.  Open-ended questions in surveys of patients' satisfaction with family doctors , 2007, Journal of health services research & policy.

[68]  Yi Luo,et al.  What Airbnb Reviews can Tell us? An Advanced Latent Aspect Rating Analysis Approach , 2018 .

[69]  Binny Joseph,et al.  A fine grained evaluation and mining of E-commerce feedback comments , 2017, 2017 International Conference on Circuit ,Power and Computing Technologies (ICCPCT).

[70]  M. Wells,et al.  Qualitative analysis of 6961 free-text comments from the first National Cancer Patient Experience Survey in Scotland , 2017, BMJ Open.

[71]  David M. Pennock,et al.  Mining the peanut gallery: opinion extraction and semantic classification of product reviews , 2003, WWW '03.

[72]  M. Bracher,et al.  Exploration and analysis of free-text comments from the 2013 Wales Cancer Patient Experience Survey (WCPES) , 2014 .

[73]  F. Okumus,et al.  Understanding Satisfied and Dissatisfied Hotel Customers: Text Mining of Online Hotel Reviews , 2016 .

[74]  Venky Shankararaman,et al.  Extracting implicit suggestions from students’ comments: A text analytics approach , 2017 .

[75]  Rim Faiz,et al.  Extracting Product Features for Opinion Mining Using Public Conversations in Twitter , 2017, KES.

[76]  Durga Toshniwal,et al.  Feature based Summarization of Customers' Reviews of Online Products , 2013, KES.

[77]  Jan Holub,et al.  Emotion models for textual emotion classification , 2016 .

[78]  Mark Lycett,et al.  Identifying patient experience from online resources via sentiment analysis and topic modelling , 2016, BDCAT.

[79]  Shyamal K. Purani,et al.  PATIENT SATISFACTION ABOUT HEALTH CARE SERVICES: A CROSS SECTIONAL STUDY OF PATIENTS WHO VISIT THE OUTPATIENT DEPARTMENT OF A CIVIL HOSPITAL AT SURENDRANAGAR, GUJARAT , 2013 .

[80]  Fazal Masud Kundi,et al.  Medical opinion lexicon: an incremental model for mining health reviews , 2014 .

[81]  Carol Friedman,et al.  Natural language processing: State of the art and prospects for significant progress, a workshop sponsored by the National Library of Medicine , 2013, J. Biomed. Informatics.

[82]  Japinder Singh,et al.  Feature-based opinion mining and ranking , 2012, J. Comput. Syst. Sci..

[83]  Kentaro Inui,et al.  Experience Mining: Building a Large-Scale Database of Personal Experiences and Opinions from Web Documents , 2008, 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[84]  Bing Liu,et al.  Opinion observer: analyzing and comparing opinions on the Web , 2005, WWW '05.

[85]  Christopher S. G. Khoo,et al.  Sentiment lexicons for health-related opinion mining , 2012, IHI '12.

[86]  Adam P. Dicker,et al.  Identifying Barriers to Patient Acceptance of Active Surveillance: Content Analysis of Online Patient Communications , 2013, PloS one.

[87]  Vasiliki Mantzana,et al.  Identifying healthcare actors involved in the adoption of information systems , 2007, Eur. J. Inf. Syst..

[88]  Maria Liakata,et al.  Using clinical Natural Language Processing for health outcomes research: Overview and actionable suggestions for future advances , 2018, J. Biomed. Informatics.

[89]  S. LaVela,et al.  Defining Patient Experience , 2014 .

[90]  Andrés Montoyo,et al.  Applying a culture dependent emotion triggers database for text valence and emotion classification , 2008, Proces. del Leng. Natural.

[91]  Z. Schwartz,et al.  What can big data and text analytics tell us about hotel guest experience and satisfaction , 2015 .

[92]  N. Gale,et al.  Using the framework method for the analysis of qualitative data in multi-disciplinary health research , 2013, BMC Medical Research Methodology.

[93]  S. Sofaer,et al.  Patient perceptions of the quality of health services. , 2005, Annual review of public health.

[94]  Frédéric Béchet,et al.  Opinion mining in a telephone survey corpus , 2006, INTERSPEECH.

[95]  T. Jones Ethical Decision Making by Individuals in Organizations: An Issue-Contingent Model , 1991 .

[96]  Jahanzeb Jabbar,et al.  Real-time Sentiment Analysis On E-Commerce Application , 2019, 2019 IEEE 16th International Conference on Networking, Sensing and Control (ICNSC).

[97]  Babis Theodoulidis,et al.  Analyzing Customer Experience Feedback Using Text Mining , 2014 .

[98]  Oren Etzioni,et al.  OPINE: Extracting Product Features and Opinions from Reviews , 2005, HLT/EMNLP.

[99]  B. McNeil,et al.  Patient satisfaction as an indicator of quality care. , 1988, Inquiry : a journal of medical care organization, provision and financing.

[100]  Maite Taboada,et al.  Methods for Creating Semantic Orientation Dictionaries , 2006, LREC.

[101]  N. Gunawardena,et al.  Development of an instrument to measure patient perception of the quality of nursing care and related hospital services at the national hospital of sri lanka. , 2011, Asian nursing research.

[102]  Andrea Esuli,et al.  PageRanking WordNet Synsets: An Application to Opinion Mining , 2007, ACL.

[103]  Harsh Jhamtani,et al.  Identifying Suggestions for Improvement of Product Features from Online Product Reviews , 2015, SocInfo.

[104]  Anna Lisa Gentile,et al.  Improving Patient Opinion Mining through Multi-step Classification , 2009, TSD.

[105]  Christopher Scaffidi,et al.  Application of a Probability-Based Algorithm to Extraction of Product Features from Online Reviews , 2006 .

[106]  A. Glaser,et al.  Qualitative analysis of patients’ feedback from a PROMs survey of cancer patients in England , 2013, BMJ Open.

[107]  V. Smrithi Rekha,et al.  Recommending products to customers using opinion mining of online product reviews and features , 2015, 2015 International Conference on Circuits, Power and Computing Technologies [ICCPCT-2015].

[108]  J. Keziya Rani,et al.  Mining Opinion Features in Customer Reviews. , 2016 .

[109]  Montse Cuadros,et al.  Automatic analysis of textual hotel reviews , 2015, Information Technology & Tourism.

[110]  M. Simon,et al.  Development and testing of a text-mining approach to analyse patients’ comments on their experiences of colorectal cancer care , 2015, BMJ Quality & Safety.

[111]  Rashid Ali,et al.  Feature extraction and analysis of online reviews for the recommendation of books using opinion mining technique , 2016 .

[112]  Houda Benbrahim,et al.  Product Opinion Mining for Competitive Intelligence , 2015 .