Capturing the Patient’s Perspective: a Review of Advances in Natural Language Processing of Health-Related Text

Background: Natural Language Processing (NLP) methods are increasingly being utilized to mine knowledge from unstructured health-related texts. Recent advances in noisy text processing techniques are enabling researchers and medical domain experts to go beyond the information encapsulated in published texts (e.g., clinical trials and systematic reviews) and structured questionnaires, and obtain perspectives from other unstructured sources such as Electronic Health Records (EHRs) and social media posts. Objectives: To review the recently published literature discussing the application of NLP techniques for mining health-related information from EHRs and social media posts. Methods: Literature review included the research published over the last five years based on searches of PubMed, conference proceedings, and the ACM Digital Library, as well as on relevant publications referenced in papers. We particularly focused on the techniques employed on EHRs and social media data. Results: A set of 62 studies involving EHRs and 87 studies involving social media matched our criteria and were included in this paper. We present the purposes of these studies, outline the key NLP contributions, and discuss the general trends observed in the field, the current state of research, and important outstanding problems. Conclusions: Over the recent years, there has been a continuing transition from lexical and rule-based systems to learning-based approaches, because of the growth of annotated data sets and advances in data science. For EHRs, publicly available annotated data is still scarce and this acts as an obstacle to research progress. On the contrary, research on social media mining has seen a rapid growth, particularly because the large amount of unlabeled data available via this resource compensates for the uncertainty inherent to the data. Effective mechanisms to filter out noise and for mapping social media expressions to standard medical concepts are crucial and latent research problems. Shared tasks and other competitive challenges have been driving factors behind the implementation of open systems, and they are likely to play an imperative role in the development of future systems.

[1]  Timothy Baldwin,et al.  Lexical normalization for social media text , 2013, TIST.

[2]  Ying Li,et al.  Validating drug repurposing signals using electronic health records: a case study of metformin associated with reduced cancer mortality , 2014, J. Am. Medical Informatics Assoc..

[3]  Carol Friedman,et al.  A broad-coverage natural language processing system , 2000, AMIA.

[4]  Abeed Sarker,et al.  Portable automatic text classification for adverse drug reaction detection via multi-corpus training , 2015, J. Biomed. Informatics.

[5]  Zhengxing Huang,et al.  On mining latent topics from healthcare chat logs , 2016, J. Biomed. Informatics.

[6]  Annice Kim,et al.  Comparing Twitter and Online Panels for Survey Recruitment of E-Cigarette Users and Smokers , 2016, Journal of medical Internet research.

[7]  Víctor M. Prieto,et al.  Twitter: A Good Place to Detect Health Conditions , 2014, PloS one.

[8]  Xin Liu,et al.  An automatic system to identify heart disease risk factors in clinical texts over time , 2015, J. Biomed. Informatics.

[9]  Thang Nguyen,et al.  The University of Maryland CLPsych 2015 Shared Task System , 2015, CLPsych@HLT-NAACL.

[10]  Xiaoyan Zhu,et al.  GeneTUKit: a software for document-level gene normalization , 2011, Bioinform..

[11]  Mizuki Morita,et al.  Twitter Catches The Flu: Detecting Influenza Epidemics using Twitter , 2011, EMNLP.

[12]  Rafael A. Calvo,et al.  CLPsych 2016 Shared Task: Triaging content in online peer-support forums , 2016, CLPsych@HLT-NAACL.

[13]  Mark Dredze,et al.  Detecting Changes in Suicide Content Manifested in Social Media Following Celebrity Suicides , 2015, HT.

[14]  Nigel Collier,et al.  Learning Orthographic Features in Bi-directional LSTM for Biomedical Named Entity Recognition , 2016, BioTxtM@COLING 2016.

[15]  Stéphane M. Meystre,et al.  UtahBMI at SemEval-2016 Task 12: Extracting Temporal Information from Clinical Text , 2016, *SEMEVAL.

[16]  Pradeep Kumar Ray,et al.  TMUNSW: Identification of Disorders and Normalization to SNOMED-CT Terminology in Unstructured Clinical Notes , 2015, *SEMEVAL.

[17]  Erik M. van Mulligen,et al.  Using rule-based natural language processing to improve disease normalization in biomedical text , 2012, J. Am. Medical Informatics Assoc..

[18]  Christophe G. Giraud-Carrier,et al.  Prevalence and Attitudes about Illicit and Prescription Drugs on Twitter , 2016, 2016 IEEE International Conference on Healthcare Informatics (ICHI).

[19]  Graciela Gonzalez-Hernandez,et al.  Pharmacovigilance on Twitter? Mining Tweets for Adverse Drug Reactions , 2014, AMIA.

[20]  Nello Cristianini,et al.  Tracking the flu pandemic by monitoring the social web , 2010, 2010 2nd International Workshop on Cognitive Information Processing.

[21]  Cécile Paris,et al.  An Approach for Query-Focused Text Summarisation for Evidence Based Medicine , 2013, AIME.

[22]  Guan Wang,et al.  A method for systematic discovery of adverse drug events from clinical notes , 2015, J. Am. Medical Informatics Assoc..

[23]  Kevin Bretonnel Cohen,et al.  Biomedical Natural Language Processing , 2014 .

[24]  Nigel Collier,et al.  Adapting Phrase-based Machine Translation to Normalise Medical Terms in Social Media Messages , 2015, EMNLP.

[25]  Amrish Patel,et al.  ezDI: A Supervised NLP System for Clinical Narrative Analysis , 2015, *SEMEVAL.

[26]  Eric Horvitz,et al.  Major life changes and behavioral markers in social media: case of childbirth , 2013, CSCW.

[27]  D Demner-Fushman,et al.  Aspiring to Unintended Consequences of Natural Language Processing: A Review of Recent Developments in Clinical and Consumer-Generated Text Processing , 2016, Yearbook of Medical Informatics.

[28]  Kevin A Padrez,et al.  Twitter as a Tool for Health Research: A Systematic Review , 2017, American journal of public health.

[29]  Graciela Gonzalez-Hernandez,et al.  Towards generating a patient's timeline: Extracting temporal relationships from clinical notes , 2013, J. Biomed. Informatics.

[30]  Mark Dredze,et al.  Exploring Health Topics in Chinese Social Media: An Analysis of Sina Weibo , 2014, AAAI 2014.

[31]  Nigam H. Shah,et al.  Automated Detection of Off-Label Drug Use , 2014, PloS one.

[32]  Alan R. Aronson,et al.  Effective mapping of biomedical text to the UMLS Metathesaurus: the MetaMap program , 2001, AMIA.

[33]  Graciela Gonzalez,et al.  Phonetic Spelling Filter for Keyword Selection in Drug Mention Mining from Social Media , 2014, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[34]  Chen Lin,et al.  Automatic identification of methotrexate-induced liver toxicity in patients with rheumatoid arthritis from the electronic medical record , 2015, J. Am. Medical Informatics Assoc..

[35]  Ekaterina Buyko,et al.  Resolution of Coordination Ellipses in Biological Named Entities Using Conditional Random Fields , 2007 .

[36]  Michael J. Paul,et al.  Twitter Improves Influenza Forecasting , 2014, PLoS currents.

[37]  Sang Won Yoon,et al.  Predictive modeling of hospital readmissions using metaheuristics and data mining , 2015, Expert Syst. Appl..

[38]  Martijn J Schuemie,et al.  Methods for drug safety signal detection in longitudinal observational databases: LGPS and LEOPARD , 2011, Pharmacoepidemiology and drug safety.

[39]  Li Wang,et al.  How Noisy Social Media Text, How Diffrnt Social Media Sources? , 2013, IJCNLP.

[40]  Rohit J. Kate.  Normalizing clinical terms using learned edit distance patterns , 2016, J. Am. Medical Informatics Assoc..

[41]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[42]  Sharon L R Kardia,et al.  Facebook Advertising Across an Engagement Spectrum: A Case Example for Public Health Communication , 2016, JMIR public health and surveillance.

[43]  Svetha Venkatesh,et al.  DeepCare: A Deep Dynamic Memory Model for Predictive Medicine , 2016, PAKDD.

[44]  M. Rastegar-Mojarad,et al.  DETECTING SIGNALS IN NOISY DATA-CAN ENSEMBLE CLASSIFIERS HELP IDENTIFY ADVERSE DRUG REACTION IN TWEETS ? , 2015 .

[45]  Jan A. Kors,et al.  Evaluating Social Media Networks in Medicines Safety Surveillance: Two Case Studies , 2015, Drug Safety.

[46]  Georgina Kennedy,et al.  Characterizing Twitter Discussions About HPV Vaccines Using Topic Modeling and Community Detection , 2016, Journal of medical Internet research.

[47]  Rachel E. Ginn,et al.  Social Media Mining for Toxicovigilance: Automatic Monitoring of Prescription Medication Abuse from Twitter , 2016, Drug Safety.

[48]  Michael J. Paul,et al.  Using Social Media to Perform Local Influenza Surveillance in an Inner-City Hospital: A Retrospective Observational Study , 2015, JMIR public health and surveillance.

[49]  Kerstin Denecke,et al.  Information Extraction from Medical Social Media , 2015 .

[50]  Sanna Salanterä,et al.  Overview of the ShARe/CLEF eHealth Evaluation Lab 2013 , 2013, CLEF.

[51]  C. Forrest,et al.  Advances in Patient-Reported Outcomes: The NIH PROMIS® Measures , 2013, EGEMS.

[52]  Nigel Collier,et al.  Towards the Semantic Interpretation of Personal Health Messages from Social Media , 2015, UCUI@CIKM.

[53]  P Zweigenbaum,et al.  Clinical Natural Language Processing in 2014: Foundational Methods Supporting Efficient Healthcare , 2015, Yearbook of Medical Informatics.

[54]  S. Ramagopalan,et al.  Using Twitter to investigate opinions about multiple sclerosis treatments: a descriptive, exploratory study , 2014, F1000Research.

[55]  Fei Liu,et al.  A Broad-Coverage Normalization System for Social Media Language , 2012, ACL.

[56]  Rebecka Weegar,et al.  Creating a rule based system for text mining of Norwegian breast cancer pathology reports , 2015, Louhi@EMNLP.

[57]  James P Witter.  The Promise of Patient-Reported Outcomes Measurement Information System-Turning Theory into Reality: A Uniform Approach to Patient-Reported Outcomes Across Rheumatic Diseases. , 2016, Rheumatic diseases clinics of North America.

[58]  Hong-Jie Dai,et al.  Identification and Progression of Heart Disease Risk Factors in Diabetic Patients from Longitudinal Electronic Health Records , 2015, BioMed research international.

[59]  Richard Bonneau,et al.  Text Classification for Automatic Detection of E-Cigarette Use and Use for Smoking Cessation from Twitter: A Feasibility Pilot , 2016, PSB.

[60]  Xinmiao Li,et al.  A Global Optimization Approach to Multi-Polarity Sentiment Analysis , 2015, PloS one.

[61]  John F. Hurdle,et al.  Extracting Information from Textual Documents in the Electronic Health Record: A Review of Recent Research , 2008, Yearbook of Medical Informatics.

[62]  Hsinchun Chen,et al.  A research framework for pharmacovigilance in health social media: Identification and evaluation of patient adverse drug event reports , 2015, J. Biomed. Informatics.

[63]  Pradeep Kumar Ray,et al.  Coronary artery disease risk assessment from unstructured electronic health records using text mining , 2015, J. Biomed. Informatics.

[64]  Danielle L. Mowery,et al.  BluLab: Temporal Information Extraction for the 2015 Clinical TempEval Challenge , 2015, *SEMEVAL.

[65]  Abeed Sarker,et al.  Finding Potentially Unsafe Nutritional Supplements from User Reviews with Topic Modeling , 2016, PSB.

[66]  Lisa Gandy,et al.  Characterizing the Discussion of Antibiotics in the Twittersphere: What is the Bigger Picture? , 2015, Journal of medical Internet research.

[67]  James Pustejovsky,et al.  SemEval-2015 Task 6: Clinical TempEval , 2015, *SEMEVAL.

[68]  Sophia Ananiadou,et al.  Learning string similarity measures for gene/protein name dictionary look-up using logistic regression , 2007, Bioinform..

[69]  WENTING WANG.  MINING ADVERSE DRUG REACTION MENTIONS IN TWITTER WITH WORD EMBEDDINGS , 2015 .

[70]  Nigam H Shah,et al.  Impact of Predicting Health Care Utilization Via Web Search Behavior: A Data-Driven Analysis , 2016, Journal of medical Internet research.

[71]  Julie A. Bettinger,et al.  Examining Perceptions about Mandatory Influenza Vaccination of Healthcare Workers through Online Comments on News Stories , 2015, PloS one.

[72]  Zina M. Ibrahim,et al.  Identification of Adverse Drug Events from Free Text Electronic Patient Records and Information in a Large Mental Health Case Register , 2015, PloS one.

[73]  Goran Nenadic,et al.  Combining rules and machine learning for extraction of temporal expressions and events from clinical narratives , 2013, J. Am. Medical Informatics Assoc..

[74]  Ying Li,et al.  A method for controlling complex confounding effects in the detection of adverse drug reactions using electronic health records , 2014, J. Am. Medical Informatics Assoc..

[75]  Michael J. Paul,et al.  Discovering Health Topics in Social Media Using Topic Models , 2014, PloS one.

[76]  James Pustejovsky,et al.  SemEval-2017 Task 12: Clinical TempEval , 2017, *SEMEVAL.

[77]  Svetha Venkatesh,et al.  Predicting Risk of Suicide Attempt Using History of Physical Illnesses From Electronic Medical Records , 2016, JMIR mental health.

[78]  Zhiyong Lu,et al.  Recommending MeSH terms for annotating biomedical articles , 2011, J. Am. Medical Informatics Assoc..

[79]  Ramakanth Kavuluru,et al.  Toward automated e-cigarette surveillance: Spotting e-cigarette proponents on Twitter , 2016, J. Biomed. Informatics.

[80]  Claire Cardie,et al.  Major Life Event Extraction from Twitter based on Congratulations/Condolences Speech Acts , 2014, EMNLP.

[81]  Gerjo Kok,et al.  Disease Detection or Public Opinion Reflection? Content Analysis of Tweets, Other Social Media, and Online Newspapers During the Measles Outbreak in the Netherlands in 2013 , 2015, Journal of medical Internet research.

[82]  Regina Barzilay,et al.  Using machine learning to parse breast pathology reports , 2016, bioRxiv.

[83]  Hui Xiong,et al.  Temporal Phenotyping from Longitudinal Electronic Health Records: A Graph Based Framework , 2015, KDD.

[84]  Petra Kralj Novak,et al.  Sentiment of Emojis , 2015, PloS one.

[85]  Ben Shneiderman,et al.  Aligning temporal data by sentinel events: discovering patterns in electronic health records , 2008, CHI.

[86]  B. Freeman,et al.  Please Like Me: Facebook and Public Health Communication , 2016, PloS one.

[87]  Abeed Sarker,et al.  Social media mining for identification and exploration of health-related information from pregnant women , 2017, ArXiv.

[88]  Karin M. Verspoor,et al.  Towards Early Discovery of Salient Health Threats: A Social Media Emotion Classification Technique , 2016, PSB.

[89]  Megan A Moreno,et al.  Using social media to engage adolescents and young adults with their health. , 2014, Healthcare.

[90]  Harith Alani,et al.  Personal Life Event Detection from Social Media , 2014, HT.

[91]  Jodi B Segal,et al.  Patient-reported Outcomes (PROs): Putting the Patient Perspective in Patient-centered Outcomes Research , 2013, Medical care.

[92]  Sunghwan Sohn,et al.  Mayo clinical Text Analysis and Knowledge Extraction System (cTAKES): architecture, component evaluation and applications , 2010, J. Am. Medical Informatics Assoc..

[93]  Chen Lin,et al.  Multilayered temporal modeling for the clinical domain , 2016, J. Am. Medical Informatics Assoc..

[94]  Dietrich Rebholz-Schuhmann,et al.  Assessment of disease named entity recognition on a corpus of annotated sentences , 2008, BMC Bioinformatics.

[95]  Girish Chavan,et al.  NOBLE – Flexible concept recognition for large-scale biomedical natural language processing , 2016, BMC Bioinformatics.

[96]  Yaoyun Zhang,et al.  UTH_CCB: A report for SemEval 2014 – Task 7 Analysis of Clinical Text , 2014, *SEMEVAL.

[97]  Joseph Futoma,et al.  A comparison of models for predicting early hospital readmissions , 2015, J. Biomed. Informatics.

[98]  Todd J. Bodnar,et al.  Identifying Adverse Effects of HIV Drug Treatment and Associated Sentiments Using Twitter , 2015, JMIR public health and surveillance.

[99]  Yaoyun Zhang,et al.  UTHealth at SemEval-2016 Task 12: an End-to-End System for Temporal Information Extraction from Clinical Notes , 2016, *SEMEVAL.

[100]  Robert L Cook,et al.  Evaluating Google, Twitter, and Wikipedia as Tools for Influenza Surveillance Using Bayesian Change Point Analysis: A Comparative Analysis , 2016, JMIR public health and surveillance.

[101]  Paloma Martínez,et al.  Exploring Spanish health social media for detecting drug effects , 2015, BMC Medical Informatics and Decision Making.

[102]  Ophir Frieder,et al.  Extracting Adverse Drug Reactions from Social Media , 2015, AAAI.

[103]  U. S. Department of Health and Human Services FDA Cen Research,et al.  Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance , 2006, Health and quality of life outcomes.

[104]  Harry Hochheiser,et al.  An information model for computable cancer phenotypes , 2016, BMC Medical Informatics and Decision Making.

[105]  Mark Dredze,et al.  Shared Task : Depression and PTSD on Twitter , 2015 .

[106]  Pierre Zweigenbaum,et al.  The Quaero French Medical Corpus : A Ressource for Medical Entity Recognition and Normalization , 2014 .

[107]  Abeed Sarker,et al.  Data, tools and resources for mining social media drug chatter , 2016, BioTxtM@COLING 2016.

[108]  Niek Sebastian Klazinga,et al.  Guidance on developing quality and safety strategies with a health system approach , 2008 .

[109]  Abeed Sarker,et al.  A corpus for mining drug-related knowledge from Twitter chatter: Language models and their utilities , 2016, Data in brief.

[110]  Graciela Gonzalez,et al.  The DIEGO Lab Graph Based Gene Normalization System , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[111]  Stefan M. Rüger,et al.  Adverse Drug Reaction Classification With Deep Neural Networks , 2016, COLING.

[112]  Abeed Sarker,et al.  Social Media Mining Shared Task Workshop , 2016, PSB.

[113]  Sriraam Natarajan,et al.  Markov logic networks for adverse drug event extraction from text , 2016, Knowledge and Information Systems.

[114]  Preslav Nakov,et al.  SemEval-2016 Task 4: Sentiment Analysis in Twitter , 2016, *SEMEVAL.

[115]  Carol A Gotway Crawford,et al.  A New Source of Data for Public Health Surveillance: Facebook Likes , 2015, Journal of medical Internet research.

[116]  Michael J. Paul,et al.  Twitter: big data opportunities. , 2014, Science.

[117]  Sophia Ananiadou,et al.  Analysis of the effect of sentiment analysis on extracting adverse drug reactions from tweets and forum posts , 2016, J. Biomed. Informatics.

[118]  Ingemar J. Cox,et al.  On Infectious Intestinal Disease Surveillance using Social Media Content , 2016, Digital Health.

[119]  Alok N. Choudhary,et al.  Real-time disease surveillance using Twitter data: demonstration on flu and cancer , 2013, KDD.

[120]  Sonja Zillner,et al.  Big Data in the Health Sector , 2016, New Horizons for a Data-Driven Economy.

[121]  Mowafa Said Househ,et al.  The Use of Social Media in Healthcare: Organizational, Clinical, and Patient Perspectives , 2013, ITCH.

[122]  Krishnaprasad Thirunarayan,et al.  “When ‘Bad’ is ‘Good’”: Identifying Personal Communication and Sentiment in Drug-Related Tweets , 2016, JMIR public health and surveillance.

[123]  Vagelis Hristidis,et al.  Pharmaceutical drugs chatter on Online Social Networks , 2014, J. Biomed. Informatics.

[124]  Dario A. Giuse,et al.  Development and evaluation of RapTAT: A machine learning system for concept mapping of phrases from medical narratives , 2014, J. Biomed. Informatics.

[125]  Olivier Bodenreider,et al.  The Unified Medical Language System (UMLS): integrating biomedical terminology , 2004, Nucleic Acids Res..

[126]  Syed Abdul Shabbir,et al.  Feature Engineering for Recognizing Adverse Drug Reactions from Twitter Posts , 2016, Inf..

[127]  Sunghwan Mac Kim,et al.  Data61-CSIRO systems at the CLPsych 2016 Shared Task , 2016, CLPsych@HLT-NAACL.

[128]  Graciela Gonzalez-Hernandez,et al.  Utilizing social media data for pharmacovigilance: A review , 2015, J. Biomed. Informatics.

[129]  Udo Hahn,et al.  High-performance gene name normalization with GENO , 2009, Bioinform..

[130]  K. Denecke.  Extracting Medical Concepts from Medical Social Media with Clinical NLP Tools : A Qualitative Study , 2014 .

[131]  Suzanne Stevenson,et al.  An Unsupervised Model for Text Message Normalization , 2009 .

[132]  Yaoyun Zhang,et al.  UTH-CCB: The Participation of the SemEval 2015 Challenge – Task 14 , 2015, *SEMEVAL.

[133]  Zhiyong Lu,et al.  Challenges in clinical natural language processing for automated disorder normalization , 2015, J. Biomed. Informatics.

[134]  Nigel Collier,et al.  OMG U got flu? Analysis of shared health messages for bio-surveillance , 2011, Semantic Mining in Biomedicine.

[135]  Fabio Rinaldi,et al.  Web Conversations About Complementary and Alternative Medicines and Cancer: Content and Sentiment Analysis , 2016, Journal of medical Internet research.

[136]  Jian Yang,et al.  Towards Internet-Age Pharmacovigilance: Extracting Adverse Drug Reactions from User Posts in Health-Related Social Networks , 2010, BioNLP@ACL.

[137]  Zhiyong Lu,et al.  DNorm: disease name normalization with pairwise learning to rank , 2013, Bioinform..

[138]  Animesh Mukherjee,et al.  Investigation and modeling of the structure of texting language , 2007, International Journal of Document Analysis and Recognition (IJDAR).

[139]  Sunghwan Sohn,et al.  Drug side effect extraction from clinical narratives of psychiatry and psychology patients , 2011, J. Am. Medical Informatics Assoc..

[140]  Ian Portelli,et al.  Drug Use in the Twittersphere: A Qualitative Contextual Analysis of Tweets About Prescription Drugs , 2015, Journal of addictive diseases.

[141]  Sarvnaz Karimi,et al.  Cadec: A corpus of adverse drug event annotations , 2015, J. Biomed. Informatics.

[142]  Noémie Elhadad,et al.  Information Extraction from Social Media for Public Health , 2014 .

[143]  Jon Patrick,et al.  Automatic population of structured reports from narrative pathology reports , 2014 .

[144]  Lang Li,et al.  Monitoring Potential Drug Interactions and Reactions via Network Analysis of Instagram User Timelines , 2015, PSB.

[145]  Carolyn Penstein Rosé,et al.  Extracting Events with Informal Temporal References in Personal Histories in Online Communities , 2013, ACL.

[146]  Urmimala Sarkar,et al.  The Canary in the Coal Mine Tweets: Social Media Reveals Public Perceptions of Non-Medical Use of Opioids , 2015, PloS one.

[147]  Xiangji Huang,et al.  Deep learning for healthcare decision making with EMRs , 2014, 2014 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[148]  Suresh Manandhar,et al.  SemEval-2014 Task 7: Analysis of Clinical Text , 2014, *SEMEVAL.

[149]  Xiang Wang,et al.  Unsupervised learning of disease progression models , 2014, KDD.

[150]  Alistair A. Young,et al.  Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) , 2017, MICCAI 2017.

[151]  P Zweigenbaum,et al.  Clinical Natural Language Processing in 2015: Leveraging the Variety of Texts of Clinical Interest , 2016, Yearbook of Medical Informatics.

[152]  Haihua Xu,et al.  NLP based congestive heart failure case finding: A prospective analysis on statewide electronic medical records , 2015, Int. J. Medical Informatics.

[153]  Nathan K. Cobb,et al.  Sentiment analysis to determine the impact of online messages on smokers' choices to use varenicline. , 2013, Journal of the National Cancer Institute. Monographs.

[154]  Jochen L. Leidner,et al.  Quantifying Self-Reported Adverse Drug Events on Twitter: Signal and Topic Analysis , 2016, SMSociety.

[155]  Pierre Zweigenbaum,et al.  Identification of Drug-Related Medical Conditions in Social Media , 2016, LREC.

[156]  Abeed Sarker,et al.  Pharmacovigilance from social media: mining adverse drug reaction mentions using sequence labeling with word embedding cluster features , 2015, J. Am. Medical Informatics Assoc..

[157]  Jing Zhao.  Temporal weighting of clinical events in electronic health records for pharmacovigilance , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[158]  Matthew Richardson,et al.  Towards Decision Support and Goal Achievement: Identifying Action-Outcome Relationships From Social Media , 2015, KDD.

[159]  Alan R. Aronson,et al.  An overview of MetaMap: historical perspective and recent advances , 2010, J. Am. Medical Informatics Assoc..

[160]  Son Doan,et al.  Mining Health-Related Issues in Consumer Product Reviews by Using Scalable Text Analytics , 2016, Biomedical informatics insights.