Preclude: Conflict detection in textual health advice

With the rapid digitalization of the health sector, people often turn to mobile apps and online health websites for health advice. Health advice generated from different sources can be conflicting as they address different aspects of health (e.g., weight loss, diet, disease) or as they are unaware of the context of a user (e.g., age, gender, physiological condition). Conflicts can occur due to lexical features, (such as, negation, antonyms, or numerical mismatch) or can be conditioned upon time and/or physiological status. We formulate the problem of finding conflicting health advice and develop a comprehensive taxonomy of conflicts. While a similar research area in the natural language processing domain explores the problem of textual contradiction identification, finding conflicts in health advice poses its own unique lexical and semantic challenges. These include large structural variation between text and hypothesis pairs, finding conceptual overlap between pairs of advice, and inference of the semantics of an advice (i.e., what to do, why and how). Hence, we develop Preclude, a novel semantic rule-based solution to detect conflicting health advice derived from heterogeneous sources utilizing linguistic rules and external knowledge bases. As our solution is interpretable and comprehensive, it can guide users towards conflict resolution too. We evaluate Preclude using 1156 real advice statements covering 8 important health topics that are collected from smart phone health apps and popular health websites. Preclude results in 90% accuracy and outperforms the accuracy and F1 score of the baseline approach by about 1.5 times and 3 times, respectively.

[1]  Tadashi Okoshi,et al.  Attelia: Reducing user's cognitive load due to interruptive notifications on smart phones , 2015, 2015 IEEE International Conference on Pervasive Computing and Communications (PerCom).

[2]  K. Vainio,et al.  Multiple Information Sources and Consequences of Conflicting Information About Medicine Use During Pregnancy: A Multinational Internet-Based Survey , 2014, Journal of medical Internet research.

[3]  Joseph A. Diaz,et al.  Patients’ use of the internet for medical information , 2002, Journal of General Internal Medicine.

[4]  Ayan Banerjee,et al.  Rapid evidence-based development of mobile medical IoT apps , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[5]  Mark Stevenson,et al.  Automatic identification of potentially contradictory claims to support systematic reviews , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[6]  Doug Downey,et al.  It’s a Contradiction – no, it’s not: A Case Study using Functional Relations , 2008, EMNLP.

[7]  Ayan Banerjee,et al.  Your mobility can be injurious to your health: Analyzing pervasive health monitoring systems under dynamic context changes , 2012, 2012 IEEE International Conference on Pervasive Computing and Communications.

[8]  Dan Klein,et al.  Feature-Rich Part-of-Speech Tagging with a Cyclic Dependency Network , 2003, NAACL.

[9]  Takashi Onishi,et al.  Detecting Contradiction in Text by Using Lexical Mismatch and Structural Similarity , 2013, NTCIR.

[10]  Julie N. Stromer,et al.  Medical applications: a database and characterization of apps in Apple iOS and Android platforms , 2014, BMC Research Notes.

[11]  G. Miller,et al.  A Semantic Network of English Verbs , 1998 .

[12]  Richard Tzong-Han Tsai,et al.  Validating Contradiction in Texts Using Online Co-Mention Pattern Checking , 2012, TALIP.

[13]  P. Krebs,et al.  Health App Use Among US Mobile Phone Owners: A National Survey , 2015, JMIR mHealth and uHealth.

[14]  Robert L. Hester,et al.  HumMod: A Modeling Environment for the Simulation of Integrative Human Physiology , 2011, Front. Physio..

[15]  John Eastwood,et al.  Oxford Guide to English Grammar , 1994 .

[16]  Alan R. Aronson,et al.  An overview of MetaMap: historical perspective and recent advances , 2010, J. Am. Medical Informatics Assoc..

[17]  J. Fleiss Measuring nominal scale agreement among many raters. , 1971 .

[18]  R. Ferner,et al.  The pathophysiology of medication errors: how and where they arise. , 2009, British journal of clinical pharmacology.

[19]  Mi Zhang,et al.  MyBehavior: automatic personalized health feedback from user behaviors and preferences using smartphones , 2015, UbiComp.

[20]  Rainer Bromme,et al.  Dealing with Conflicting or Consistent Medical Information on the Web: When Expert Information Breeds Laypersons' Doubts about Experts. , 2011 .

[21]  E. Coiera,et al.  Impact of Web Searching and Social Feedback on Consumer Decision Making: A Prospective Online Experiment , 2008, Journal of medical Internet research.

[22]  Mark V. Williams,et al.  Health literacy and knowledge of chronic disease. , 2003, Patient education and counseling.

[23]  2017 IEEE International Conference on Pervasive Computing and Communications, PerCom 2017, Kona, Big Island, HI, USA, March 13-17, 2017 , 2017, PerCom.

[24]  E. Obiodu,et al.  An Empirical Review of the Top 500 Medical Apps in a European Android Market , 2012 .

[25]  David Garlan,et al.  Project Aura: Toward Distraction-Free Pervasive Computing , 2002, IEEE Pervasive Comput..

[26]  Sirajum Munir,et al.  EyePhy: Detecting Dependencies in Cyber-Physical System Apps due to Human-in-the-Loop , 2015, EAI Endorsed Trans. e Learn..

[27]  Christopher D. Manning,et al.  Finding Contradictions in Text , 2008, ACL.

[28]  Angela J. Deokar,et al.  Self-Reported Increased Confusion or Memory Loss and Associated Functional Difficulties Among Adults Aged ≥60 Years — 21 States, 2011 , 2013, MMWR. Morbidity and mortality weekly report.

[29]  Angel X. Chang,et al.  SUTime: A library for recognizing and normalizing time expressions , 2012, LREC.

[30]  George Forman,et al.  An Extensive Empirical Study of Feature Selection Metrics for Text Classification , 2003, J. Mach. Learn. Res..

[31]  Mihai Surdeanu,et al.  The Stanford CoreNLP Natural Language Processing Toolkit , 2014, ACL.