Explicitly integrating MeSH thesaurus help into health information retrieval systems: An empirical user study

When consumers search for health information, a major obstacle is their unfamiliarity with the medical terminology. Even though medical thesauri such as the Medical Subject Headings (MeSH) and related tools (e.g., the MeSH Browser) were created to help consumers find medical term definitions, the lack of direct and explicit integration of these help tools into a health retrieval system prevented them from effectively achieving their objectives. To explore this issue, we conducted an empirical study with two systems: One is a simple interface system supporting query-based searching; the other is an augmented system with two new components supporting MeSH term searching and MeSH tree browsing. A total of 45 subjects were recruited to participate in the study. The results indicated that the augmented system is more effective than the simple system in terms of improving user-perceived topic familiarity and question-answer performance, even though we did not find users spend more time on the augmented system. The two new MeSH help components played a critical role in participants' health information retrieval and were found to allow them to develop new search strategies. The findings of the study enhanced our understanding of consumers' search behaviors and shed light on the design of future health information retrieval systems.

[1]  Johanna Enberg,et al.  Query Expansion , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[2]  Jaana Kristensen,et al.  Expanding End-Users' Query Statements for Free Text Searching with a Search-Aid Thesaurus , 1993, Inf. Process. Manag..

[3]  Padmini Srinivasan,et al.  Research Paper: Retrieval Feedback in MEDLINE , 1996, J. Am. Medical Informatics Assoc..

[4]  Elmer V. Bernstam,et al.  A day in the life of PubMed: analysis of a typical day's query log. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[5]  Linda A. Watson,et al.  Information Retrieval: A Health and Biomedical Perspective. , 2005 .

[6]  Georg Göbel,et al.  A MeSH based intelligent search intermediary for Consumer Health Information Systems , 2001, Int. J. Medical Informatics.

[7]  Jason William Clark Information retrieval: a health and biomedical perspective. 3rd ed. , 2014 .

[8]  William R. Hersh,et al.  Research Paper: A Performance and Failure Analysis of SAPHIRE with a MEDLINE Test Collection , 1994, J. Am. Medical Informatics Assoc..

[9]  L. Porterfield,et al.  Estrogen replacement therapy. , 1991, Advancing clinical care : official journal of NOAADN.

[10]  Gary Marchionini,et al.  Examining the effectiveness of real-time query expansion , 2007, Inf. Process. Manag..

[11]  Diane Kelly,et al.  The effects of topic familiarity on information search behavior , 2002, JCDL '02.

[12]  Jin Zhang,et al.  Visualization of health-subject analysis based on query term co-occurrences , 2008, J. Assoc. Inf. Sci. Technol..

[13]  Robert M Plovnick,et al.  Reformulation of Consumer Health Queries with Professional Terminology: A Pilot Study , 2004, Journal of medical Internet research.

[14]  Somani P.,et al.  Beta blockers? , 1970, Nature.

[15]  Alla Keselman,et al.  Research Paper: Consumer Health Information Seeking as Hypothesis Testing , 2008, J. Am. Medical Informatics Assoc..

[16]  Mary Shultz,et al.  Variations in Medical Subject Headings (MeSH) mapping: from the natural language of patron terms to the controlled vocabulary of mapped lists. , 2002, Journal of the Medical Library Association : JMLA.

[17]  Ellen M. Voorhees,et al.  Query expansion using lexical-semantic relations , 1994, SIGIR '94.

[18]  Mary Shultz,et al.  Mapping of medical acronyms and initialisms to Medical Subject Headings (MeSH) across selected systems. , 2006, Journal of the Medical Library Association : JMLA.

[19]  Elaine Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[20]  Bryce Allen,et al.  Cognitive and task influences on Web searching behavior , 2002, J. Assoc. Inf. Sci. Technol..

[21]  Zhiyong Lu,et al.  Evaluation of query expansion using MeSH in PubMed , 2009, Information Retrieval.

[22]  Gary Marchionini,et al.  User studies informing E-table interfaces , 2003, Inf. Process. Manag..

[23]  R. J. Cline,et al.  Consumer health information seeking on the Internet: the state of the art. , 2001, Health education research.

[24]  M. E. Maron,et al.  An evaluation of retrieval effectiveness for a full-text document-retrieval system , 1985, CACM.

[25]  Raya Fidel,et al.  Terminological Knowledge Structure for Intermediary Expert Systems , 1995, Inf. Process. Manag..

[26]  Barbara M. Wildemuth,et al.  The effects of domain knowledge on search tactic formulation , 2004, J. Assoc. Inf. Sci. Technol..

[27]  W. Brewer,et al.  Role of schemata in memory for places , 1981, Cognitive Psychology.

[28]  James P. Callan,et al.  Experiments Using the Lemur Toolkit , 2001, TREC.

[29]  Pertti Vakkari,et al.  Subject Knowledge, Source of Terms, and Term Selection in Query Expansion: An Analytical Study , 2002, ECIR.

[30]  Pertti Vakkari,et al.  Lay persons' and professionals' nutrition-related vocabularies and their matching to a general and a specific thesaurus , 2009, J. Inf. Sci..

[31]  Gary Marchionini Information Seeking in Full-Text End-User-Oriented Search Systems: The Roles of Domain and Search Expertise , 1993 .

[32]  Yi Li,et al.  Exploring criteria for successful query expansion in the genomic domain , 2009, Information Retrieval.

[33]  Qing Zeng-Treitler,et al.  Research Paper: Assisting Consumer Health Information Retrieval with Query Recommendations , 2006, J. Am. Medical Informatics Assoc..

[34]  P. Smith,et al.  A review of ontology based query expansion , 2007, Inf. Process. Manag..

[35]  W. John Wilbur,et al.  How to interpret PubMed queries and why it matters , 2009, J. Assoc. Inf. Sci. Technol..

[36]  Padmini Srinivasan,et al.  Query Expansion and MEDLINE , 1996, Inf. Process. Manag..

[37]  Enrico W. Coiera,et al.  Research Paper: Is Relevance Relevant? User Relevance Ratings May Not Predict the Impact of Internet Search on Decision Outcomes , 2008, J. Am. Medical Informatics Assoc..

[38]  P. Srinivasan Retrieval feedback in MEDLINE. , 1996, Journal of the American Medical Informatics Association : JAMIA.

[39]  Ali Shiri,et al.  The effects of topic complexity and familiarity on cognitive and physical moves in a thesaurus-enhanced search environment , 2003, J. Inf. Sci..

[40]  R A Greenes,et al.  Characteristics of Consumer Terminology for Health Information Retrieval , 2002, Methods of Information in Medicine.

[41]  P. Grimaud [Cerebral palsy]. , 1972, Pediatrie.

[42]  E. Toms,et al.  What is user engagement? A conceptual framework for defining user engagement with technology , 2008, J. Assoc. Inf. Sci. Technol..

[43]  R. Heine,et al.  Diabetic gastroparesis. , 2007, The New England journal of medicine.

[44]  Thomas C. Rindflesch,et al.  Query Expansion Using the UMLS ® Metathesaurus ® , 1997 .

[45]  Muh-Chyun Tang Browsing and searching in a faceted information space: A naturalistic study of PubMed users' interaction with a display tool , 2007 .

[46]  William R. Hersh,et al.  Assessing thesaurus-based query expansion using the UMLS Metathesaurus , 2000, AMIA.

[47]  Jane Greenberg Automatic query expansion via lexical-semantic relationships , 2001, J. Assoc. Inf. Sci. Technol..

[48]  Damaraju Raghavarao,et al.  Block Designs: Analysis, Combinatorics and Applications , 2005 .

[49]  R. Steinbrook Searching for the right search--reaching the medical literature. , 2006, The New England journal of medicine.

[50]  Dagobert Soergel,et al.  Helping Healthcare Consumers Understand: An "Interpretive Layer" for Finding and Making Sense of Medical Information , 2004, MedInfo.

[51]  Muh-Chyun Tang Browsing and searching in a faceted information space: A naturalistic study of PubMed users' interaction with a display tool , 2007, J. Assoc. Inf. Sci. Technol..