Lost in translation? A multilingual Query Builder improves the quality of PubMed queries: a randomised controlled trial

BackgroundMEDLINE is the most widely used medical bibliographic database in the world. Most of its citations are in English and this can be an obstacle for some researchers to access the information the database contains. We created a multilingual query builder to facilitate access to the PubMed subset using a language other than English. The aim of our study was to assess the impact of this multilingual query builder on the quality of PubMed queries for non-native English speaking physicians and medical researchers.MethodsA randomised controlled study was conducted among French speaking general practice residents. We designed a multi-lingual query builder to facilitate information retrieval, based on available MeSH translations and providing users with both an interface and a controlled vocabulary in their own language. Participating residents were randomly allocated either the French or the English version of the query builder. They were asked to translate 12 short medical questions into MeSH queries. The main outcome was the quality of the query. Two librarians blind to the arm independently evaluated each query, using a modified published classification that differentiated eight types of errors.ResultsTwenty residents used the French version of the query builder and 22 used the English version. 492 queries were analysed. There were significantly more perfect queries in the French group vs. the English group (respectively 37.9% vs. 17.9%; p < 0.01). It took significantly more time for the members of the English group than the members of the French group to build each query, respectively 194 sec vs. 128 sec; p < 0.01.ConclusionsThis multi-lingual query builder is an effective tool to improve the quality of PubMed queries in particular for researchers whose first language is not English.

[1]  P. Younger Internet-based information-seeking behaviour amongst doctors and nurses: a short review of the literature. , 2010, Health information and libraries journal.

[2]  Fiona M. Callaghan,et al.  Do Language Fluency and Other Socioeconomic Factors Influence the Use of PubMed and MedlinePlus? , 2013, Applied Clinical Informatics.

[3]  Fang Liu,et al.  PICO Linguist and BabelMeSH: Development and Partial Evaluation of Evidence-based Multilanguage Search Tools for MEDLINE/PubMed , 2007, MedInfo.

[4]  James J. Cimino,et al.  Supporting infobuttons with terminological knowledge , 1997, AMIA.

[5]  Pierre Frémont,et al.  A systematic review of interventions promoting clinical information retrieval technology (CIRT) adoption by healthcare professionals , 2010, Int. J. Medical Informatics.

[6]  R. Thiele,et al.  Speed, accuracy, and confidence in Google, Ovid, PubMed, and UpToDate: results of a randomised trial , 2010, Postgraduate Medical Journal.

[7]  Stéfan Jacques Darmoni,et al.  Optimization of the PubMed Automatic Term Mapping , 2009, MIE.

[8]  Elmer V. Bernstam,et al.  A day in the life of PubMed: analysis of a typical day's query log. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[9]  Nicolas Griffon,et al.  Behavior and attitudes of residents and general practitioners in searching for health information: From intention to practice , 2016, Int. J. Medical Informatics.

[10]  K. Davies,et al.  The information-seeking behaviour of doctors: a review of the evidence. , 2007, Health information and libraries journal.

[11]  Parker Magin,et al.  GP trainees' in-consultation information-seeking: associations with human, paper and electronic sources. , 2015, Family practice.

[12]  H. C. Coumou,et al.  How do primary care physicians seek answers to clinical questions? A literature review. , 2006, Journal of the Medical Library Association : JMLA.

[13]  Fang Liu,et al.  BabelMeSH: Development of a Cross-Language Tool for MEDLINE/PubMed , 2006, AMIA.

[14]  C E Lipscomb,et al.  Medical Subject Headings (MeSH). , 2000, Bulletin of the Medical Library Association.

[15]  Klaar Vanopstal,et al.  PubMed searches by Dutch-speaking nursing students: The impact of language and system experience , 2012, J. Assoc. Inf. Sci. Technol..

[16]  Sue Lacey Bryant,et al.  The information needs and information seeking behaviour of family doctors. , 2004, Health information and libraries journal.

[17]  Lina Fatima Soualmia,et al.  A Search Engine to Access PubMed Monolingual Subsets: Proof of Concept and Evaluation in French , 2014, Journal of medical Internet research.

[18]  Antonio Jimeno-Yepes,et al.  Combining MEDLINE and publisher data to create parallel corpora for the automatic translation of biomedical text , 2013, BMC Bioinformatics.

[19]  Carl Heneghan,et al.  Using the Turning Research Into Practice (TRIP) database: how do clinicians really search? , 2007, Journal of the Medical Library Association : JMLA.

[20]  Klaar Vanopstal,et al.  Lost in PubMed. Factors influencing the success of medical information retrieval , 2013, Expert Syst. Appl..