PubMed searches by Dutch-speaking nursing students: The impact of language and system experience

This study analyzes the search behavior of Dutch-speaking nursing students with a nonnative knowledge of English who searched for information in MEDLINE/PubMed about a specific theme in nursing. We examine whether and to what extent their search efficiency is affected by their language skills. Our task-oriented approach focuses on three stages of the information retrieval process: need articulation, query formulation, and relevance judgment. The test participants completed a pretest questionnaire, which gave us information about their overall experience with the search system and their self-reported computer and language skills. The students were briefly introduced to the use of PubMed and MeSH (medical subject headings) before they conducted their keyword-driven subject search. We assessed the search results in terms of recall and precision, and also analyzed the search process. After the search task, a satisfaction survey and a language test were completed. We conclude that language skills have an impact on the search results. We hypothesize that language support might improve the efficiency of searches conducted by Dutch-speaking users of PubMed. © 2012 Wiley Periodicals, Inc.

[1]  Amanda Spink,et al.  Searching the Web: the public and their queries , 2001 .

[2]  Gary Marchionini,et al.  Editorial: Evaluating exploratory search systems , 2008 .

[3]  Jimmy J. Lin,et al.  How do users find things with PubMed?: towards automatic utility evaluation with user simulations , 2008, SIGIR '08.

[4]  Elmer V. Bernstam,et al.  A day in the life of PubMed: analysis of a typical day's query log. , 2007, Journal of the American Medical Informatics Association : JAMIA.

[5]  Sergio A. Alvarez,et al.  An exact analytical relation among recall , precision , and classification accuracy in information retrieval , 2002 .

[6]  Anne Aula,et al.  Query Formulation in Web Information Search , 2003, ICWI.

[7]  Li Bin,et al.  The retrieval effectiveness of medical information on the web , 2001, Int. J. Medical Informatics.

[8]  Mu-Hsuan Huang.  Pausal behavior of end-users in online searching , 2003, Inf. Process. Manag..

[9]  Carol H. Fenichel,et al.  Online searching: Measures that discriminate among users with different types of experiences , 1981, J. Am. Soc. Inf. Sci..

[10]  K. A. McKibbon,et al.  Problems encountered by clinical end users of MEDLINE and GRATEFUL MED. , 1991, Bulletin of the Medical Library Association.

[11]  William L. Miller,et al.  THE EXTENSION OF USERS' LITERATURE AWARENESS AS A MEASURE OF RETRIEVAL PERFORMANCE, AND ITS APPLICATION TO MEDLARS , 1971 .

[12]  G Eysenbach,et al.  Evaluation of the usefulness of Internet searches to identify unpublished clinical trials for systematic reviews. , 2001, Medical informatics and the Internet in medicine.

[13]  Winifred Sewell,et al.  Observations of end-user online searching behavior over eleven years , 1986, J. Am. Soc. Inf. Sci..

[14]  W. John Wilbur,et al.  Spelling correction in the PubMed search engine , 2006, Information Retrieval.

[15]  T. D. Wilson,et al.  Models in information behaviour research , 1999, J. Documentation.

[16]  Fredric C. Gey,et al.  The Relationship between Recall and Precision , 1994, J. Am. Soc. Inf. Sci..

[17]  Alistair G. Sutcliffe,et al.  Empirical studies of end-user information searching , 2000, J. Am. Soc. Inf. Sci..

[18]  Dirk Wendt,et al.  Value of information for decisions , 1969 .

[19]  Alistair G. Sutcliffe,et al.  Towards a cognitive theory of information retrieval , 1998, Interact. Comput..

[20]  Iwan G. J. H. Wopereis,et al.  Differences between novice and experienced users in searching information on the World Wide Web , 2000, J. Am. Soc. Inf. Sci..

[21]  Pertti Vakkari,et al.  Changes of search terms and tactics while writing a research proposal: A longitudinal case study , 2003, Inf. Process. Manag..

[22]  K. A. McKibbon,et al.  Online access to medline in clinical settings , 2020 .

[23]  E Mouillet,et al.  Language barriers and bibliographic retrieval effectiveness: use of MEDLINE by French-speaking end users. , 1999, Bulletin of the Medical Library Association.

[24]  L C Kingsland,et al.  Coach: applying UMLS knowledge sources in an expert searcher environment. , 1993, Bulletin of the Medical Library Association.

[25]  R. Lankamp,et al.  A study on the effect of terminology on L2 reading comprehension : should specialist terms in medical texts be avoided? , 1990 .

[26]  K. A. McKibbon,et al.  Online access to MEDLINE in clinical settings. A study of use and usefulness. , 1990, Annals of internal medicine.

[27]  Thomas L. Jacobson,et al.  Computer, system, and subject knowledge in novice searching of a full-text, multifile database , 1992 .

[28]  Fang Liu,et al.  SLIM: an alternative Web interface for MEDLINE/PubMed searches – a preliminary study , 2005, BMC Medical Informatics Decis. Mak..