Identifying nurse staffing research in Medline: development and testing of empirically derived search strategies with the PubMed interface

BackgroundThe identification of health services research in databases such as PubMed/Medline is a cumbersome task. This task becomes even more difficult if the field of interest involves the use of diverse methods and data sources, as is the case with nurse staffing research. This type of research investigates the association between nurse staffing parameters and nursing and patient outcomes. A comprehensively developed search strategy may help identify nurse staffing research in PubMed/Medline.MethodsA set of relevant references in PubMed/Medline was identified by means of three systematic reviews. This development set was used to detect candidate free-text and MeSH terms. The frequency of these terms was compared to a random sample from PubMed/Medline in order to identify terms specific to nurse staffing research, which were then used to develop a sensitive, precise and balanced search strategy. To determine their precision, the newly developed search strategies were tested against a) the pool of relevant references extracted from the systematic reviews, b) a reference set identified from an electronic journal screening, and c) a sample from PubMed/Medline. Finally, all newly developed strategies were compared to PubMed's Health Services Research Queries (PubMed's HSR Queries).ResultsThe sensitivities of the newly developed search strategies were almost 100% in all of the three test sets applied; precision ranged from 6.1% to 32.0%. PubMed's HSR queries were less sensitive (83.3% to 88.2%) than the new search strategies. Only minor differences in precision were found (5.0% to 32.0%).ConclusionsAs with other literature on health services research, nurse staffing studies are difficult to identify in PubMed/Medline. Depending on the purpose of the search, researchers can choose between high sensitivity and retrieval of a large number of references or high precision, i.e. and an increased risk of missing relevant references, respectively. More standardized terminology (e.g. by consistent use of the term "nurse staffing") could improve the precision of future searches in this field. Empirically selected search terms can help to develop effective search strategies. The high consistency between all test sets confirmed the validity of our approach.

[1]  Sarah Anne Murphy,et al.  Research methodology search filters: are they effective for locating research for evidence-based veterinary medicine in PubMed? , 2003, Journal of the Medical Library Association : JMLA.

[2]  Arjen Hoogendam,et al.  Evaluation of PubMed filters used for evidence-based searching: validation using relative recall. , 2009, Journal of the Medical Library Association : JMLA.

[3]  R Brian Haynes,et al.  EMBASE search strategies achieved high sensitivity and specificity for retrieving methodologically sound systematic reviews. , 2007, Journal of clinical epidemiology.

[4]  T. Wilt,et al.  Nurse staffing and quality of patient care. , 2007, Evidence report/technology assessment.

[5]  Carol Lefebvre,et al.  How to identify randomized controlled trials in MEDLINE: ten years on. , 2006, Journal of the Medical Library Association : JMLA.

[6]  D. Moher,et al.  An alternative to the hand searching gold standard: validating methodological search filters using relative recall , 2006, BMC medical research methodology.

[7]  Carol Lefebvre,et al.  Identifying systematic reviews in MEDLINE: developing an objective approach to search strategy design , 1998, J. Inf. Sci..

[8]  Michelle Jenkins,et al.  Evaluation of methodological search filters--a review. , 2004, Health information and libraries journal.

[9]  Nancy L Wilczynski,et al.  Optimal CINAHL search strategies for identifying therapy studies and review articles. , 2006, Journal of nursing scholarship : an official publication of Sigma Theta Tau International Honor Society of Nursing.

[10]  Robert Brian Haynes,et al.  Retrieving randomized controlled trials from medline: a comparison of 38 published search filters. , 2009, Health information and libraries journal.

[11]  Sam Vincent,et al.  Clinical Evidence diagnosis: Developing a sensitive search strategy to retrieve diagnostic studies on deep vein thrombosis: a pragmatic approach. , 2003, Health information and libraries journal.

[12]  E. Lake,et al.  Are Patient Falls and Pressure Ulcers Sensitive to Nurse Staffing? , 2006, Western journal of nursing research.

[13]  M. Clarke,et al.  Handsearching versus electronic searching to identify reports of randomized trials. , 2002, The Cochrane database of systematic reviews.

[14]  R. Brian Haynes,et al.  Developing optimal search strategies for detecting clinically sound studies in MEDLINE. , 1994, Journal of the American Medical Informatics Association : JAMIA.

[15]  R. Brian Haynes,et al.  Robustness of empirical search strategies for clinical content in MEDLINE , 2002, AMIA.

[16]  Monika Kastner,et al.  Age-Specific Search Strategies for Medline , 2006, Journal of medical Internet research.

[17]  R. Haynes,et al.  Optimal search strategies for retrieving systematic reviews from Medline: analytical survey , 2004, BMJ : British Medical Journal.

[18]  Jennifer Tieman,et al.  Improving search filter development: a study of palliative care literature , 2007, BMC Medical Informatics Decis. Mak..

[19]  P. Royle,et al.  Making literature searches easier: a rapid and sensitive search filter for retrieving randomized controlled trials from PubMed , 2007, Diabetic medicine : a journal of the British Diabetic Association.

[20]  Ellen Balka,et al.  Nurse staffing levels and hospital mortality in critical care settings: literature review and meta-analysis. , 2006, Journal of advanced nursing.

[21]  K. Shojania,et al.  Taking advantage of the explosion of systematic reviews: an efficient MEDLINE search strategy. , 2001, Effective clinical practice : ECP.

[22]  Karen A Robinson,et al.  Development of a highly sensitive search strategy for the retrieval of reports of controlled trials using PubMed. , 2002, International journal of epidemiology.

[23]  R. Haynes,et al.  Optimal search strategies for detecting health services research studies in MEDLINE , 2004, Canadian Medical Association Journal.

[24]  Carol Lefebvre,et al.  The effect of postings information on searching behaviour A statistical approach to designing search filters to find systematic reviews : objectivity enhances accuracy , 2001 .

[25]  R Brian Haynes,et al.  PsycINFO search strategies identified methodologically sound therapy studies and review articles for use by clinicians and researchers. , 2008, Journal of clinical epidemiology.

[26]  R Brian Haynes,et al.  Developing optimal search strategies for detecting clinically sound treatment studies in EMBASE. , 2006, Journal of the Medical Library Association : JMLA.