Systematic reviews in laboratory medicine: principles, processes and practical considerations.

BACKGROUND Systematic reviews and meta-analyses are generally accepted to represent the highest level of evidence, and are a cornerstone in practising evidence-based medicine. So far, these efforts have been largely confined to the evaluation of the efficacy and effectiveness of therapeutic and preventive interventions. Systematic reviews in laboratory medicine are scarce and many of them do not meet essential quality criteria [Clin. Chem. Lab. Med. 38 (2000) 577]. Most of these problems are related to the poor design and heterogeneity of primary research, and that there are no agreed methods or quality standards for making systematic reviews in laboratory medicine. AIMS AND OBJECTIVES For better evidence in laboratory medicine, not only higher quality primary studies but also standardized methodologies for designing, conducting and reporting systematic reviews in diagnostics are needed. The aim of this review is to present the general principles and provide a step-by-step process of systematic reviewing in laboratory medicine. METHODS This narrative review is based on the overview of the medical literature on the methodology of systematic reviewing and that of the "state of the art" of evidence-based diagnosis. RESULTS Systematic reviews of diagnostic interventions differ from that of therapeutic interventions in the methods of question formulation, the choice of study design, the assessment of study quality and the statistical methods used to combine results. Therefore, the general principles of systematic reviewing are adapted to the specialist field of laboratory medicine. The process of systematic reviewing consists of six key steps: (1) preparation for the review, (2) systematic search of the primary literature, (3) selection of papers for review, (4) critical appraisal of the selected literature, (5) analysis and synthesis of data, and (6) interpretation of data. The most important technical and methodological aspects of each step and the essential elements of a good systematic review in laboratory medicine are presented. CONCLUSIONS Systematic reviews of diagnostic interventions support clinical and policy decisions, the development of practice guidelines, clinical audit, technology assessment, economic evaluations, education and training, and identify gaps in our knowledge for future research. Systematic reviewing of laboratory data is expected to result in better, bigger and more reliable primary studies, which hopefully will support the diffusion of new diagnostic technologies with scientifically proven efficacy and effectiveness in the future.

[1]  Alex J. Sutton,et al.  Publication and related biases: a review , 2000 .

[2]  M. Landray,et al.  Measuring brain natriuretic peptide in suspected left ventricular systolic dysfunction in general practice: cross-sectional study , 2000, BMJ : British Medical Journal.

[3]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[4]  Deborah J. Cook,et al.  Systematic Reviews: Synthesis of Best Evidence for Health Care Decisions , 1998, Annals of Internal Medicine.

[5]  C. Gatsonis,et al.  Designing studies to ensure that estimates of test accuracy are transferable , 2002, BMJ : British Medical Journal.

[6]  Paul F. Griner,et al.  Diagnostic Strategies for Common Medical Problems , 1991 .

[7]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test A. Are the Results of the Study Valid? , 1994 .

[8]  Mark Petticrew,et al.  Systematic reviews from astronomy to zoology: myths and misconceptions , 2001, BMJ : British Medical Journal.

[9]  G. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test: B. What Are the Results and Will They Help Me In Caring for My Patients? , 1994 .

[10]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[11]  M. R. Howell,et al.  Screening Women for Chlamydia trachomatis in Family Planning Clinics: The Cost‐Effectiveness of DNA Amplification Assays , 1998, Sexually transmitted diseases.

[12]  Trisha Greenhalgh,et al.  How to read a paper: Papers that summarise other papers (systematic reviews and meta-analyses) , 1997 .

[13]  J. Knottnerus,et al.  Assessment of the accuracy of diagnostic tests: the cross-sectional study. , 2003, Journal of clinical epidemiology.

[14]  G. Guyatt,et al.  Users' guides to the medical literature. III. How to use an article about a diagnostic test. B. What are the results and will they help me in caring for my patients? The Evidence-Based Medicine Working Group. , 1994, JAMA.

[15]  K A McKibbon,et al.  Locating and Appraising Systematic Reviews , 1997, Annals of Internal Medicine.

[16]  G. Guyatt,et al.  Diagnosis of iron-deficiency anemia in the elderly. , 1990, The American journal of medicine.

[17]  L M Schuman,et al.  The effect of fecal occult-blood screening on the incidence of colorectal cancer. , 2000, The New England journal of medicine.

[18]  D. Rennie,et al.  The STARD statement for reporting studies of diagnostic accuracy: explanation and elaboration. , 2003, Annals of internal medicine.

[19]  S. Golder,et al.  The effectiveness and cost-effectiveness of prophylactic removal of wisdom teeth. , 2000, Health technology assessment.

[20]  C. Counsell,et al.  Formulating Questions and Locating Primary Studies for Inclusion in Systematic Reviews , 1997, Annals of Internal Medicine.

[21]  Trisha Greenhalgh,et al.  How to read a paper: Papers that report diagnostic or screening tests , 1997, BMJ.

[22]  D. Bruns,et al.  Toward a checklist for reporting of studies of diagnostic accuracy of medical tests. , 2000, Clinical chemistry.

[23]  Douglas G. Altman,et al.  Systematic Reviews in Health Care: Meta-Analysis in Context: Second Edition , 2008 .

[24]  J Nicholl,et al.  Routine preoperative testing: a systematic review of the evidence. , 1997, Health technology assessment.

[25]  R. W. Niessen,et al.  Diagnostic value of the mean corpuscular volume in the detection of vitamin B12 deficiency , 2000, Scandinavian journal of clinical and laboratory investigation.

[26]  E. Vamvakas,et al.  Meta-analyses of studies of the diagnostic accuracy of laboratory tests: a review of the concepts and methods. , 1998, Archives of pathology & laboratory medicine.

[27]  P. Bossuyt,et al.  Randomised comparisons of medical tests: sometimes invalid, not always efficient , 2000, The Lancet.

[28]  G H Guyatt,et al.  A framework for clinical evaluation of diagnostic technologies. , 1986, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[29]  Vic Hasselblad,et al.  A clinical approach for the diagnosis of diabetes mellitus: an analysis using glycosylated hemoglobin levels. Meta-analysis Research Group on the Diagnosis of Diabetes Using Glycated Hemoglobin Levels. , 1996, JAMA.

[30]  C. Price Evidence-based laboratory medicine: supporting decision-making. , 2000, Clinical chemistry.

[31]  G. Guyatt,et al.  Users ' Guides to the Medical Literature : III . How to Use an Article About a Diagnostic Test : A . Are the Results of the Study Valid ? , 2022 .

[32]  David Moher,et al.  Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative. , 2003, Radiology.

[33]  J. Donovan,et al.  Diagnosis, management and screening of early localised prostate cancer. , 1997, Health technology assessment.

[34]  D. Sackett,et al.  The architecture of diagnostic research , 2002, BMJ : British Medical Journal.

[35]  A R Feinstein,et al.  Clinical epidemiological quality in molecular genetic research: the need for methodological standards. , 1999, JAMA.

[36]  R. W. Niessen,et al.  The Science of Systematic Reviewing Studies of Diagnostic Tests , 2000, Clinical chemistry and laboratory medicine.

[37]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[38]  Trisha Greenhalgh,et al.  How to Read a Paper , 1999 .

[39]  A R Feinstein,et al.  Use of methodological standards in diagnostic test research. Getting better but still not good. , 1995, JAMA.

[40]  Jonathan J Deeks,et al.  Systematic reviews in health care: Systematic reviews of evaluations of diagnostic and screening tests. , 2001, BMJ.

[41]  D. Bruns,et al.  Laboratory-related outcomes in healthcare. , 2001, Clinical chemistry.

[42]  V. Hasselblad,et al.  A clinical approach for the diagnosis of diabetes mellitus: an analysis using glycosylated hemoglobin levels. Meta-analysis Research Group on the Diagnosis of Diabetes Using Glycated Hemoglobin Levels. , 1996, JAMA.

[43]  D. Sackett,et al.  On some clinically useful measures of the accuracy of diagnostic tests , 1998, Evidence Based Medicine.

[44]  T. Greenhalgh How to Read a Paper: The Basics of Evidence-Based Medicine , 1997 .

[45]  S D Walter,et al.  Meta-analysis of diagnostic tests with imperfect reference standards. , 1999, Journal of clinical epidemiology.

[46]  Douglas G. Altman,et al.  Systematic Reviews in Health Care , 2001 .

[47]  Keith R. Abrams,et al.  The Advanced Handbook of Methods in Evidence Based Healthcare , 2001 .