Evaluation of diagnostic procedures

This is the first of a series of five articles Development and introduction of new diagnostic techniques have greatly accelerated over the past decades. The evaluation of diagnostic techniques, however, is less advanced than that of treatments. Unlike with drugs, there are generally no formal requirements for adoption of diagnostic tests in routine care. In spite of important contributions, 1 2 the methodology of diagnostic research is poorly defined compared with study designs on treatment effectiveness, or on aetiology, so it is not surprising that methodological flaws are common in diagnostic studies.3–5 Furthermore, research funds rarely cover diagnostic research starting from symptoms or tests. Since quality of the diagnostic process largely determines quality of care, overcoming deficiencies in standards, methodology, and funding deserves high priority. This article summarises objectives of diagnostic testing and research, methodological challenges, and options for design of studies. #### Summary points Development of diagnostic techniques has greatly accelerated but the methodology of diagnostic research lags far behind that for evaluating treatments Objectives of diagnostic investigations include detection or exclusion of disease; contributing to management; assessment of prognosis; monitoring clinical course; and measurement of general health or fitness Methodological challenges include the “gold standard” problem; spectrum and selection biases; “soft” measures (subjective phenomena); observer variability and bias; complex relations; clinical impact; sample size; and rapid progress of knowledge Diagnostic investigations collect information to clarify patients' health status, using personal characteristics, symptoms, signs, history, physical examination, laboratory tests, and additional facilities. Objectives include the following.

[1]  J H van Bemmel,et al.  Assessment of Decision Support for Blood Test Ordering in Primary Care , 2001, Annals of Internal Medicine.

[2]  P. Bossuyt,et al.  Empirical evidence of design-related bias in studies of diagnostic tests. , 1999, JAMA.

[3]  A S Elstein,et al.  Heuristics and biases: selected errors in clinical reasoning. , 1999, Academic medicine : journal of the Association of American Medical Colleges.

[4]  J. Knottnerus,et al.  Evidence-based interventions and comprehensive treatment , 1999, The Lancet.

[5]  D. Moher,et al.  Carotid endarterectomy for asymptomatic carotid stenosis: a meta-analysis , 1998, BMJ.

[6]  G. Dinant,et al.  Medicine based evidence, a prerequisite for evidence based medicine , 1997, BMJ.

[7]  J D Habbema,et al.  Application of Treatment Thresholds to Diagnostic-test Evaluation , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[8]  L. Bouter,et al.  Cardiovascular morbidity and mortality among hypertensive patients in general practice: the evaluation of long-term systematic management. , 1997, Journal of clinical epidemiology.

[9]  J. Knottnerus,et al.  Diagnostic Value of Signs and Symptoms Associated with Peripheral Arterial Occlusive Disease Seen in General Practice , 1997, Medical decision making : an international journal of the Society for Medical Decision Making.

[10]  M. Brouwers,et al.  Relation between sampling device and detection of abnormality in cervical smears: a meta-analysis of randomised and quasi-randomised studies , 1996, BMJ.

[11]  A R Feinstein,et al.  Use of methodological standards in diagnostic test research. Getting better but still not good. , 1995, JAMA.

[12]  P. Leffers,et al.  The influence of referral patterns on the characteristics of diagnostic tests. , 1992, Journal of clinical epidemiology.

[13]  D. Sackett,et al.  The Ends of Human Life: Medical Ethics in a Liberal Polity , 1992, Annals of Internal Medicine.

[14]  J. Knottnerus Application of Logistic Regression to the Analysis of Diagnostic Data , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[15]  A. S. Abraham,et al.  Diagnostic Strategies for Common Medical Problems , 1992 .

[16]  Paul F. Griner,et al.  Diagnostic Strategies for Common Medical Problems , 1991 .

[17]  C B Begg,et al.  Biases in the assessment of diagnostic tests. , 1987, Statistics in medicine.

[18]  A. Feinstein,et al.  Clinical Epidemiology: The Architecture of Clinical Research. , 1987 .

[19]  S. Sheps,et al.  The assessment of diagnostic tests. A survey of current medical research. , 1984, JAMA.

[20]  J. Hendriks,et al.  REDUCTION OF BREAST CANCER MORTALITY THROUGH MASS SCREENING WITH MODERN MAMMOGRAPHY First Results of the Nijmegen Project, 1975 - 1981 , 1984, The Lancet.

[21]  S. Shapiro,et al.  Ten- to fourteen-year effect of screening on breast cancer mortality. , 1982, Journal of the National Cancer Institute.

[22]  S G Pauker,et al.  Pathology and probabilities: a new approach to interpreting and reporting biopsies. , 1981, The New England journal of medicine.

[23]  A. Feinstein,et al.  The Effectiveness of Panendoscopy on Diagnostic and Therapeutic Decisions about Chronic Abdominal Pain , 1980, Journal of clinical gastroenterology.

[24]  A. Feinstein,et al.  Problems of spectrum and bias in evaluating the efficacy of diagnostic tests. , 1978, The New England journal of medicine.

[25]  P Glasziou,et al.  Meta-analytic methods for diagnostic test accuracy. , 1995, Journal of clinical epidemiology.

[26]  G. Fijten Rectal bleeding, a danger signal? , 1993 .

[27]  D. Spiegelhalter,et al.  Taking a calculated risk: predictive scoring systems in dyspepsia. , 1987, Scandinavian journal of gastroenterology. Supplement.

[28]  G. Guyatt,et al.  The role of before-after studies of therapeutic impact in the evaluation of diagnostic technologies. , 1986, Journal of chronic diseases.

[29]  Stephen B. Gruber,et al.  Clinical Epidemiology: The Architecture of Clinical Research , 1986, The Yale Journal of Biology and Medicine.