Epidemiologic issues in the validation of veterinary diagnostic tests

In this review, we critically discuss the objectives, methods and limitations of different approaches for the validation of diagnostic tests. We show (based on published data and our own experiences) that estimates for the diagnostic sensitivity and specificity may vary among populations and/or subpopulations of animals, conditional on the distribution of influential covariates. Additional variability in those parameter estimates may be attributable to the sampling strategy. The uncertainty about diagnostic parameters is of concern for the decision-maker in the context of clinical diagnosis or quantitative risk assessment as well as for the epidemiologist who uses test data for prevalence estimation or risk-factor studies. Examples for the calculation of diagnostic parameters are presented together with bias-avoidance strategies. We suggest guidelines for an epidemiologic approach to test validation of veterinary diagnostic tests. # 2000 Elsevier Science B.V. All rights reserved.

[1]  Ellen Fineout-Overholt,et al.  Users' Guides to the Medical Literature , 2002 .

[2]  M. Greiner,et al.  Principles and practical application of the receiver-operating characteristic analysis for diagnostic tests. , 2000, Preventive veterinary medicine.

[3]  M Greiner,et al.  Epidemiologic issues in the validation of veterinary diagnostic tests. , 2000, Preventive veterinary medicine.

[4]  B D Slenning,et al.  Decision analysis: dealing with uncertainty in diagnostic testing. , 2000, Preventive veterinary medicine.

[5]  I A Gardner,et al.  Herd-level interpretation of test results for epidemiologic studies of animal diseases. , 2000, Preventive veterinary medicine.

[6]  H Stryhn,et al.  Conditional dependence between tests affects the diagnosis and surveillance of animal diseases. , 2000, Preventive veterinary medicine.

[7]  Claes Enùea,et al.  Estimation of sensitivity and specificity of diagnostic tests and disease prevalence when the true disease state is unknown , 2000 .

[8]  F. Conraths,et al.  Serological differences in Neospora caninum-associated epidemic and endemic abortions. , 1999, Journal of Parasitology.

[9]  M. Greiner,et al.  Validation of the Indirect MAP1-B Enzyme-Linked Immunosorbent Assay for Diagnosis of Experimental Cowdria ruminantium Infection in Small Ruminants , 1999, Clinical Diagnostic Laboratory Immunology.

[10]  A. Lindberg,et al.  Using logistic regression to model the sensitivity and specificity of a test aimed at identifying dams carrying Bovine ViralDiarrhoea Virus (BVDV) infected foetuses , 1999 .

[11]  D. Böhning,et al.  Prevalence estimation under heterogeneity in the example of bovine trypanosomosis in Uganda. , 1998, Preventive veterinary medicine.

[12]  A. Peregrine,et al.  Use of a PCR Assay for the Specific and Sensitive Detection of Trypanosoma Spp. in Naturally Infected Dairy Cattle in Peri‐urban Kampala, Uganda a , 1998, Annals of the New York Academy of Sciences.

[13]  S. Hietala,et al.  Evaluation of North American Antibody Detection Tests for Diagnosis of Brucellosis in Goats , 1998, Journal of Clinical Microbiology.

[14]  R. H. Jacobson.  Validation of serological assays for diagnosis of infectious diseases. , 1998, Revue scientifique et technique.

[15]  M. Greiner,et al.  Evaluation and comparison of antibody ELISAs for serodiagnosis of bovine trypanosomosis. , 1997, Veterinary parasitology.

[16]  H Brenner,et al.  Variation of sensitivity, specificity, likelihood ratios and predictive values with disease prevalence. , 1997, Statistics in medicine.

[17]  D. Böhning,et al.  Impact of biological factors on the interpretation of bovine trypanosomosis serology. , 1997, Preventive veterinary medicine.

[18]  Diederick E. Grobbee,et al.  Limitations of Sensitivity, Specificity, Likelihood Ratio, and Bayes' Theorem in Assessing Diagnostic Probabilities: A Clinical Example , 1997, Epidemiology.

[19]  H. Gamble,et al.  Detection of trichinellosis in pigs by artificial digestion and enzyme immunoassay. , 1996, Journal of food protection.

[20]  R. Clifton-Hadley,et al.  Evaluation of an ELISA for Mycobacterium bovis infection in badgers (Meles meles) , 1995, Veterinary Record.

[21]  M. O'Brecht,et al.  Evaluating medical tests: Objective and quantitative guidelines , 1995 .

[22]  R. Dybkaer.  Result, error and uncertainty. , 1995, Scandinavian journal of clinical and laboratory investigation.

[23]  S C Kazmierczak,et al.  Clinical informatics. , 1995, Analytical chemistry.

[24]  D L Massart,et al.  An analysis of the Washington Conference Report on bioanalytical method validation. , 1994, Journal of pharmaceutical and biomedical analysis.

[25]  J M Simpson,et al.  Efficient study designs to assess the accuracy of screening tests. , 1994, American journal of epidemiology.

[26]  X H Zhou,et al.  Effect of verification bias on positive and negative predictive values. , 1994, Statistics in medicine.

[27]  Alison L. Van Eenennaam,et al.  Performance of various tests used to screen antibiotic residues in milk samples from individual animals. , 1994, Journal of AOAC International.

[28]  Alvin D. Wiggins,et al.  Cut-off points for aggreate herd testing in the presence of disease clustering and correlation of test errors , 1994 .

[29]  Frederick Mosteller,et al.  Guidelines for Meta-analyses Evaluating Diagnostic Tests , 1994, Annals of Internal Medicine.

[30]  Gordon H. Guyatt,et al.  Users' Guides to the Medical Literature: III. How to Use an Article About a Diagnostic Test A. Are the Results of the Study Valid? , 1994 .

[31]  J. McDermott,et al.  A review of methods used to adjust for cluster effects in explanatory epidemiological studies of animal populations , 1994 .

[32]  P. Wright,et al.  Standardisation and validation of enzyme-linked immunosorbent assay techniques for the detection of antibody in infectious disease diagnosis. , 1993, Revue scientifique et technique.

[33]  C. Franti,et al.  Notes about determining the cut-off value in enzyme linked immunosorbent assay (ELISA) , 1993 .

[34]  P. Leffers,et al.  The influence of referral patterns on the characteristics of diagnostic tests. , 1992, Journal of clinical epidemiology.

[35]  E. Somoza,et al.  Comparing and Optimizing Diagnostic Tests , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[36]  R. Centor.  Estimating Confidence intervals of Likelihood Ratios , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[37]  J. Knottnerus.  Application of Logistic Regression to the Analysis of Diagnostic Data , 1992, Medical decision making : an international journal of the Society for Medical Decision Making.

[38]  M. Collins,et al.  Evaluation of four serological tests for bovine paratuberculosis , 1992, Journal of clinical microbiology.

[39]  L. Pickle,et al.  The logistic modeling of sensitivity, specificity, and predictive value of a diagnostic test. , 1992, Journal of clinical epidemiology.

[40]  M. Collins,et al.  Economic decision analysis model of a paratuberculosis test and cull program. , 1991, Journal of the American Veterinary Medical Association.

[41]  R. Condron,et al.  Comparison of the Johne's absorbed EIA and the complement-fixation test for the diagnosis of Johne's disease in cattle. , 1991, Australian veterinary journal.

[42]  C. H. Courtney,et al.  Evaluation of heartworm immunodiagnostic tests. , 1990, Journal of the American Veterinary Medical Association.

[43]  J. Shearer,et al.  Financial comparison of three testing strategies for detection of estrus in dairy cattle. , 1990, Journal of the American Veterinary Medical Association.

[44]  R A Greenes,et al.  Assessment of diagnostic tests when disease verification is subject to selection bias. , 1983, Biometrics.