Information Graphs Incorporating Predictive Values of Disease Forecasts

Diagrammatic formats are useful for summarizing the processes of evaluation and comparison of forecasts in plant pathology and other disciplines where decisions about interventions for the purpose of disease management are often based on a proxy risk variable. We describe a new diagrammatic format for disease forecasts with two categories of actual status and two categories of forecast. The format displays relative entropies, functions of the predictive values that characterize expected information provided by disease forecasts. The new format arises from a consideration of earlier formats with underlying information properties that were previously unexploited. The new diagrammatic format requires no additional data for calculation beyond those used for the calculation of a receiver operating characteristic (ROC) curve. While an ROC curve characterizes a forecast in terms of sensitivity and specificity, the new format described here characterizes a forecast in terms of relative entropies based on predictive values. Thus it is complementary to ROC methodology in its application to the evaluation and comparison of forecasts.

[1]  B J Biggerstaff,et al.  Comparing diagnostic tests: a simple graphic using likelihood ratios. , 2000, Statistics in medicine.

[2]  D G Altman,et al.  What do we mean by validating a prognostic model? , 2000, Statistics in medicine.

[3]  G. Brier VERIFICATION OF FORECASTS EXPRESSED IN TERMS OF PROBABILITY , 1950 .

[4]  D. Friedland,et al.  Evidence-Based Medicine: A Framework for Clinical Practice , 1998 .

[5]  J A Swets,et al.  Better decisions through science. , 2000, Scientific American.

[6]  G. Hughes The Evidential Basis of Decision Making in Plant Disease Management. , 2017, Annual review of phytopathology.

[7]  Peter Harremoës Entropy - New Editor-in-Chief and Outlook , 2009, Entropy.

[8]  W. Benish The use of information graphs to evaluate and compare diagnostic tests. , 2002, Methods of information in medicine.

[9]  A. Rossier Letter to the Editor , 1986, Paraplegia.

[10]  G. Hughes,et al.  Bayesian analysis of plant disease prediction , 2002 .

[11]  F. Burnett,et al.  Evaluation of Probabilistic Disease Forecasts. , 2017, Phytopathology.

[12]  W. E. Silver,et al.  Economics and Information Theory , 1967 .

[13]  L. Madden,et al.  Risk assessment models for wheat fusarium head blight epidemics based on within-season weather data. , 2003, Phytopathology.

[14]  Nils P Johnson Advantages to transforming the receiver operating characteristic (ROC) curve into likelihood ratio co-ordinates. , 2004, Statistics in medicine.

[15]  J. Yuen,et al.  Forecasting Sclerotinia stem rot in spring sown oilseed rape , 1998 .

[16]  J. Yuen,et al.  Calibration and verification of risk algorithms using logistic regression , 1996, European Journal of Plant Pathology.

[17]  Nick van de Giesen,et al.  Kullback–Leibler Divergence as a Forecast Skill Score with Classic Reliability–Resolution–Uncertainty Decomposition , 2010 .

[18]  L. Madden Botanical Epidemiology: Some Key Advances and its Continuing Role in Disease Management , 2005, European Journal of Plant Pathology.

[19]  David Makowski,et al.  A Bayesian approach to assess the accuracy of a diagnostic test based on plant disease measurement , 2008 .