Symmetry Properties of Bi-Normal and Bi-Gamma Receiver Operating Characteristic Curves are Described by Kullback-Leibler Divergences

Receiver operating characteristic (ROC) curves have application in analysis of the performance of diagnostic indicators used in the assessment of disease risk in clinical and veterinary medicine and in crop protection. For a binary indicator, an ROC curve summarizes the two distributions of risk scores obtained by retrospectively categorizing subjects as cases or controls using a gold standard. An ROC curve may be symmetric about the negative diagonal of the graphical plot, or skewed towards the left-hand axis or the upper axis of the plot. ROC curves with different symmetry properties may have the same area under the curve. Here, we characterize the symmetry properties of bi-Normal and bi-gamma ROC curves in terms of the Kullback-Leibler divergences (KLDs) between the case and control distributions of risk scores. The KLDs describe the known symmetry properties of bi-Normal ROC curves, and newly characterize the symmetry properties of constant-shape and constant-scale bi-gamma ROC curves. It is also of interest to note an application of KLDs where their asymmetry—often an inconvenience—has a useful interpretation.

[1]  J A Swets,et al.  Better decisions through science. , 2000, Scientific American.

[2]  David J. Hand,et al.  ROC Curves for Continuous Data , 2009 .

[3]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[4]  Chengqing Wu,et al.  Compare diagnostic tests using transformation-invariant smoothed ROC curves(). , 2010, Journal of statistical planning and inference.

[5]  D. MacDonald.  Information Theory and Its Application to Taxonomy , 1952 .

[6]  Peter R. Killeen,et al.  Symmetric receiver operating characteristics , 2004 .

[7]  Laurence V. Madden,et al.  The study of plant disease epidemics , 2007 .

[8]  András Kocsor,et al.  ROC analysis: applications to the classification of biological sequences and 3D structures , 2008, Briefings Bioinform..

[9]  John Reidar Mathiassen,et al.  Texture Similarity Measure Using Kullback-Leibler Divergence between Gamma Distributions , 2002, ECCV.

[10]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[11]  K. B. Oldham,et al.  An Atlas of Functions: with Equator, the Atlas Function Calculator , 2008 .

[12]  Martin Betinec,et al.  TESTING THE DIFFERENCE OF THE ROC CURVES IN BIEXPONENTIAL MODEL , 2008 .

[13]  Bhaskar Bhattacharya,et al.  Symmetry of receiver operating characteristic curves and Kullback–Leibler divergences between the signal and noise populations , 2011 .

[14]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[15]  James P. Egan,et al.  Signal detection theory and ROC analysis , 1975 .

[16]  M. M. Taylor,et al.  Detectability theory and the interpretation of vigilance data. , 1967, Acta psychologica.

[17]  Christoforos Anagnostopoulos,et al.  When is the area under the receiver operating characteristic curve an appropriate measure of classifier performance? , 2013, Pattern Recognit. Lett..

[18]  David Applebaum,et al.  Probability and Information: An Integrated Approach , 2008 .

[19]  Ehtesham Hussain.  The Bi-Gamma ROC Curve in a Straightforward Manner , 2012 .

[20]  K. B. Oldham,et al.  An Atlas of Functions. , 1988 .

[21]  Don H. Johnson,et al.  Toward a theory of information processing , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[22]  J. Hanley.  The Robustness of the "Binormal" Assumptions Used in Fitting ROC Curves , 1988, Medical decision making : an international journal of the Society for Medical Decision Making.

[23]  K. Berbaum,et al.  Proper receiver operating characteristic analysis: the bigamma model. , 1997, Academic radiology.

[24]  D. M. Green,et al.  Signal detection theory and psychophysics , 1966 .

[25]  N. Obuchowski.  ROC analysis. , 2005, AJR. American journal of roentgenology.

[26]  Enrique F Schisterman,et al.  Roc Curve Analysis for Biomarkers Based on Pooled Assessments , 2022 .

[27]  David L. Pearl,et al.  Veterinary Epidemiology, 3rd ed. , 2006 .

[28]  L. Broemeling,et al.  Bayesian Methods for Medical Test Accuracy , 2011, Diagnostics.

[29]  B. Reiser,et al.  Estimation of the area under the ROC curve , 2002, Statistics in medicine.

[30]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[31]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.

[32]  C. Marzban.  The ROC Curve and the Area under It as Performance Measures , 2004 .

[33]  M. Asadi,et al.  Information Measures for Pareto Distributions and Order Statistics , 2006 .

[34]  B. Chomel,et al.  [Veterinary epidemiology]. , 1991, Revue d'epidemiologie et de sante publique.

[35]  Aman Ullah.  Uses of entropy and divergence measures for evaluating econometric approximations and inference , 2002 .

[36]  J. Paz,et al.  Impact of Early Spring Weather Factors on the Risk of Tomato Spotted Wilt in Peanut. , 2009, Plant disease.

[37]  Dmitry I. Belov,et al.  Distributions of the Kullback-Leibler divergence with applications. , 2011, The British journal of mathematical and statistical psychology.

[38]  Don H. Johnson,et al.  Information-Theoretic Analysis of Neural Coding , 2004, Journal of Computational Neuroscience.

[39]  Gareth Hughes,et al.  Applications of Information Theory to Epidemiology , 2012, Entropy.

[40]  S. Kullback,et al.  Information Theory and Statistics , 1959 .

[41]  Evgueni A. Haroutunian,et al.  Information Theory and Statistics , 2011, International Encyclopedia of Statistical Science.