A comprehensive and comparative review of optimal cut-points selection methods for diseases with multiple ordinal stages

ABSTRACT Cut-points selection is a key topic in the field of diagnostic studies. For binary classification, there exist several well-developed methods, some of which have been extended to three-class settings and beyond. This paper focuses on optimal cut-points selection methods for diseases with multiple ordinal stages. The purpose of this paper is two-fold: 1) to propose three new cut-points selection methods; and 2) to present a comprehensive simulation study to assess and compare the performance of all the available methods. Two real data sets, one from ovarian cancer and the other from pancreatic cancer, are analyzed.

[1]  Katherine A. Batterton,et al.  Confidence intervals around Bayes Cost in multi‐state diagnostic settings to estimate optimal performance , 2014, Statistics in medicine.

[2]  Dan Wang,et al.  Optimal threshold selection methods under tree or umbrella ordering , 2018, Journal of biopharmaceutical statistics.

[3]  A. Chudecka-Głaz,et al.  ROMA, an algorithm for ovarian cancer. , 2015, Clinica chimica acta; international journal of clinical chemistry.

[4]  J L Bosson,et al.  Strategies for graphical threshold determination. , 1991, Computer methods and programs in biomedicine.

[5]  Joachim Thiery,et al.  Pancreatic carcinoma, pancreatitis, and healthy controls: metabolite models in a three-class diagnostic dilemma , 2012, Metabolomics.

[6]  Lluís Jover,et al.  Optimum threshold estimation based on cost function in a multistate diagnostic setting , 2012, Statistics in medicine.

[7]  Xinhua Liu,et al.  Classification accuracy and cut point selection , 2012, Statistics in medicine.

[8]  Laura Antolini,et al.  Computational Statistics and Data Analysis Finding the Optimal Cut-point for Gaussian and Gamma Distributed Biomarkers , 2022 .

[9]  Jialiang Li,et al.  ROC analysis with multiple classes and multiple tests: methodology and its application in microarray studies. , 2008, Biostatistics.

[10]  H. Lynch,et al.  Psychologic Aspects of Cancer Genetic Testing: A Research Update for Clinicians , 1997 .

[11]  Alan C. Bovik,et al.  Indexes for Three-Class Classification Performance Assessment—An Empirical Comparison , 2009, IEEE Transactions on Information Technology in Biomedicine.

[12]  Lili Tian,et al.  Diagnostic Thresholds with Three Ordinal Groups , 2014, Journal of biopharmaceutical statistics.

[13]  Todd A Alonzo,et al.  Generalization of Youden index for multiple‐class classification problems applied to the assessment of externally validated cognition in Parkinson disease screening , 2013, Statistics in medicine.

[14]  K. Partheen,et al.  Evaluation of ovarian cancer biomarkers HE4 and CA-125 in women presenting with a suspicious cystic ovarian mass , 2011, Journal of gynecologic oncology.

[15]  Todd A Alonzo,et al.  ROC Graphs for Assessing the Ability of a Diagnostic Marker to Detect Three Disease Classes with an Umbrella Ordering , 2007, Biometrics.

[16]  Christos T. Nakas,et al.  DEVELOPMENTS IN ROC SURFACE ANALYSIS AND ASSESSMENT OF DIAGNOSTIC MARKERS IN THREE-CLASS CLASSIFICATION PROBLEMS , 2014 .

[17]  Howard Rockette,et al.  Statistical Evaluation of Diagnostic Performance: Topics in Roc Analysis , 2011 .

[18]  B. Reiser,et al.  Estimation of the area under the ROC curve , 2002, Statistics in medicine.

[19]  W. Youden,et al.  Index for rating diagnostic tests , 1950, Cancer.

[20]  B. Reiser,et al.  Estimation of the Youden Index and its Associated Cutoff Point , 2005, Biometrical journal. Biometrische Zeitschrift.

[21]  Daniel F Hayes,et al.  ASCO 2006 update of recommendations for the use of tumor markers in gastrointestinal cancer. , 2006, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[22]  Derrick Wong,et al.  Serum CA19-9 Decline Compared to Radiographic Response as a Surrogate for Clinical Outcomes in Patients With Metastatic Pancreatic Cancer Receiving Chemotherapy , 2008, Pancreas.

[23]  Alistair Burns,et al.  Diagnosis of Alzheimer's Disease , 1997, International Psychogeriatrics.

[24]  C. Yiannoutsos,et al.  Ordered multiple‐class ROC analysis with continuous measurements , 2004, Statistics in medicine.

[25]  Richard G. Moore,et al.  Evaluation of the Diagnostic Accuracy of the Risk of Ovarian Malignancy Algorithm in Women With a Pelvic Mass , 2011, Obstetrics and gynecology.

[26]  Enrique F. Schisterman,et al.  Confidence Intervals for the Youden Index and Corresponding Optimal Cut-Point , 2007, Commun. Stat. Simul. Comput..

[27]  Chengjie Xiong,et al.  A Parametric Comparison of Diagnostic Accuracy with Three Ordinal Diagnostic Groups , 2007, Biometrical journal. Biometrische Zeitschrift.

[28]  Constantin T Yiannoutsos,et al.  Accuracy and cut‐off point selection in three‐class classification problems using a generalization of the Youden index , 2010, Statistics in medicine.

[29]  D. Mossman.  Three-way ROCs , 1999, Medical decision making : an international journal of the Society for Medical Decision Making.

[30]  Sudhir Srivastava,et al.  A Framework for Evaluating Biomarkers for Early Detection: Validation of Biomarker Panels for Ovarian Cancer , 2011, Cancer Prevention Research.

[31]  J. Price,et al.  Mild cognitive impairment represents early-stage Alzheimer disease. , 2001, Archives of neurology.

[32]  M. Ringnér,et al.  Classification and diagnostic prediction of cancers using gene expression profiling and artificial neural networks , 2001, Nature Medicine.

[33]  Lili Tian,et al.  Exact confidence interval estimation for the difference in diagnostic accuracy with three ordinal diagnostic groups. , 2011, Journal of statistical planning and inference.

[34]  J R Fielding,et al.  Original smooth receiver operating characteristic curve estimation from continuous data: statistical methods for analyzing the predictive value of spiral CT of ureteral stones. , 1998, Academic radiology.

[35]  Lili Tian,et al.  Receiver operating characteristic analysis under tree orderings of disease classes , 2016, Statistics in medicine.

[36]  J. Morris,et al.  Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groups , 2006, Statistics in medicine.

[37]  Julien Delrieu,et al.  Early diagnosis of Alzheimers disease , 2009 .

[38]  Sudhir Srivastava,et al.  Ovarian Cancer Biomarker Performance in Prostate, Lung, Colorectal, and Ovarian Cancer Screening Trial Specimens , 2011, Cancer Prevention Research.

[39]  Heinz Holling,et al.  A limitation of the diagnostic-odds ratio in determining an optimal cut-off value for a continuous diagnostic test , 2011, Statistical methods in medical research.

[40]  Lili Tian,et al.  A new diagnostic accuracy measure and cut-point selection criterion , 2017, Statistical methods in medical research.

[41]  Xiao-Hua Zhou,et al.  Statistical Methods in Diagnostic Medicine , 2002 .

[42]  Karimolla Hajian-Tilaki,et al.  The choice of methods in determining the optimal cut-off value for quantitative diagnostic test evaluation , 2018, Statistical methods in medical research.

[43]  M. Pepe.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[44]  N. Perkins,et al.  Optimal Cut-point and Its Corresponding Youden Index to Discriminate Individuals Using Pooled Blood Samples , 2005, Epidemiology.

[45]  P. J. Green,et al.  Density Estimation for Statistics and Data Analysis , 1987 .

[46]  C. Metz.  Basic principles of ROC analysis. , 1978, Seminars in nuclear medicine.

[47]  Jialiang Li,et al.  COMBINING MULTIPLE MARKERS FOR MULTI‐CATEGORY CLASSIFICATION: AN ROC SURFACE APPROACH , 2011 .

[48]  Constantin T Yiannoutsos,et al.  A comparison of tests for restricted orderings in the three‐class case , 2009, Statistics in medicine.

[49]  Lili Tian,et al.  Exact confidence interval estimation for the Youden index and its corresponding optimal cut-point , 2012, Comput. Stat. Data Anal..

[50]  Scurfield.  Multiple-Event Forced-Choice Tasks in the Theory of Signal Detectability , 1996, Journal of mathematical psychology.

[51]  Ė. B. Vinberg,et al.  A course in algebra , 2003 .

[52]  Jialiang Li,et al.  Multicategory reclassification statistics for assessing improvements in diagnostic accuracy. , 2013, Biostatistics.

[53]  P. Robinson.  The interpretation of diagnostic tests. , 1987, Nuclear medicine communications.