CombiROC: an interactive web tool for selecting accurate marker combinations of omics data

Diagnostic accuracy can be improved considerably by combining multiple markers, whose performance in identifying diseased subjects is usually assessed via receiver operating characteristic (ROC) curves. The selection of multimarker signatures is a complicated process that requires integration of data signatures with sophisticated statistical methods. We developed a user-friendly tool, called CombiROC, to help researchers accurately determine optimal markers combinations from diverse omics methods. With CombiROC data from different domains, such as proteomics and transcriptomics, can be analyzed using sensitivity/specificity filters: the number of candidate marker panels rising from combinatorial analysis is easily optimized bypassing limitations imposed by the nature of different experimental approaches. Leaving to the user full control on initial selection stringency, CombiROC computes sensitivity and specificity for all markers combinations, performances of best combinations and ROC curves for automatic comparisons, all visualized in a graphic interface. CombiROC was designed without hard-coded thresholds, allowing a custom fit to each specific data: this dramatically reduces the computational burden and lowers the false negative rates given by fixed thresholds. The application was validated with published data, confirming the marker combination already originally described or even finding new ones. CombiROC is a novel tool for the scientific community freely available at http://CombiROC.eu.

[1]  Daniel J Sargent,et al.  Integrating biomarkers in clinical trials , 2011, Expert review of molecular diagnostics.

[2]  Benjamin Reiser,et al.  mROC: a computer program for combining tumour markers in predicting disease states , 2001, Comput. Methods Programs Biomed..

[3]  F. Marabita,et al.  Identification of New Autoantigens by Protein Array Indicates a Role for IL4 Neutralization in Autoimmune Hepatitis* , 2012, Molecular & Cellular Proteomics.

[4]  Renee Drabier,et al.  Multiple Biomarker Panels for Early Detection of Breast Cancer in Peripheral Blood , 2013, BioMed research international.

[5]  Abdelouahid Maghnouj,et al.  Identification of microRNAs in the cerebrospinal fluid as biomarker for the diagnosis of glioma. , 2012, Neuro-oncology.

[6]  Pil Je Park,et al.  The multiplex bead array approach to identifying serum biomarkers associated with breast cancer , 2009, Breast Cancer Research.

[7]  D. Wishart,et al.  Translational biomarker discovery in clinical metabolomics: an introductory tutorial , 2012, Metabolomics.

[8]  Michael W Pfaffl,et al.  Transcriptional biomarkers. , 2013, Methods.

[9]  Jaak Vilo,et al.  ClustVis: a web tool for visualizing clustering of multivariate data using Principal Component Analysis and heatmap , 2015, Nucleic Acids Res..

[10]  Frédérique Lisacek,et al.  A Combined CXCL10, CXCL8 and H-FABP Panel for the Staging of Human African Trypanosomiasis Patients , 2009, PLoS neglected tropical diseases.

[11]  P. Gibbs,et al.  Blood-Based Protein Biomarker Panel for the Detection of Colorectal Cancer , 2015, PloS one.

[12]  Po-Chung Chen,et al.  Combination of OipA, BabA, and SabA as candidate biomarkers for predicting Helicobacter pylori-related gastric cancer , 2016, Scientific Reports.

[13]  M. Tyers,et al.  BoxPlotR: a web tool for generation of box plots , 2014, Nature Methods.

[14]  D. Chan,et al.  Proteomics and bioinformatics approaches for identification of serum biomarkers to detect breast cancer. , 2002, Clinical chemistry.

[15]  C. Sotiriou,et al.  Taking gene-expression profiling to the clinic: when will molecular signatures become relevant to patient care? , 2007, Nature Reviews Cancer.

[16]  Paola Gaia,et al.  Plasma microRNAs as biomarkers for myotonic dystrophy type 1 , 2014, Neuromuscular Disorders.

[17]  Joy Scaria,et al.  High-Throughput Screening for Biomarker Discovery , 2015, Disease markers.

[18]  Saveria Mazzara,et al.  Two of Them Do It Better: Novel Serum Biomarkers Improve Autoimmune Hepatitis Diagnosis , 2015, PloS one.

[19]  Charles Kooperberg,et al.  Combining biomarkers to detect disease with application to prostate cancer. , 2003, Biostatistics.

[20]  R. A. van den Berg,et al.  Centering, scaling, and transformations: improving the biological information content of metabolomics data , 2006, BMC Genomics.

[21]  Frédérique Lisacek,et al.  A multiparameter panel method for outcome prediction following aneurysmal subarachnoid hemorrhage , 2009, Intensive Care Medicine.

[22]  Johan Trygg,et al.  Multi- and Megavariate Data Analysis : Part II: Advanced Applications and Method Extensions , 2006 .

[23]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[24]  Paolo Aretini,et al.  The combination of four molecular markers improves thyroid cancer cytologic diagnosis and patient management , 2015, BMC Cancer.

[25]  Markus Müller,et al.  Bioinformatics for protein biomarker panel classification: what is needed to bring biomarker panels into in vitro diagnostics? , 2009, Expert review of proteomics.

[26]  U. Jeschke,et al.  Two-marker combinations for preoperative discrimination of benign and malignant ovarian masses. , 2012, Anticancer research.

[27]  Yudong D. He,et al.  Gene expression profiling predicts clinical outcome of breast cancer , 2002, Nature.

[28]  Sarah Watson,et al.  Pragmatic issues in biomarker evaluation for targeted therapies in cancer , 2015, Nature Reviews Clinical Oncology.

[29]  Luc Buée,et al.  A new decision tree combining Abeta 1-42 and p-Tau levels in Alzheimer's diagnosis. , 2013, Current Alzheimer research.