A novel measure for evaluating an ordered list: application in microRNA target prediction

Sensitivity and specificity are the most widely used statistics for measuring the performance of a binary classification test. They stand vastly meaningful for variety of use cases where the classifying tests are affordable. But unfortunately, there is a legion of problems arriving from different streams of natural sciences where the screening test is too expensive to render for all the predicted objects. Thus, the trend has been for scientists to calculate the sensitivity and the specificity of a binary classification test based on a handful of experimentally proven facts, which is theoretically uncertain. In this article a novel measure is proposed that assigns importance to multiple ordered lists, taking into account the share of majority voted ranked pairs of elements a list contains. A real life bioinformatic application is demonstrated in the domain of microRNA target prediction where a number of algorithms exist. Using the proposed measure, we aim to assign certain weight to each algorithm that conveys its reliability with respect to the rest.

[1]  Charles A. Holt,et al.  The Nash equilibrium: A perspective , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[2]  Ruth Etzioni,et al.  Combining Results of Microarray Experiments: A Rank Aggregation Approach , 2006 .

[3]  Julius Brennecke,et al.  Identification of Drosophila MicroRNA Targets , 2003, PLoS biology.

[4]  K. Gunsalus,et al.  Combinatorial microRNA target predictions , 2005, Nature Genetics.

[5]  Guy N. Brock,et al.  clValid , an R package for cluster validation , 2008 .

[6]  Vasyl Pihur,et al.  Weighted rank aggregation of cluster validation measures: a Monte Carlo cross-entropy approach , 2007, Bioinform..

[7]  Moni Naor,et al.  Rank aggregation methods for the Web , 2001, WWW '01.

[8]  Dang D. Long,et al.  Potent effect of target structure on microRNA function , 2007, Nature Structural &Molecular Biology.

[9]  N. Greenberg,et al.  Down‐regulation of prostasin serine protease: A potential invasion suppressor in prostate cancer , 2001, The Prostate.

[10]  D. Bartel MicroRNAs Genomics, Biogenesis, Mechanism, and Function , 2004, Cell.

[11]  R. Graham,et al.  Spearman's Footrule as a Measure of Disarray , 1977 .

[12]  Y. Li,et al.  Incorporating structure to predict microRNA targets. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[13]  K. Kosik,et al.  MicroRNA-21 is an antiapoptotic factor in human glioblastoma cells. , 2005, Cancer research.

[14]  Anton J. Enright,et al.  Human MicroRNA Targets , 2004, PLoS biology.

[15]  C. Burge,et al.  Prediction of Mammalian MicroRNA Targets , 2003, Cell.