Rank-Score Characteristics (RSC) Function and Cognitive Diversity

In Combinatorial Fusion Analysis (CFA), a set of multiple scoring systems is used to facilitate integration and fusion of data, features, and/or decisions so as to improve the quality of resultant decisions and actions. Specifically, in a recently developed information fusion method, each system consists of a score function, a rank function, and a Rank-Score Characteristic (RSC) function. The RSC function illustrates the scoring (or ranking) behavior of the system. In this report, we show that RSC functions can be computed easily and RSC functions can be used to measure cognitive diversity for two or more scoring systems. In addition, we show that measuring diversity using the RSC function is inherently distinct from the concept of correlation in statistics and can be used to improve fusion results in classification and decision making. Among a set of domain applications, we discuss information retrieval, virtual screening, and target tracking.

[1]  E. Schadt Molecular networks as sensors and drivers of common human diseases , 2009, Nature.

[2]  Valerie J. Gillet,et al.  Analysis of Data Fusion Methods in Virtual Screening: Theoretical Model , 2006, J. Chem. Inf. Model..

[3]  Amanda J. C. Sharkey,et al.  Combining Artificial Neural Nets: Ensemble and Modular Multi-Net Systems , 1999 .

[4]  Virginia Gewin Biodiversity: Rack and field , 2009, Nature.

[5]  Xin Yao,et al.  Diversity creation methods: a survey and categorisation , 2004, Inf. Fusion.

[6]  Hrishikesh D. Vinod,et al.  Advances in social science research using R , 2010 .

[7]  Chuan Yi Tang,et al.  Feature Selection and Combination Criteria for Improving Accuracy in Protein Structure Prediction , 2007, IEEE Transactions on NanoBioscience.

[8]  Peter J. Denning The profession of IT: The IT schools movement , 2001, Commun. ACM.

[9]  D. Frank Hsu,et al.  Combinatorial fusion with on-line learning algorithms , 2008, 2008 11th International Conference on Information Fusion.

[10]  Anders Krogh,et al.  Neural Network Ensembles, Cross Validation, and Active Learning , 1994, NIPS.

[11]  Soon Myoung Chung,et al.  Combining Multiple Feature Selection Methods for Text Categorization by Using Rank-Score Characteristics , 2009, 2009 21st IEEE International Conference on Tools with Artificial Intelligence.

[12]  D. Frank Hsu,et al.  Microarray Gene Expression Analysis Using Combinatorial Fusion , 2009, 2009 Ninth IEEE International Conference on Bioinformatics and BioEngineering.

[13]  Paul B. Kantor,et al.  Predicting the effectiveness of Naïve data fusion on the basis of system characteristics , 2000 .

[14]  R. Engle,et al.  Anticipating Correlations: A New Paradigm for Risk Management , 2009 .

[15]  D. Frank Hsu,et al.  Consensus Scoring Criteria for Improving Enrichment in Virtual Screening , 2005, J. Chem. Inf. Model..

[16]  Hui-Huang Hsu,et al.  Advanced Data Mining Technologies in Bioinformatics , 2006 .

[17]  D. Frank Hsu,et al.  Comparing Rank and Score Combination Methods for Data Fusion in Information Retrieval , 2005, Information Retrieval.

[18]  Subhash C. Bagui,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2005, Technometrics.

[19]  Tin Kam Ho,et al.  MULTIPLE CLASSIFIER COMBINATION: LESSONS AND NEXT STEPS , 2002 .

[20]  D. Frank Hsu,et al.  Performance evaluation of classifier ensembles in terms of diversity and performance of individual systems , 2010, Int. J. Pervasive Comput. Commun..

[21]  Felix Naumann,et al.  Data fusion , 2009, CSUR.

[22]  K David,et al.  2020 Vision , 1998, IEEE Vehicular Technology Magazine.

[23]  Chuan Yi Tang,et al.  On the Relationships Among Various Diversity Measures in Multiple Classifier Systems , 2008, 2008 International Symposium on Parallel Architectures, Algorithms, and Networks (i-span 2008).

[24]  Chuan Yi Tang,et al.  On the Diversity-Performance Relationship for Majority Voting in Classifier Ensembles , 2007, MCS.

[25]  Horst Bunke,et al.  Hybrid methods in pattern recognition , 1987 .

[26]  D. F. Hsu,et al.  Combinatorial Fusion for Improving Portfolio Performance , 2010 .

[27]  Damian M. Lyons,et al.  Combining multiple scoring systems for target tracking using rank-score characteristics , 2009, Inf. Fusion.

[28]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  D. Frank Hsu,et al.  Analysis of Autism Prevalence and Neurotoxins Using Combinatorial Fusion and Association Rule Mining , 2009, 2009 Ninth IEEE International Conference on Bioinformatics and BioEngineering.

[30]  Ludmila I. Kuncheva,et al.  Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[31]  S Kim,et al.  Microarray Gene Expression Analysis. , 2001 .

[32]  Belur V. Dasarathy,et al.  Elucidative fusion systems - an exposition , 2000, Inf. Fusion.

[33]  Anthony J. G. Hey,et al.  Jim Gray on eScience: a transformed scientific method , 2009, The Fourth Paradigm.