An investigation into label fusion on sparse data

The Department of Homeland Security (DHS) and the Transportation Security Administration (TSA) are interested in developing a standardized testing procedure for determining the performance of a candidate detection systems combined with a currently operational detection system. This paper investigates the problem of combining data from different detection systems that could possibly produce a more accurate combined detection system. Theoretically, this combination of detection systems tends to assume that the Receiver Operating Characteristic (ROC) curves that describe the detection systems are well defined for all thresholds on the unit square. In practice, many ROC curves are discrete and/or incomplete data sets and label fusion with a competing existing system is not well defined. This work investigates the concept of fusion with incomplete ROC data using an estimate for the fused performance of the detection system under a constrained OR label rule.

[1]  Steven N. Thorsen,et al.  A Boolean Algebra of receiver operating characteristic curves , 2007, 2007 10th International Conference on Information Fusion.

[2]  P. Qiu.  The Statistical Evaluation of Medical Tests for Classification and Prediction , 2005 .

[3]  Stelios C. A. Thomopoulos,et al.  Distributed Fusion Architectures and Algorithms for Target Tracking , 1997, Proc. IEEE.

[4]  Christine M. Schubert.  Quantifying Correlation and Its Effects on System Performance in Classifier Fusion , 2005 .

[5]  Kenneth W. Bauer,et al.  Receiver operating characteristic curves and fusion of multiple classifiers , 2003, Sixth International Conference of Information Fusion, 2003. Proceedings of the.

[6]  K.W. Bauer,et al.  The Inclusion of Correlation Effects in the Performance of Multiple Sensor and Classifier Systems , 2005, 2005 IEEE Aerospace Conference.

[7]  Alexander M Venzin.  Quantifying Performance Bias in Label Fusion , 2012 .

[8]  M.E. Oxley,et al.  A comparison of ROC curves for label-fused within and across classifier systems , 2005, 2005 7th International Conference on Information Fusion.

[9]  Jon Atli Benediktsson,et al.  The effect of correlation on the accuracy of the combined classifier in decision level fusion , 2000, IGARSS 2000. IEEE 2000 International Geoscience and Remote Sensing Symposium. Taking the Pulse of the Planet: The Role of Remote Sensing in Managing the Environment. Proceedings (Cat. No.00CH37120).

[10]  Steven N. Thorsen,et al.  A description of competing fusion systems , 2006, Inf. Fusion.