Explosive hazard detection with feature and decision level fusion, multiple kernel learning, and fuzzy integrals

Kernel methods for classification is a well-studied area in which data are implicitly mapped from a lower-dimensional space to a higher-dimensional space to improve classification accuracy. However, for most kernel methods, one must still choose a kernel to use for the problem. Since there is, in general, no way of knowing which kernel is the best, multiple kernel learning (MKL) is a technique used to learn the aggregation of a set of valid kernels into a single (ideally) superior kernel. The aggregation can be done using weighted sums of the pre-computed kernels, but determining the summation weights is not a trivial task. A popular and successful approach to this problem is MKL-group lasso (MKLGL), where the weights and classification surface are simultaneously solved by iteratively optimizing a min-max optimization until convergence. In this work, we compare the results of two previously proposed MKL algorithms to MKLGL in the context of explosive hazard detection using ground penetrating radar (GPR) data. The first MKL algorithm we employ is an ℓp-normed genetic algorithm MKL (GAMKLp), which uses a genetic algorithm to learn the weights of a set of pre-computed kernel matrices for use with MKL classification. A second algorithm, called decision-level fuzzy integral MKL (DeFIMKL), is also employed, where a fuzzy measure with respect to the fuzzy Choquet integral is learned via quadratic programming, and the decision value—viz., the class label—is computed using the fuzzy Choquet integral aggregation. Experiments using government furnished GPR data show that these MKL algorithms can outperform MKLGL when applied to support vector machine (SVM)-based classification.

[1]  Hugh F. Durrant-Whyte,et al.  Sensor Models and Multisensor Integration , 1988, Int. J. Robotics Res..

[2]  Thomson-CSF,et al.  Fuzzy Integral for Classification and Feature Extraction , 2000 .

[3]  Christian Wagner,et al.  Extracting meta-measures from data for fuzzy aggregation of crowd sourced information , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[4]  Yan Li,et al.  FUSION OF EXTREME LEARNING MACHINE WITH FUZZY INTEGRAL , 2013 .

[5]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[6]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[7]  Michel Grabisch,et al.  Fuzzy Measures and Integrals , 1995 .

[8]  James Llinas,et al.  An introduction to multisensor data fusion , 1997, Proc. IEEE.

[9]  M. Sugeno,et al.  An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy , 1989 .

[10]  Yu-Chiang Frank Wang,et al.  A Novel Multiple Kernel Learning Framework for Heterogeneous Feature Fusion and Variable Selection , 2012, IEEE Transactions on Multimedia.

[11]  Paul D. Gader,et al.  Generalized Choquet fuzzy integral fusion , 2002, Inf. Fusion.

[12]  James M. Keller,et al.  Learning Fuzzy-Valued Fuzzy Measures for the Fuzzy-Valued Sugeno Fuzzy Integral , 2010, IPMU.

[13]  James M. Keller,et al.  Extension of the Fuzzy Integral for General Fuzzy Set-Valued Information , 2014, IEEE Transactions on Fuzzy Systems.

[14]  M. Kloft,et al.  Non-sparse Multiple Kernel Learning , 2008 .

[15]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[16]  M. Grabisch Fuzzy integral in multicriteria decision making , 1995 .

[17]  Roland Siegwart,et al.  Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAM , 2011, J. Intell. Robotic Syst..

[18]  Timothy C. Havens,et al.  Multiple kernel aggregation using fuzzy integrals , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[19]  James M. Keller,et al.  A fuzzy Choquet integral with an interval type-2 fuzzy number-valued integrand , 2010, International Conference on Fuzzy Systems.

[20]  Mehryar Mohri,et al.  L2 Regularization for Learning Kernels , 2009, UAI.

[21]  James M. Keller,et al.  Information fusion in computer vision using the fuzzy integral , 1990, IEEE Trans. Syst. Man Cybern..

[22]  Belur V. Dasarathy,et al.  Sensor fusion potential exploitation-innovative architectures and illustrative applications , 1997, Proc. IEEE.

[23]  Melissa F. Anderson,et al.  Estimation of adult skeletal age-at-death using the Sugeno fuzzy integral. , 2009, American journal of physical anthropology.

[24]  Timothy C. Havens,et al.  A comparison of robust principal component analysis techniques for buried object detection in downward looking GPR sensor data , 2016, SPIE Defense + Security.

[25]  Zenglin Xu,et al.  Simple and Efficient Multiple Kernel Learning by Group Lasso , 2010, ICML.

[26]  Sebastian Nowozin,et al.  On feature combination for multiclass object classification , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[27]  Christian Wagner,et al.  Fuzzy integrals of crowd-sourced intervals using a measure of generalized accord , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[28]  Marc Sebban,et al.  Discriminative feature fusion for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Federico Castanedo,et al.  A Review of Data Fusion Techniques , 2013, TheScientificWorldJournal.

[30]  Hung T. Nguyen,et al.  Fundamentals of Uncertainty Calculi with Applications to Fuzzy Inference , 1994 .

[31]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[32]  Fahad Shahbaz Khan,et al.  Top-down color attention for object recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[33]  Jiebo Luo,et al.  Heterogeneous feature machines for visual recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[34]  Edoardo Pasolli,et al.  Ensemble Multiple Kernel Active Learning For Classification of Multisource Remote Sensing Data , 2015, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[35]  Ren C. Luo,et al.  Multisensor fusion and integration: approaches, applications, and future research directions , 2002 .

[36]  Jake K. Aggarwal,et al.  Multisensor Fusion for Computer Vision , 1993, NATO ASI Series.

[37]  Shuang Wu,et al.  Multimodal feature fusion for robust event detection in web videos , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[38]  Timothy C. Havens,et al.  Regularization-based learning of the Choquet integral , 2014, 2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[39]  Matti Pietikäinen,et al.  Multiscale Local Phase Quantization for Robust Component-Based Face Recognition Using Kernel Fusion of Multiple Descriptors , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  H. Carter Fuzzy Sets and Systems — Theory and Applications , 1982 .

[41]  Wen Gao,et al.  Group-sensitive multiple kernel learning for object categorization , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[42]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[43]  Christian Wagner,et al.  Data-Informed Fuzzy Measures for Fuzzy Integration of Intervals and Fuzzy Numbers , 2015, IEEE Transactions on Fuzzy Systems.

[44]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[45]  Kwong-Sak Leung,et al.  Fuzzified Choquet Integral With a Fuzzy-Valued Integrand and Its Application on Temperature Prediction , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[46]  Paul D. Gader,et al.  Sparsity Promotion Models for the Choquet Integral , 2007, 2007 IEEE Symposium on Foundations of Computational Intelligence.

[47]  G. Choquet Theory of capacities , 1954 .

[48]  James M. Keller,et al.  Training the fuzzy integral , 1996, Int. J. Approx. Reason..

[49]  J. Mercer Functions of positive and negative type, and their connection with the theory of integral equations , 1909 .

[50]  Xizhao Wang,et al.  Upper integral network with extreme learning mechanism , 2011, Neurocomputing.

[51]  Zhimin Chen,et al.  An intuitionistic fuzzy weighted OWA operator and its application , 2013, Int. J. Mach. Learn. Cybern..

[52]  Timothy C. Havens,et al.  GPR anomaly detection with robust principal component analysis , 2015, Defense + Security Symposium.

[53]  Behnaz Bigdeli,et al.  Fusion of hyperspectral and LIDAR data using decision template-based fuzzy multiple classifier system , 2015, Int. J. Appl. Earth Obs. Geoinformation.

[54]  Deli Zhang,et al.  Fuzzy integrals of fuzzy-valued functions , 1993 .

[55]  Timothy C. Havens,et al.  Approach to explosive hazard detection using sensor fusion and multiple kernel learning with downward-looking GPR and EMI sensor data , 2015, Defense + Security Symposium.

[56]  David Haussler,et al.  Proceedings of the fifth annual workshop on Computational learning theory , 1992, COLT 1992.

[57]  Christian Wagner,et al.  Generalization of the Fuzzy Integral for discontinuous interval- and non-convex interval fuzzy set-valued inputs , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[58]  Timothy C. Havens,et al.  Feature and decision level fusion using multiple kernel learning and fuzzy integrals , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[59]  James M. Keller,et al.  Sugeno fuzzy integral generalizations for Sub-normal Fuzzy set-valued inputs , 2012, 2012 IEEE International Conference on Fuzzy Systems.

[60]  Leslie M. Collins,et al.  Leveraging robust principal component analysis to detect buried explosive threats in handheld ground-penetrating radar data , 2015, Defense + Security Symposium.