Adaptive Local Fusion With Fuzzy Integrals

We propose a novel method for fusing different classifiers outputs. Our approach, called context extraction for local fusion with fuzzy integrals (CELF-FI), is a local approach that adapts a fuzzy integrals fusion method to different regions of the feature space. It is based on a novel objective function that combines context identification and multialgorithm fusion criteria into a joint objective function. This objective function consists of two terms: The first is designed to produce compact clusters, called contexts, and the second is designed to produce Sugeno measures for fuzzy integral fusion for each context. The terms are optimized simultaneously via alternating optimization. To test a new sample, first, its features (extracted by each algorithm) are used to assign it to each context with a fuzzy membership degree. Second, the sample confidence values (assigned by each algorithm) are fused within each context using the learned context fusion parameters. Then, the context-dependent partial confidence values are weighted by the membership degrees and averaged over all contexts to produce a final confidence value. We illustrate the performance of CELF using synthetic data, and we apply it to the problem of landmine detection using ground penetrating radar and wideband electromagnetic induction. Our extensive experiments have indicated that the proposed fusion approach outperforms all individual classifiers, the global fuzzy integral fusion method, and the basic local fusion with linear aggregation.

[1]  Joseph N. Wilson,et al.  An Investigation of Using the Spectral Characteristics From Ground Penetrating Radar for Landmine/Clutter Discrimination , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Homayoun Seraji,et al.  A Multisensor Decision Fusion System for Terrain Safety Assessment , 2009, IEEE Transactions on Robotics.

[3]  Ofer Melnik,et al.  Mixed group ranks: preference and confidence in classifier combination , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  E. Pap Null-Additive Set Functions , 1995 .

[5]  Ludmila I. Kuncheva,et al.  "Fuzzy" versus "nonfuzzy" in combining classifiers designed by Boosting , 2003, IEEE Trans. Fuzzy Syst..

[6]  Paul D. Gader,et al.  Fusion of handwritten word classifiers , 1996, Pattern Recognit. Lett..

[7]  Paul D. Gader,et al.  A generic framework for context-dependent fusion with application to landmine detection , 2008, SPIE Defense + Commercial Sensing.

[8]  Hichem Sahli,et al.  Thermal infrared identification of buried landmines , 2005, SPIE Defense + Commercial Sensing.

[9]  Paul D. Gader,et al.  Minimum Classification Error Training for Choquet Integrals With Applications to Landmine Detection , 2008, IEEE Transactions on Fuzzy Systems.

[10]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[11]  B. S. Manjunath,et al.  Introduction to mpeg-7 , 2002 .

[12]  Gang Li,et al.  Learning Choquet-Integral-Based Metrics for Semisupervised Clustering , 2011, IEEE Transactions on Fuzzy Systems.

[13]  Hichem Frigui,et al.  A Robust Competitive Clustering Algorithm With Applications in Computer Vision , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  E. Mandler,et al.  Combining the Classification Results of Independent Classifiers Based on the Dempster/Shafer Theory of Evidence , 1988 .

[15]  Leslie M. Collins,et al.  Classification of landmine-like metal targets using wideband electromagnetic induction , 2000, IEEE Trans. Geosci. Remote. Sens..

[16]  Michio Sugeno,et al.  Separated Hierarchical Decomposition of the Choquet Integral , 1997, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[17]  Ludmila I. Kuncheva,et al.  'Change-glasses' approach in pattern recognition , 1993, Pattern Recognit. Lett..

[18]  Xiaowei Yang,et al.  A Kernel Fuzzy c-Means Clustering-Based Fuzzy Support Vector Machine Algorithm for Classification Problems With Outliers or Noises , 2011, IEEE Transactions on Fuzzy Systems.

[19]  Hanseok Ko,et al.  Bayesian fusion of confidence measures for speech recognition , 2005, IEEE Signal Process. Lett..

[20]  Kaspar Althoefer,et al.  Detection of Landmines Using Nuclear Quadrupole Resonance (NQR): Signal Processing to Aid Classification , 2005, CLAWAR.

[21]  Michel Grabisch,et al.  A new algorithm for identifying fuzzy measures and its application to pattern recognition , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[22]  Witold Pedrycz,et al.  Two nonparametric models for fusing heterogeneous fuzzy data , 1998, IEEE Trans. Fuzzy Syst..

[23]  Paul D. Gader,et al.  Real-Time Landmine Detection with Ground-Penetrating Radar Using Discriminative and Adaptive Hidden Markov Models , 2005, EURASIP J. Adv. Signal Process..

[24]  Ludmila I. Kuncheva,et al.  Switching between selection and fusion in combining classifiers: an experiment , 2002, IEEE Trans. Syst. Man Cybern. Part B.

[25]  Michael J. Pazzani,et al.  Combining Neural Network Regression Estimates with Regularized Linear Weights , 1996, NIPS.

[26]  Paul D. Gader,et al.  Context-dependent fusion for landmine detection with ground-penetrating radar , 2007, SPIE Defense + Commercial Sensing.

[27]  M. Sugeno,et al.  An interpretation of fuzzy measures and the Choquet integral as an integral with respect to a fuzzy , 1989 .

[28]  Michel Grabisch A graphical interpretation of the Choquet integral , 2000, IEEE Trans. Fuzzy Syst..

[29]  Thomas H. Bell,et al.  Simple phenomenological models for wideband frequency-domain electromagnetic induction , 2001, IEEE Trans. Geosci. Remote. Sens..

[30]  Antanas Verikas,et al.  Soft combination of neural classifiers: A comparative study , 1999, Pattern Recognit. Lett..

[31]  Andrew Blake,et al.  Probabilistic Fusion of Stereo with Color and Contrast for Bilayer Segmentation , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[33]  Giuseppe Pirlo,et al.  Fuzzy-Zoning-Based Classification for Handwritten Characters , 2011, IEEE Transactions on Fuzzy Systems.

[34]  Nirmal K. Bose,et al.  Landmine detection and classification with complex-valued hybrid neural network using scattering parameters dataset , 2005, IEEE Transactions on Neural Networks.

[35]  Paul D. Gader,et al.  Detection and Discrimination of Land Mines in Ground-Penetrating Radar Based on Edge Histogram Descriptors and a Possibilistic $K$-Nearest Neighbor Classifier , 2009, IEEE Transactions on Fuzzy Systems.

[36]  James M. Keller,et al.  Information fusion in computer vision using the fuzzy integral , 1990, IEEE Trans. Syst. Man Cybern..

[37]  Jerry M. Mendel,et al.  Aggregation Using the Linguistic Weighted Average and Interval Type-2 Fuzzy Sets , 2007, IEEE Transactions on Fuzzy Systems.

[38]  Thomas H. Bell,et al.  Electromagnetic induction spectroscopy for clearing landmines , 2001, IEEE Trans. Geosci. Remote. Sens..

[39]  C. Ji,et al.  Combined weak classifiers , 1996, NIPS 1996.

[40]  Kevin W. Bowyer,et al.  Combination of multiple classifiers using local accuracy estimates , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[41]  D. Denneberg Non-additive measure and integral , 1994 .

[42]  Michio Sugeno,et al.  A Hierarchical Decomposition of Choquet integral Model , 1995, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[43]  Paul D. Gader,et al.  Generalized Choquet fuzzy integral fusion , 2002, Inf. Fusion.

[44]  Leslie M. Collins,et al.  Comparison of algorithms for land mine detection and discrimination using ground penetrating radar , 2002, SPIE Defense + Commercial Sensing.

[45]  Thomas R. Witten Present state of the art in ground-penetrating radars for mine detection , 1998, Defense, Security, and Sensing.

[46]  Isabelle Bloch,et al.  Introduction of neighborhood information in evidence theory and application to data fusion of radar and optical images with partial cloud cover , 1998, Pattern Recognit..

[47]  Sargur N. Srihari,et al.  Decision Combination in Multiple Classifier Systems , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[48]  Waymond R. Scott,et al.  Broadband Array of Electromagnetic Induction Sensors for Detecting Buried Landmines , 2008, IGARSS 2008 - 2008 IEEE International Geoscience and Remote Sensing Symposium.

[49]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Motoyuki Sato,et al.  Investigation of Time–Frequency Features for GPR Landmine Discrimination , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[51]  G. Choquet Theory of capacities , 1954 .

[52]  K. Leszczynski,et al.  Sugeno's fuzzy measure and fuzzy clustering , 1985 .

[53]  Paul D. Gader,et al.  New results in fuzzy-set-based detection of land mines with GPR , 1999, Defense, Security, and Sensing.