Maximum A Posteriori EM MCE Logistic LASSO for learning fuzzy measures

A novel algorithm is introduced for learning fuzzy measures for Choquet integral-based information fusion. The new algorithm goes beyond previously published MCE-based approaches. It has the advantage that it is applicable to general measures, as opposed to only the Sugeno class of measures. In addition, the monotonicity constraints are handled easily with minimal time or storage requirements. Learning the fuzzy measure is framed as a maximum a posteriori (MAP) parameter learning problem. In order to maintain the constraints, this MAP problem is solved with a Gibbs sampler using an expectation maximization (EM) framework. For these reasons, the new algorithm is referred to as the MAP-EM MCE logistic LASSO algorithm. Results are given on synthetic and real data sets, the latter obtained from a landmine detection problem. Average reductions in false alarms of about 25% are achieved on the landmine detection problem and probabilities of detection in the interesting and meaningful range of 85%-95%.

[1]  W. Wong,et al.  The calculation of posterior distributions by data augmentation , 1987 .

[2]  M. A. Tanner,et al.  Tools for Statistical Inference: Methods for the Exploration of Posterior Distributions and Likelihood Functions, 3rd Edition , 1998 .

[3]  Michel Grabisch,et al.  A new algorithm for identifying fuzzy measures and its application to pattern recognition , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[4]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[5]  G. Choquet Theory of capacities , 1954 .

[6]  Andrew W. Moore,et al.  Logistic regression for data mining and high-dimensional classification , 2004 .

[7]  James M. Keller,et al.  Training the fuzzy integral , 1996, Int. J. Approx. Reason..

[8]  Joseph N. Wilson,et al.  Optimizing the Area Under a Receiver Operating Characteristic Curve With Application to Landmine Detection , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[9]  Paul D. Gader,et al.  Minimum Classification Error Training for Choquet Integrals With Applications to Landmine Detection , 2008, IEEE Transactions on Fuzzy Systems.

[10]  Hung T. Nguyen,et al.  Fundamentals of Uncertainty Calculi with Applications to Fuzzy Inference , 1994 .

[11]  Y. So,et al.  A Tutorial on Logistic Regression , 1996 .

[12]  Ping Chen,et al.  Training DHMMs of mine and clutter to minimize landmine detection errors , 2003, IEEE Trans. Geosci. Remote. Sens..

[13]  Mário A. T. Figueiredo Adaptive Sparseness for Supervised Learning , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Kwong-Sak Leung,et al.  Classification by nonlinear integral projections , 2003, IEEE Trans. Fuzzy Syst..

[15]  Paul D. Gader,et al.  Real-Time Landmine Detection with Ground-Penetrating Radar Using Discriminative and Adaptive Hidden Markov Models , 2005, EURASIP J. Adv. Signal Process..

[16]  G. Klir,et al.  Fuzzy Measure Theory , 1993 .

[17]  George J. Klir,et al.  Genetic algorithms for determining fuzzy measures from data , 1998, J. Intell. Fuzzy Syst..

[18]  Joseph N. Wilson,et al.  A Large-Scale Systematic Evaluation of Algorithms Using Ground-Penetrating Radar for Landmine Detection and Discrimination , 2007, IEEE Transactions on Geoscience and Remote Sensing.

[19]  L. Tierney Markov Chains for Exploring Posterior Distributions , 1994 .

[20]  M. Sugeno,et al.  Fuzzy Measures and Integrals: Theory and Applications , 2000 .

[21]  Jia Wang,et al.  Using Neural Networks to Determine Sugeno Measures by Statistics , 1997, Neural Networks.

[22]  Olga Kosheleva,et al.  IEEE International Conference on Fuzzy Systems , 1996 .

[23]  Paul D. Gader,et al.  Generalized Choquet fuzzy integral fusion , 2002, Inf. Fusion.

[24]  Deniz Erdogmus,et al.  Feature selection in MLPs and SVMs based on maximum output information , 2004, IEEE Transactions on Neural Networks.

[25]  Joseph N. Wilson,et al.  An Investigation of Using the Spectral Characteristics From Ground Penetrating Radar for Landmine/Clutter Discrimination , 2008, IEEE Transactions on Geoscience and Remote Sensing.

[26]  Christian P. Robert,et al.  Monte Carlo Statistical Methods (Springer Texts in Statistics) , 2005 .

[27]  Radko Mesiar Fuzzy measures and integrals , 2005, Fuzzy Sets Syst..

[28]  P. Gader,et al.  Information fusion and sparsity promotion using choquet integrals , 2007 .

[29]  Joseph N. Wilson,et al.  Detecting landmines with ground-penetrating radar using feature-based rules, order statistics, and adaptive whitening , 2004, IEEE Transactions on Geoscience and Remote Sensing.

[30]  Paul D. Gader,et al.  Continuous Choquet integrals with respect to random sets with applications to landmine detection , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[31]  菅野 道夫,et al.  Theory of fuzzy integrals and its applications , 1975 .

[32]  M. Sugeno,et al.  Multi-attribute classification using fuzzy integral , 1992, [1992 Proceedings] IEEE International Conference on Fuzzy Systems.

[33]  P. Gader,et al.  Neural Versus Heuristic Development of Choquet Fuzzy Integral Fusion Algorithms for Land Mine Detection , 2000 .

[34]  M. Tanner Tools for statistical inference: methods for the exploration of posterior distributions and likeliho , 1994 .

[35]  James M. Keller,et al.  Determining fuzzy integral densities using a genetic algorithm for pattern recognition , 1997, 1997 Annual Meeting of the North American Fuzzy Information Processing Society - NAFIPS (Cat. No.97TH8297).

[36]  Jung-Hsien Chiang,et al.  Choquet fuzzy integral-based hierarchical networks for decision analysis , 1999, IEEE Trans. Fuzzy Syst..

[37]  Marcin Detyniecki,et al.  Mathematical Aggregation Operators and their Application to Video Querying , 2000 .

[38]  Paul D. Gader,et al.  Detection and Discrimination of Land Mines based on Edge Histogram Descriptors and Fuzzy K-Nearest Neighbors , 2006, 2006 IEEE International Conference on Fuzzy Systems.

[39]  Mohamed S. Kamel,et al.  Choquet integral-based aggregation of image template matching algorithms , 2003, 22nd International Conference of the North American Fuzzy Information Processing Society, NAFIPS 2003.

[40]  Michel Grabisch,et al.  Classification by fuzzy integral: performance and tests , 1994, CVPR 1994.