Learning fuzzy measures from data: Simplifications and optimisation strategies

Abstract Fuzzy measures model interactions between the inputs in aggregation problems. Their complexity grows exponentially with the dimensionality of the problem, and elicitation of fuzzy measure coefficients either from domain experts or from empirical data is a significant challenge. The notions of k-additivity and k-maxitivity simplify the fuzzy measures by limiting interactions to subsets of up to k elements, but neither reduces the complexity of monotonicity constraints. In this paper we explore various approaches to further reduce the complexity of learning fuzzy measures. We introduce the concept of k-interactivity, which reduces both the number of variables and constraints, and also the complexity of each constraint. The learning problem is set as a linear programming problem, and its numerical efficiency is illustrated on numerical experiments. The proposed methods allow efficient learning of fuzzy measures in up to 30 variables, which is significantly higher than using k-additive and k-maxitive fuzzy measures.

[1]  Derek Anderson,et al.  An efficient evolutionary algorithm to optimize the Choquet integral , 2019, Int. J. Intell. Syst..

[2]  M. Grabisch.  The application of fuzzy integrals in multicriteria decision making , 1996 .

[3]  Serge Guillaume,et al.  Revised HLMS: A useful algorithm for fuzzy measure identification , 2013, Inf. Fusion.

[4]  Gleb Beliakov,et al.  How to build aggregation operators from data , 2003, Int. J. Intell. Syst..

[5]  Salvatore Greco,et al.  Non-additive robust ordinal regression: A multiple criteria decision model based on the Choquet integral , 2010, Eur. J. Oper. Res..

[6]  S. Greco,et al.  Combining analytical hierarchy process and Choquet integral within non-additive robust ordinal regression ☆ , 2016 .

[7]  Endre Pap,et al.  Two kinds of explicit preference information oriented capacity identification methods in the context of multicriteria decision analysis , 2018, Int. Trans. Oper. Res..

[8]  Alain Chateauneuf,et al.  Some Characterizations of Lower Probabilities and Other Monotone Capacities through the use of Möbius Inversion , 1989, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[9]  M. Grabisch.  Fuzzy integral in multicriteria decision making , 1995 .

[10]  Salvatore Greco,et al.  Robust ordinal regression for value functions handling interacting criteria , 2014, Eur. J. Oper. Res..

[11]  Ivan Kojadinovic,et al.  Minimum variance capacity identification , 2007, Eur. J. Oper. Res..

[12]  Paul D. Gader,et al.  Minimum Classification Error Training for Choquet Integrals With Applications to Landmine Detection , 2008, IEEE Transactions on Fuzzy Systems.

[13]  Gang Li,et al.  Learning Choquet-Integral-Based Metrics for Semisupervised Clustering , 2011, IEEE Transactions on Fuzzy Systems.

[14]  Timothy C. Havens,et al.  Data-Driven Compression and Efficient Learning of the Choquet Integral , 2018, IEEE Transactions on Fuzzy Systems.

[15]  Michel Grabisch,et al.  A new algorithm for identifying fuzzy measures and its application to pattern recognition , 1995, Proceedings of 1995 IEEE International Conference on Fuzzy Systems..

[16]  Salvatore Greco,et al.  Non Additive Robust Ordinal Regression for urban and territorial planning: an application for siting an urban waste landfill , 2016, Ann. Oper. Res..

[17]  Gleb Beliakov,et al.  Nonadditivity index and capacity identification method in the context of multicriteria decision making , 2018, Inf. Sci..

[18]  Jian-Zhang Wu,et al.  Compromise principle based methods of identifying capacities in the framework of multicriteria decision analysis , 2014, Fuzzy Sets Syst..

[19]  Shanlin Yang,et al.  2-Additive Capacity Identification Methods From Multicriteria Correlation Preference Information , 2015, IEEE Transactions on Fuzzy Systems.

[20]  Hans-Jürgen Zimmermann,et al.  Improved feature selection and classification by the 2-additive fuzzy measure , 1999, Fuzzy Sets Syst..

[21]  Michel Grabisch,et al.  K-order Additive Discrete Fuzzy Measures and Their Representation , 1997, Fuzzy Sets Syst..

[22]  Gleb Beliakov,et al.  Construction of aggregation functions from data using linear programming , 2009, Fuzzy Sets Syst..

[23]  Michel Grabisch,et al.  Set Functions, Games and Capacities in Decision Making , 2016 .

[24]  Jean-Luc Marichal,et al.  Determination of weights of interacting criteria from a reference set , 2000, Eur. J. Oper. Res..

[25]  Radko Mesiar,et al.  Generalizations of k-order additive discrete fuzzy measures , 1999, Fuzzy Sets Syst..

[26]  L. Shapley.  A Value for n-person Games , 1988 .

[27]  Eyke Hüllermeier,et al.  Learning monotone nonlinear models using the Choquet integral , 2011, Machine Learning.

[28]  Marc Roubens,et al.  Choice, Ranking and Sorting in Fuzzy Multiple Criteria Decision Aid , 2005 .

[29]  Gleb Beliakov,et al.  Learning k-maxitive fuzzy measures from data by mixed integer programming , 2021, Fuzzy Sets Syst..

[30]  Jean-Luc Marichal,et al.  Entropy of discrete Choquet capacities , 2002, Eur. J. Oper. Res..

[31]  Jean-Luc Marichal,et al.  Tolerant or intolerant character of interacting criteria in aggregation by the Choquet integral , 2004, Eur. J. Oper. Res..

[32]  Michel Grabisch,et al.  The representation of importance and interaction of features by fuzzy measures , 1996, Pattern Recognit. Lett..

[33]  Michel Grabisch,et al.  A review of methods for capacity identification in Choquet integral based multi-attribute utility theory: Applications of the Kappalab R package , 2008, Eur. J. Oper. Res..

[34]  Radko Mesiar,et al.  K-Order Additive Fuzzy Measures , 1999, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[35]  Humberto Bustince,et al.  A Practical Guide to Averaging Functions , 2015, Studies in Fuzziness and Soft Computing.

[36]  G. Choquet.  Theory of capacities , 1954 .

[37]  James M. Keller,et al.  Training the fuzzy integral , 1996, Int. J. Approx. Reason..

[38]  Didier Dubois,et al.  The Use of the Discrete Sugeno Integral in Decision-Making: A Survey , 2001, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[39]  Michel Grabisch,et al.  Classification by fuzzy integral: performance and tests , 1994, CVPR 1994.

[40]  Gleb Beliakov,et al.  Nonmodularity index for capacity identifying with multiple criteria preference information , 2019, Inf. Sci..

[41]  Christophe Labreuche,et al.  To : Fuzzy Sets and Systems , 2010 .

[42]  Gleb Beliakov,et al.  Aggregation Functions: A Guide for Practitioners , 2007, Studies in Fuzziness and Soft Computing.

[43]  Bernard De Baets,et al.  Aggregation Operators Defined by k-Order Additive/Maxitive Fuzzy Measures , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[44]  Jean-Luc Marichal,et al.  k-intolerant capacities and Choquet integrals , 2007, Eur. J. Oper. Res..

[45]  Serge Guillaume,et al.  k-maxitive fuzzy measures: A scalable approach to model interactions , 2017, Fuzzy Sets Syst..

[46]  Jean-Luc Marichal,et al.  Behavioral analysis of aggregation in multicriteria decision aid , 2000 .