A New Hybrid Possibilistic-Probabilistic Decision-Making Scheme for Classification

Uncertainty is at the heart of decision-making processes in most real-world applications. Uncertainty can be broadly categorized into two types: aleatory and epistemic. Aleatory uncertainty describes the variability in the physical system where sensors provide information (hard) of a probabilistic type. Epistemic uncertainty appears when the information is incomplete or vague such as judgments or human expert appreciations in linguistic form. Linguistic information (soft) typically introduces a possibilistic type of uncertainty. This paper is concerned with the problem of classification where the available information, concerning the observed features, may be of a probabilistic nature for some features, and of a possibilistic nature for some others. In this configuration, most encountered studies transform one of the two information types into the other form, and then apply either classical Bayesian-based or possibilistic-based decision-making criteria. In this paper, a new hybrid decision-making scheme is proposed for classification when hard and soft information sources are present. A new Possibilistic Maximum Likelihood (PML) criterion is introduced to improve classification rates compared to a classical approach using only information from hard sources. The proposed PML allows to jointly exploit both probabilistic and possibilistic sources within the same probabilistic decision-making framework, without imposing to convert the possibilistic sources into probabilistic ones, and vice versa.

[1]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[2]  Jerry M. Mendel,et al.  Type-2 fuzzy sets made simple , 2002, IEEE Trans. Fuzzy Syst..

[3]  Nahla Ben Amor,et al.  On the Complexity of Decision Making in Possibilistic Decision Trees , 2011, UAI.

[4]  G. Klir,et al.  Uncertainty-based information: Elements of generalized information theory (studies in fuzziness and soft computing). , 1998 .

[5]  Lotfi A. Zadeh,et al.  Generalized theory of uncertainty (GTU) - principal concepts and ideas , 2006, Comput. Stat. Data Anal..

[6]  Ronald R. Yager,et al.  Hard and soft information fusion using measures , 2010, 2010 IEEE International Conference on Intelligent Systems and Knowledge Engineering.

[7]  Mathieu Serrurier,et al.  Naive possibilistic classifiers for imprecise or uncertain numerical data , 2014, Fuzzy Sets Syst..

[8]  Thierry Denoeux,et al.  Maximum likelihood estimation from fuzzy data using the EM algorithm , 2011, Fuzzy Sets Syst..

[9]  Salem Benferhat,et al.  An Efficient Algorithm for Naive Possibilistic Classifiers with Uncertain Inputs , 2008, SUM.

[10]  Paul Weng,et al.  Qualitative Decision Making Under Possibilistic Uncertainty: Toward more Discriminating Criteria , 2005, UAI.

[11]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[12]  Jonathan M. Garibaldi,et al.  Effect of type-2 fuzzy membership function shape on modelling variation in human decision making , 2004, 2004 IEEE International Conference on Fuzzy Systems (IEEE Cat. No.04CH37542).

[13]  Thierry Denoeux,et al.  40 years of Dempster-Shafer theory , 2016, Int. J. Approx. Reason..

[14]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[15]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[16]  Ronald R. Yager,et al.  Classic Works of the Dempster-Shafer Theory of Belief Functions , 2010, Classic Works of the Dempster-Shafer Theory of Belief Functions.

[17]  Philippe Smets,et al.  Quantified Representation of Uncertainty and Imprecision , 1998 .

[18]  Witold Pedrycz,et al.  Fuzzy logic-based generalized decision theory with imperfect information , 2012, Inf. Sci..

[19]  Thierry Denoeux,et al.  Modeling vague beliefs using fuzzy-valued belief structures , 2000, Fuzzy Sets Syst..

[20]  V. Kreinovich,et al.  HOW TO COMBINE PROBABILISTIC AND POSSIBILISTIC (EXPERT) KNOWLEDGE: UNIQUENESS OF RECONSTRUCTION IN YAGER'S (PRODUCT) APPROACH , 2011 .

[21]  Didier Dubois,et al.  Possibility Theory: Qualitative and Quantitative Aspects , 1998 .

[22]  Giulianella Coletti,et al.  Possibilistic and probabilistic likelihood functions and their extensions: Common features and specific characteristics , 2014, Fuzzy Sets Syst..

[23]  Carl Frélicot On Unifying Probabilistic/Fuzzy and Possibilistic Rejection-Based Classifiers , 1998, SSPR/SPR.

[24]  Didier Dubois,et al.  The legacy of 50 years of fuzzy sets: A discussion , 2015, Fuzzy Sets Syst..

[25]  Khaled Mellouli,et al.  Naïve possibilistic network classifiers , 2009, Fuzzy Sets Syst..

[26]  Éloi Bossé,et al.  Possibility Theory for the Design of Information Fusion Systems , 2019 .

[27]  Thierry Denoeux,et al.  Maximum Likelihood Estimation from Uncertain Data in the Belief Function Framework , 2013, IEEE Transactions on Knowledge and Data Engineering.

[28]  Milos Manic,et al.  Towards resilient critical infrastructures: Application of Type-2 Fuzzy Logic in embedded network security cyber sensor , 2011, 2011 4th International Symposium on Resilient Control Systems.

[29]  Ronald R. Yager,et al.  A measure based approach to the fusion of possibilistic and probabilistic uncertainty , 2011, Fuzzy Optim. Decis. Mak..

[30]  D. Dubois,et al.  When upper probabilities are possibility measures , 1992 .

[31]  Mathieu Serrurier,et al.  Possibilistic classifiers for numerical data , 2013, Soft Comput..

[32]  Ronald R. Yager On the fusion of possibilistic and probabilistic information in biometric decision-making , 2011, 2011 IEEE Workshop on Computational Intelligence in Biometrics and Identity Management (CIBIM).

[33]  P. Guo Possibilistic Decision-Making Approaches , 2007 .

[34]  Julius T. Tou,et al.  Pattern Recognition Principles , 1974 .

[35]  Didier Dubois,et al.  The three semantics of fuzzy sets , 1997, Fuzzy Sets Syst..

[36]  P. Walley Statistical Reasoning with Imprecise Probabilities , 1990 .

[37]  Éloi Bossé,et al.  A conceptual definition of a holonic processing framework to support the design of information fusion systems , 2015, Inf. Fusion.

[38]  Ronald R. Yager,et al.  Set Measure Directed Multi-Source Information Fusion , 2011, IEEE Transactions on Fuzzy Systems.

[39]  Henri Prade,et al.  Decision-Making Process: Concepts and Methods , 2009 .

[40]  David Banks,et al.  Games and Decisions , 2015 .

[41]  Peter Walley,et al.  Towards a unified theory of imprecise probability , 2000, Int. J. Approx. Reason..

[42]  Didier Dubois,et al.  Uncertainty Theories: a Unified View , 2007 .

[43]  Arie Tzvieli Possibility theory: An approach to computerized processing of uncertainty , 1990, J. Am. Soc. Inf. Sci..

[44]  Didier Dubois,et al.  Probability-Possibility Transformations, Triangular Fuzzy Sets, and Probabilistic Inequalities , 2004, Reliab. Comput..

[45]  Didier Dubois,et al.  Fuzzy sets and systems ' . Theory and applications , 2007 .

[46]  D. Dubois,et al.  On Possibility/Probability Transformations , 1993 .