An informational distance for estimating the faithfulness of a possibility distribution, viewed as a family of probability distributions, with respect to data

An acknowledged interpretation of possibility distributions in quantitative possibility theory is in terms of families of probabilities that are upper and lower bounded by the associated possibility and necessity measures. This paper proposes an informational distance function for possibility distributions that agrees with the above-mentioned view of possibility theory in the continuous and in the discrete cases. Especially, we show that, given a set of data following a probability distribution, the optimal possibility distribution with respect to our informational distance is the distribution obtained as the result of the probability-possibility transformation that agrees with the maximal specificity principle. It is also shown that when the optimal distribution is not available due to representation bias, maximizing this possibilistic informational distance provides more faithful results than approximating the probability distribution and then applying the probability-possibility transformation. We show that maximizing the possibilistic informational distance is equivalent to minimizing the squared distance to the unknown optimal possibility distribution. Two advantages of the proposed informational distance function is that (i) it does not require the knowledge of the shape of the probability distribution that underlies the data, and (ii) it amounts to sum up the elementary terms corresponding to the informational distance between the considered possibility distribution and each piece of data. We detail the particular case of triangular and trapezoidal possibility distributions and we show that any unimodal unknown probability distribution can be faithfully upper approximated by a triangular distribution obtained by optimizing the possibilistic informational distance.

[1]  Olivier Strauss,et al.  Rough histograms for robust statistics , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[2]  D. Dubois,et al.  On Possibility/Probability Transformations , 1993 .

[3]  Gilles Mauris,et al.  Possibility distributions: A unified representation of usual direct-probability-based parameter estimation methods , 2011, Int. J. Approx. Reason..

[4]  Gilles Mauris,et al.  Inferring a Possibility Distribution from Very Few Measurements , 2008, SMPS.

[5]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[6]  D. Dubois,et al.  When upper probabilities are possibility measures , 1992 .

[7]  Mathieu Serrurier,et al.  Maximum-likelihood principle for possibility distributions viewed as families of probabilities , 2011, 2011 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE 2011).

[8]  Jürg Kohlas,et al.  Handbook of Defeasible Reasoning and Uncertainty Management Systems , 2000 .

[9]  Thierry Denoeux,et al.  Constructing consonant belief functions from sample data using confidence sets of pignistic probabilities , 2008, Int. J. Approx. Reason..

[10]  Didier Dubois,et al.  Probability-Possibility Transformations, Triangular Fuzzy Sets, and Probabilistic Inequalities , 2004, Reliab. Comput..

[11]  C. D. Gelatt,et al.  Optimization by Simulated Annealing , 1983, Science.

[12]  Mathieu Serrurier,et al.  Imprecise Regression Based on Possibilistic Likelihood , 2011, SUM.

[13]  Thierry Denoeux,et al.  Inferring a possibility distribution from empirical data , 2006, Fuzzy Sets Syst..

[14]  Kevin Loquin,et al.  Fuzzy Histograms and Density Estimation , 2006, SMPS.

[15]  G. Klir,et al.  On probability-possibility transformations , 1992 .

[16]  Didier Dubois,et al.  Possibility theory and statistical reasoning , 2006, Comput. Stat. Data Anal..

[17]  L. Zadeh Fuzzy sets as a basis for a theory of possibility , 1999 .

[18]  Didier Dubois,et al.  Possibility Theory: Qualitative and Quantitative Aspects , 1998 .