On some ordinal models for decision making under uncertainty

In the field of Artificial Intelligence many models for decision making under uncertainty have been proposed that deviate from the traditional models used in Decision Theory, i.e. the Subjective Expected Utility (SEU) model and its many variants. These models aim at obtaining simple decision rules that can be implemented by efficient algorithms while based on inputs that are less rich than what is required in traditional models. One of these models, called the likely dominance (LD) model, consists in declaring that an act is preferred to another as soon as the set of states on which the first act gives a better outcome than the second act is judged more likely than the set of states on which the second act is preferable. The LD model is at much variance with the SEU model. Indeed, it has a definite ordinal flavor and it may lead to preference relations between acts that are not transitive. This paper proposes a general model for decision making under uncertainty tolerating intransitive and/or incomplete preferences that will contain both the SEU and the LD models as particular cases. Within the framework of this general model, we propose a characterization of the preference relations that can be obtained with the LD model. This characterization shows that the main distinctive feature of such relations lies in the very poor relation comparing preference differences that they induce on the set of outcomes.

[1]  Didier Dubois,et al.  Qualitative decision theory with preference relations and comparative uncertainty: An axiomatic approach , 2003, Artif. Intell..

[2]  P. Wakker Additive Representations of Preferences: A New Foundation of Decision Analysis , 1988 .

[3]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[4]  Ronen I. Brafman,et al.  An axiomatic treatment of three qualitative decision criteria , 2000, JACM.

[5]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[6]  Didier Dubois,et al.  A characterization of generalized concordance rules in multicriteria decision making , 2003, Int. J. Intell. Syst..

[7]  Didier Dubois,et al.  Decision-theoretic foundations of qualitative possibility theory , 2001, Eur. J. Oper. Res..

[8]  P. Blavatskyy,et al.  Content-dependent Preferences in Choice under Risk: Heuristic of Relative Probability Comparisons , 2003 .

[9]  Jaap Van Brakel,et al.  Foundations of measurement , 1983 .

[10]  P. Fishburn Nontransitive preferences in decision theory , 1991 .

[11]  D. Dubois,et al.  Decision-making under ordinal preferences and uncertainty , 1997 .

[12]  D. Ellsberg Decision, probability, and utility: Risk, ambiguity, and the Savage axioms , 1961 .

[13]  I. Erev,et al.  Small feedback‐based decisions and their limited correspondence to description‐based decisions , 2003 .

[14]  Peter C. Fishburn,et al.  A Survey of Multiattribute/Multicriterion Evaluation Theories , 1978 .

[15]  Donald G. Saari,et al.  Connecting and resolving Sen's and Arrow's theorems , 1998 .

[16]  P. Wakker Separating marginal utility and probabilistic risk aversion , 1994 .

[17]  A. Sen,et al.  Social Choice Theory , 1980 .

[18]  R. Sugden Alternatives to Expected Utility: Foundations , 2004 .

[19]  Denis Bouyssou,et al.  A note on Wakker's Cardinal Coordinate Independence , 2004, Math. Soc. Sci..

[20]  Patrice Perny,et al.  Qualitative decision models under uncertainty without the commensurability hypothesis , 1999, UAI 1999.

[21]  Denis Bouyssou,et al.  ‘Additive difference’ models without additivity and subtractivity , 2004 .

[22]  Peter P. Wakker,et al.  DERIVED STRENGTHS OF PREFERENCE RELATIONS ON COORDINATES , 1988 .

[23]  Peter C. Fishburn,et al.  Nonlinear preference and utility theory , 1988 .

[24]  David Schmeidleis SUBJECTIVE PROBABILITY AND EXPECTED UTILITY WITHOUT ADDITIVITY , 1989 .

[25]  A. Tversky,et al.  Prospect Theory : An Analysis of Decision under Risk Author ( s ) : , 2007 .

[26]  Peter C. Fishburn,et al.  Additive differences and simple preference comparisons , 1992 .

[27]  M. Allais Le comportement de l'homme rationnel devant le risque : critique des postulats et axiomes de l'ecole americaine , 1953 .

[28]  Hung T. Nguyen,et al.  Fundamentals of Uncertainty Calculi with Applications to Fuzzy Inference , 1994 .

[29]  J. Milnor Games Against Nature , 1951 .

[30]  R. Sugden,et al.  Some implications of a more general form of regret theory , 1987 .

[31]  Joseph Y. Halpern,et al.  Great expectations: part I: on the customizability of generalized expected utility , 2003, IJCAI 2003.

[32]  Patrice Perny,et al.  Qualitative Models for Decision Under Uncertainty without the Commensurability Assumption , 1999, UAI.

[33]  Pavlo R. Blavatskyy,et al.  Axiomatization of a Preference for Most Probable Winner , 2005 .

[34]  Richard P. Savage The Paradox of Nontransitive Dice , 1994 .

[35]  P. Fishburn Nontransitive measurable utility , 1982 .

[36]  A. Tversky,et al.  Foundations of Measurement, Vol. I: Additive and Polynomial Representations , 1991 .

[37]  R. Luce Utility of Gains and Losses: Measurement-Theoretical and Experimental Approaches , 2000 .

[38]  Daniel Lehmann,et al.  Generalized Qualitative Probability: Savage revisited , 1996, UAI.

[39]  Peter P. Wakker,et al.  Cardinal coordinate independence for expected utility , 1984 .

[40]  Denis Bouyssou,et al.  A characterization of concordance relations , 2005, Eur. J. Oper. Res..

[41]  Lola L. Lopes Decision Making in the Short Run. , 1981 .

[42]  Yutaka Nakamura Skew-symmetric additive representations of preferences , 1998 .

[43]  Jon Doyle,et al.  Background to Qualitative Decision Theory , 1999, AI Mag..

[44]  Donald E. Campbell,et al.  Impossibility theorems in the arrovian framework , 2002 .

[45]  Judea Pearl,et al.  Qualitative Decision Theory , 1994, AAAI.

[46]  Peter C. Fishburn,et al.  Utility theory for decision making , 1970 .

[47]  Ulrich Schmidt,et al.  Alternatives to Expected Utility: Formal Theories , 2004 .

[48]  Ronen I. Brafman,et al.  Modeling Agents as Qualitative Decision Makers , 1997, Artif. Intell..

[49]  C. Starmer Developments in Non-expected Utility Theory: The Hunt for a Descriptive Theory of Choice under Risk , 2000 .

[50]  Peter P. Wakker,et al.  Additive Representations of Preferences , 1989 .

[51]  I. Gilboa Expected utility with purely subjective non-additive probabilities , 1987 .

[52]  Peter C. Fishburn,et al.  Context-Dependent Choice with Nonlinear and Nontransitive Preferences , 1988 .

[53]  D. Bouyssou,et al.  Nontransitive decomposable conjoint measurement , 2002 .

[54]  Kotaro Suzumura,et al.  Introduction, Handbook of Social Choice and Welfare, Edited by Kenneth Arrow, Amartya Sen and Kotaro Suzumura, Amsterdam: Elsevier/North-Holland , 2001 .

[55]  Peter C. Fishburn,et al.  Non-transitive measurable utility for decision under uncertainty , 1989 .

[56]  Jean-Claude Vansnick On the problem of weights in multiple criteria decision making (the noncompensatory approach) , 1986 .

[57]  C. Blyth Some Probability Paradoxes in Choice from among Random Alternatives , 1972 .

[58]  Edi Karni,et al.  Choquet Expected Utility with a Finite State Space: Commutativity and Act-Independence , 1994 .

[59]  Peter C. Fishburn,et al.  Noncompensatory preferences , 2004, Synthese.

[60]  A. Tversky,et al.  Prospect theory: an analysis of decision under risk — Source link , 2007 .

[61]  Howard Raiffa,et al.  Games And Decisions , 1958 .

[62]  Peter C. Fishburn,et al.  A Nonlinear, Nontransitive and Additive-Probability Model for Decisions Under Uncertainty , 1987 .

[63]  A. Tversky Intransitivity of preferences. , 1969 .

[64]  A. Tversky,et al.  Prospect theory: analysis of decision under risk , 1979 .

[65]  Craig Boutilier,et al.  Toward a Logic for Qualitative Decision Theory , 1994, KR.

[66]  P. Fishburn Axioms for Lexicographic Preferences , 1975 .

[67]  Denis Bouyssou,et al.  Noncompensatory and generalized noncompensatory preference structures , 1986 .

[68]  Didier Dubois,et al.  Qualitative decision theory: from savage's axioms to nonmonotonic reasoning , 2002, JACM.

[69]  D. Bouyssou On some properties of outranking relations based on a concordance-discordance principle , 2007 .

[70]  P. Hammond,et al.  Handbook of Utility Theory , 2004 .

[71]  Peter C. Fishburn,et al.  Decision Analysis Under States-Additive SSB Preferences , 1987, Oper. Res..

[72]  P. Fishburn,et al.  State-dependent SSB utility , 1987 .

[73]  Yutaka Nakamura Subjective expected utility with non-additive probabilities on finite state spaces , 1990 .

[74]  P. Fishburn The Axioms of Subjective Probability , 1986 .

[75]  P. Fishburn Binary choice probabilities: on the varieties of stochastic transitivity , 1973 .

[76]  Robert Sugden,et al.  An Axiomatic Foundation for Regret Theory , 1993 .

[77]  Ronen I. Brafman,et al.  On the Axiomatization of Qualitative Decision Criteria , 1997, AAAI/IAAI.

[78]  Denis Bouyssou,et al.  Some remarks on the notion of compensation in MCDM , 1986 .

[79]  P. Blavatsky Note on 'Small Feedback-Based Decisions and their Limited Correspondence to Description-Based Decisions' , 2003 .

[80]  Peter C. Fishburn,et al.  SSB utility theory and decision-making under uncertainty , 1984 .

[81]  P. Vincke,et al.  Biorder families, valued relations and preference modelling , 1986 .

[82]  Patrice Perny,et al.  Modélisation des préférences par une règle de concordance généralisée , 2001 .

[83]  Peter C. Fishburn,et al.  Skew symmetric additive utility with finite states , 1990 .

[84]  A. Tversky,et al.  An axiomatization of cumulative prospect theory , 1993 .

[85]  Peter P. Wakker,et al.  The sure-thing principle and the comonotonic sure-thing principle: An axiomatic analysis☆ , 1996 .

[86]  Edi Karni,et al.  Utility theory with uncertainty , 1991 .