Preference Modeling and Preference Elicitation: An Overview

Handling preferences [16] is important in a number of domains, including recommender systems, computational advertisement, personal cognitive assistants, systems for decision support (for example, in medicine) and robotics. Artificial intelligence has been dealing with preferences for quite some time. In order to get closer to the goal of realizing autonomous agents that can decide and act on behalf of humans, formal tools are needed in order to model preferences, represent preferences in a compact way, support reasoning, and elicit (or learn) them from the user (decision maker). Research on preference handling systems makes use of quite a variety of different tools, including formal logic, optimization techniques from operations research; there is also a substantial intersection with research in mathematical economics, especially in approaches based on utility. An additional challenge is brought by the realization that (differently from what assumed in classical economics) humans are not rational decision makers, and are prone to decision biases; this recognition is important especially if the aim is to produce systems that are meant to be used by real users. A thorough introduction to the topic of preferences in artificial intelligence, going much more in depth, can be found in [17].

[1]  Craig Boutilier,et al.  Local Utility Elicitation in GAI Models , 2005, UAI.

[2]  G. Wright.  The logic of preference reconsidered , 1972 .

[3]  Craig Boutilier,et al.  Optimal Bayesian Recommendation Sets and Myopically Optimal Choice Query Sets , 2010, NIPS.

[4]  Patrice Perny,et al.  Incremental Elicitation of Choquet Capacities for Multicriteria Decision Making , 2014, ECAI.

[5]  Paolo Viappiani,et al.  Preferences in Interactive Systems: Technical Challenges and Case Studies , 2008, AI Mag..

[6]  Michel Grabisch,et al.  A decade of application of the Choquet and Sugeno integrals in multi-criteria decision aid , 2010, Ann. Oper. Res..

[7]  Fahiem Bacchus,et al.  Graphical models for preference and utility , 1995, UAI.

[8]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[9]  Souhila Kaci,et al.  Working with Preferences: Less Is More , 2011, Cognitive Technologies.

[10]  Eyke Hüllermeier,et al.  Learning Monotone Nonlinear Models Using the Choquet Integral , 2011, ECML/PKDD.

[11]  Craig Boutilier,et al.  A POMDP formulation of preference elicitation problems , 2002, AAAI/IAAI.

[12]  Gabriella Pigozzi,et al.  Preferences in artificial intelligence , 2016, Annals of Mathematics and Artificial Intelligence.

[13]  Patrice Perny,et al.  GAI Networks for Utility Elicitation , 2004, KR.

[14]  Francesco Ricci,et al.  Active learning strategies for rating elicitation in collaborative filtering , 2013, ACM Trans. Intell. Syst. Technol..

[15]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decision-making , 1988 .

[16]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[17]  Craig Boutilier,et al.  Constraint-based optimization and utility elicitation using the minimax decision criterion , 2006, Artif. Intell..

[18]  Paolo Viappiani,et al.  Robust Optimization of Recommendation Sets with the Maximin Utility Criterion , 2013, ADT.

[19]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decisionmaking , 1988, IEEE Trans. Syst. Man Cybern..

[20]  Ronen I. Brafman,et al.  Reasoning With Conditional Ceteris Paribus Preference Statements , 1999, UAI.

[21]  Daphne Koller,et al.  Making Rational Decisions Using Adaptive Utility Elicitation , 2000, AAAI/IAAI.

[22]  Ronen I. Brafman,et al.  Extended Semantics and Optimization Algorithms for CP‐Networks , 2004, Comput. Intell..

[23]  Craig Boutilier,et al.  Minimax regret based elicitation of generalized additive utilities , 2007, UAI.

[24]  Scott Sanner,et al.  Real-time Multiattribute Bayesian Preference Elicitation with Pairwise Comparison Queries , 2010, AISTATS.

[25]  Craig Boutilier,et al.  Regret-based optimal recommendation sets in conversational recommender systems , 2009, RecSys '09.