Constraint-based optimization and utility elicitation using the minimax decision criterion

In many situations, a set of hard constraints encodes the feasible configurations of some system or product over which multiple users have distinct preferences. However, making suitable decisions requires that the preferences of a specific user for different configurations be articulated or elicited, something generally acknowledged to be onerous. We address two problems associated with preference elicitation: computing a best feasible solution when the user's utilities are imprecisely specified; and developing useful elicitation procedures that reduce utility uncertainty, with minimal user interaction, to a point where (approximately) optimal decisions can be made. Our main contributions are threefold. First, we propose the use of minimax regret as a suitable decision criterion for decision making in the presence of such utility function uncertainty. Second, we devise several different procedures, all relying on mixed integer linear programs, that can be used to compute minimax regret and regret-optimizing solutions effectively. In particular, our methods exploit generalized additive structure in a user's utility function to ensure tractable computation. Third, we propose various elicitation methods that can be used to refine utility uncertainty in such a way as to quickly (i.e., with as few questions as possible) reduce minimax regret. Empirical study suggests that several of these methods are quite successful in minimizing the number of user queries, while remaining computationally practical so as to admit real-time user interaction.

[1]  Ceusters Werner,et al.  Proceedings of the Ninth International Conference on the Principles of Knowledge Representation and Reasoning (KR2004), Whistler, BC, 2-5 June 2004 , 2004 .

[2]  Rina Dechter,et al.  Constraint Processing , 1995, Lecture Notes in Computer Science.

[3]  Craig Boutilier,et al.  Local Utility Elicitation in GAI Models , 2005, UAI.

[4]  Dale Schuurmans,et al.  Direct value-approximation for factored MDPs , 2001, NIPS.

[5]  Fahiem Bacchus,et al.  Graphical models for preference and utility , 1995, UAI.

[6]  A Gerodimos,et al.  Robust Discrete Optimization and its Applications , 1996, J. Oper. Res. Soc..

[7]  Murray Campbell,et al.  Evaluating multiple attribute items using queries , 2001, EC '01.

[8]  Hillary A. Holloway,et al.  Decision Aiding Question selection for multi-attribute decision-aiding , 2003 .

[9]  J. Neumann,et al.  Theory of Games and Economic Behavior. , 1945 .

[10]  Bradley N. Miller,et al.  GroupLens: applying collaborative filtering to Usenet news , 1997, CACM.

[11]  George Apostolakis,et al.  Decision theory , 1986 .

[12]  Thomas Schiex,et al.  Valued Constraint Satisfaction Problems: Hard and Easy Problems , 1995, IJCAI.

[13]  Craig Boutilier,et al.  On the Foundations of Expected Expected Utility , 2003, IJCAI.

[14]  David E. Bell,et al.  Regret in Decision Making under Uncertainty , 1982, Oper. Res..

[15]  Daniel Sabin,et al.  Product Configuration Frameworks - A Survey , 1998, IEEE Intell. Syst..

[16]  Arkadi Nemirovski,et al.  Robust solutions of uncertain linear programs , 1999, Oper. Res. Lett..

[17]  Ariel D. Procaccia,et al.  Strategyproof Classification with Shared Inputs , 2009, IJCAI.

[18]  Martin Weber Decision Making with Incomplete Information , 1987 .

[19]  Jim Blythe,et al.  Visual exploration and incremental utility elicitation , 2002, AAAI/IAAI.

[20]  Igor Averbakh,et al.  On the complexity of minmax regret linear programming , 2005, Eur. J. Oper. Res..

[21]  Craig Boutilier,et al.  Eliciting Bid Taker Non-price Preferences in (Combinatorial) Auctions , 2004, AAAI.

[22]  Boi Faltings,et al.  User-Involved Preference Elicitation , 2003 .

[23]  Andrew P. Sage,et al.  A model of multiattribute decisionmaking and trade-off weight determination under uncertainty , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[24]  Eric Horvitz,et al.  The Lumière Project: Bayesian User Modeling for Inferring the Goals and Needs of Software Users , 1998, UAI.

[25]  John R. Hauser,et al.  Polyhedral Methods for Adaptive Choice-Based Conjoint Analysis , 2004 .

[26]  Chelsea C. White,et al.  Question selection for multi-attribute decision-aiding , 2003, Eur. J. Oper. Res..

[27]  Patrice Perny,et al.  GAI Networks for Utility Elicitation , 2004, KR.

[28]  Igor Averbakh Minmax regret solutions for minimax optimization problems with uncertainty , 2000, Oper. Res. Lett..

[29]  Carlos Guestrin,et al.  Max-norm Projections for Factored MDPs , 2001, IJCAI.

[30]  Umberto Bertelè,et al.  Nonserial Dynamic Programming , 1972 .

[31]  Alessandro Sperduti,et al.  Learning and Solving Soft Temporal Constraints: An Experimental Study , 2002, CP.

[32]  R. M. Adelson,et al.  Utility Theory for Decision Making , 1971 .

[33]  Leonard J. Savage,et al.  The Theory of Statistical Decision , 1951 .

[34]  Rina Dechter,et al.  Bucket elimination: A unifying framework for probabilistic inference , 1996, UAI.

[35]  Raimo P. Hämäläinen,et al.  Preference ratios in multiattribute evaluation (PRIME)-elicitation and decision procedures under incomplete information , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[36]  R. Sugden,et al.  Regret Theory: An alternative theory of rational choice under uncertainty Review of Economic Studies , 1982 .

[37]  Jacques F. Benders,et al.  Partitioning procedures for solving mixed-variables programming problems , 2005, Comput. Manag. Sci..

[38]  V. Chandru,et al.  Optimization Methods for Logical Inference , 1999 .

[39]  Francesca Rossi,et al.  Semiring-based constraint satisfaction and optimization , 1997, JACM.

[40]  J. Dyer Interactive Goal Programming , 1972 .

[41]  Craig Boutilier,et al.  A POMDP formulation of preference elicitation problems , 2002, AAAI/IAAI.

[42]  Boi Faltings,et al.  Decision Tradeoff Using Example-Critiquing and Constraint Programming , 2004, Constraints.

[43]  Yuval Shahar,et al.  Utility Elicitation as a Classification Problem , 1998, UAI.

[44]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[45]  Peter C. Fishburn,et al.  INTERDEPENDENCE AND ADDITIVITY IN MULTIVARIATE, UNIDIMENSIONAL EXPECTED UTILITY TIHEORY* , 1967 .

[46]  Bradley N. Miller,et al.  Applying Collaborative Filtering to Usenet News , 1997 .

[47]  John Quiggin,et al.  Stochastic Dominance in Regret Theory , 1990 .

[48]  John Wroclawski,et al.  Learning user preferences for wireless services provisioning , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[49]  A. M. Mármol,et al.  The use of partial information on weights in multicriteria decision problems , 1998 .

[50]  S. Thomas McCormick,et al.  Integer Programming and Combinatorial Optimization , 1996, Lecture Notes in Computer Science.

[51]  Craig Boutilier,et al.  Cooperative Negotiation in Autonomic Systems using Incremental Utility Elicitation , 2002, UAI.

[52]  Daphne Koller,et al.  Making Rational Decisions Using Adaptive Utility Elicitation , 2000, AAAI/IAAI.

[53]  E. Rowland Theory of Games and Economic Behavior , 1946, Nature.

[54]  Ronen I. Brafman,et al.  UCP-Networks: A Directed Graphical Representation of Conditional Utilities , 2001, UAI.