Constructive Preference Elicitation for Multiple Users with Setwise Max-margin

In this paper we consider the problem of simultaneously eliciting the preferences of a group of users in an interactive way. We focus on constructive recommendation tasks, where the instance to be recommended should be synthesized by searching in a constrained configuration space rather than choosing among a set of pre-determined options. We adopt a setwise max-margin optimization method, that can be viewed as a generalization of max-margin learning to sets, supporting the identification of informative questions and encouraging sparsity in the parameter space. We extend setwise max-margin to multiple users and we provide strategies for choosing the user to be queried next and identifying an informative query to ask. At each stage of the interaction, each user is associated with a set of parameter weights (a sort of alternative options for the unknown user utility) that can be used to identify “similar” users and to propagate preference information between them. We present simulation results evaluating the effectiveness of our procedure, showing that our approach compares favorably with respect to straightforward adaptations in a multi-user setting of elicitation methods conceived for single users.

[1]  Avishek Saha,et al.  Online Learning of Multiple Tasks and Their Relationships , 2011, AISTATS.

[2]  Patrice Perny,et al.  Incremental Preference Elicitation in Multi-attribute Domains for Choice and Ranking with the Borda Count , 2016, SUM.

[3]  R. Plackett The Analysis of Permutations , 1975 .

[4]  Alexander J. Smola,et al.  Learning with Kernels: support vector machines, regularization, optimization, and beyond , 2001, Adaptive computation and machine learning series.

[5]  Vincent Conitzer,et al.  Determining Possible and Necessary Winners under Common Voting Rules Given Partial Orders , 2008, AAAI.

[6]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[7]  Craig Boutilier,et al.  Robust Approximation and Incremental Elicitation in Voting Protocols , 2011, IJCAI.

[8]  Craig Boutilier,et al.  Constraint-based optimization and utility elicitation using the minimax decision criterion , 2006, Artif. Intell..

[9]  R. L. Keeney,et al.  Decisions with Multiple Objectives: Preferences and Value Trade-Offs , 1977, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Scott Sanner,et al.  Gaussian Process Preference Elicitation , 2010, NIPS.

[11]  Gabriella Pigozzi,et al.  Preferences in artificial intelligence , 2016, Annals of Mathematics and Artificial Intelligence.

[12]  Craig Boutilier,et al.  A POMDP formulation of preference elicitation problems , 2002, AAAI/IAAI.

[13]  Scott Sanner,et al.  Real-time Multiattribute Bayesian Preference Elicitation with Pairwise Comparison Queries , 2010, AISTATS.

[14]  Craig Boutilier,et al.  Regret-based optimal recommendation sets in conversational recommender systems , 2009, RecSys '09.

[15]  R. A. Bradley,et al.  Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons , 1952 .

[16]  J. Lafferty,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[17]  Krzysztof Z. Gajos,et al.  Preference elicitation for interface optimization , 2005, UIST.

[18]  Craig Boutilier,et al.  Optimal Bayesian Recommendation Sets and Myopically Optimal Choice Query Sets , 2010, NIPS.

[19]  Brice Mayag,et al.  Identification of a 2-Additive Bi-Capacity by Using Mathematical Programming , 2013, ADT.

[20]  Daphne Koller,et al.  Making Rational Decisions Using Adaptive Utility Elicitation , 2000, AAAI/IAAI.

[21]  Greg Hines,et al.  Efficiently Eliciting Preferences from a Group of Users , 2011, Interactive Decision Theory and Game Theory.

[22]  R. Luce,et al.  Individual Choice Behavior: A Theoretical Analysis. , 1960 .

[23]  Massimiliano Pontil,et al.  Multi-Task Feature Learning , 2006, NIPS.

[24]  Francesco Ricci,et al.  Active learning strategies for rating elicitation in collaborative filtering , 2013, ACM Trans. Intell. Syst. Technol..

[25]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[26]  Andrea Passerini,et al.  Constructive Preference Elicitation by Setwise Max-Margin Learning , 2016, IJCAI.

[27]  Meir Kalech,et al.  Reaching a joint decision with minimal elicitation of voter preferences , 2014, Inf. Sci..