An Interactive Polyhedral Approach for Multi-objective Combinatorial Optimization with Incomplete Preference Information

In this paper, we develop a general interactive polyhedral approach to solve multi-objective combinatorial optimization problems with incomplete preference information. Assuming that preferences can be represented by a parameterized scalarizing function, we iteratively ask preferences queries to the decision maker in order to reduce the imprecision over the preference parameters until being able to determine her preferred solution. To produce informative preference queries at each step, we generate promising solutions using the extreme points of the polyhedron representing the admissible preference parameters and then we ask the decision maker to compare two of these solutions (we propose different selection strategies). These extreme points are also used to provide a stopping criterion guaranteeing that the returned solution is optimal (or near-optimal) according to the decision maker’s preferences. We provide numerical results for the multi-objective spanning tree and traveling salesman problems with preferences represented by a weighted sum to demonstrate the practical efficiency of our approach. We compare our results to a recent approach based on minimax regret, where preference queries are generated during the construction of an optimal solution. We show that better results are achieved by our method both in terms of running time and number of questions.

[1]  J. Kruskal On the shortest spanning subtree of a graph and the traveling salesman problem , 1956 .

[2]  Craig Boutilier,et al.  Incremental utility elicitation with minimax regret decision criterion , 2003, IJCAI 2003.

[3]  Daniel Vanderpooten,et al.  Weighted sum model with partial preference information: Application to multi-objective optimization , 2017, Eur. J. Oper. Res..

[4]  M. Wiecek Advances in Cone-Based Preference Modeling for Decision Making with Multiple Criteria , 2007 .

[5]  Horst W. Hamacher,et al.  On spanning tree problems with multiple objectives , 1994, Ann. Oper. Res..

[6]  Craig Boutilier,et al.  Eliciting Additive Reward Functions for Markov Decision Processes , 2011, IJCAI.

[7]  Nic Wilson,et al.  Multi-Objective Constraint Optimization with Tradeoffs , 2013, CP.

[8]  Thibaut Lust,et al.  Choquet optimal set in biobjective combinatorial optimization , 2013, Comput. Oper. Res..

[9]  Marco Laumanns,et al.  Combining Convergence and Diversity in Evolutionary Multiobjective Optimization , 2002, Evolutionary Computation.

[10]  Michel Grabisch,et al.  A decade of application of the Choquet and Sugeno integrals in multi-criteria decision aid , 2010, Ann. Oper. Res..

[11]  Paolo Viappiani,et al.  Incremental elicitation of Choquet capacities for multicriteria choice, ranking and sorting problems , 2017, Artif. Intell..

[12]  Nic Wilson,et al.  Multi-Objective Influence Diagrams with Possibly Optimal Policies , 2017, AAAI.

[13]  Patrice Perny,et al.  Solving Multi-Agent Knapsack Problems Using Incremental Approval Voting , 2016, ECAI.

[14]  Patrice Perny,et al.  Active Preference Learning Based on Generalized Gini Functions: Application to the Multiagent Knapsack Problem , 2019, AAAI.

[15]  Nic Wilson,et al.  Computing Possibly Optimal Solutions for Multi-Objective Constraint Optimisation with Tradeoffs , 2015, IJCAI.

[16]  Craig Boutilier,et al.  Constraint-based optimization and utility elicitation using the minimax decision criterion , 2006, Artif. Intell..

[17]  Patrice Perny,et al.  On Possibly Optimal Tradeoffs in Multicriteria Spanning Tree Problems , 2015, ADT.

[18]  Olivier Spanjaard,et al.  Reducing the Number of Queries in Interactive Value Iteration , 2015, ADT.

[19]  R. Prim Shortest connection networks and some generalizations , 1957 .

[20]  Andrew P. Sage,et al.  A model of multiattribute decisionmaking and trade-off weight determination under uncertainty , 1984, IEEE Transactions on Systems, Man, and Cybernetics.

[21]  R. Y. Rubinstein Generating random vectors uniformly distributed inside and on the surface of different regions , 1982 .

[22]  Murat Köksalan,et al.  Generating a Representative Subset of the Nondominated Frontier in Multiple Criteria Decision Making , 2009, Oper. Res..

[23]  Craig Boutilier,et al.  Preference Elicitation and Interview Minimization in Stable Matchings , 2014, AAAI.

[24]  Martin E. Dyer,et al.  An algorithm for determining all extreme points of a convex polytope , 1977, Math. Program..

[25]  Patrice Perny,et al.  Interactive resolution of multiobjective combinatorial optimization problems by incremental elicitation of criteria weights , 2018 .

[26]  G. Choquet Theory of capacities , 1954 .

[27]  Alexander Schrijver,et al.  Combinatorial optimization. Polyhedra and efficiency. , 2003 .

[28]  Patrice Perny,et al.  Incremental Preference Elicitation in Multi-attribute Domains for Choice and Ranking with the Borda Count , 2016, SUM.

[29]  Bruno Zanuttini,et al.  Interactive Value Iteration for Markov Decision Processes with Unknown Rewards , 2013, IJCAI.