Learning to Anticipate Flexible Choices in Multiple Criteria Decision-Making Under Uncertainty

In several applications, a solution must be selected from a set of tradeoff alternatives for operating in dynamic and noisy environments. In this paper, such multicriteria decision process is handled by anticipating flexible options predicted to improve the decision maker future freedom of action. A methodology is then proposed for predicting tradeoff sets of maximal hypervolume, where a multiobjective metaheuristic was augmented with a Kalman filter and a dynamical Dirichlet model for tracking and predicting flexible solutions. The method identified decisions that were shown to improve the future hypervolume of tradeoff investment portfolio sets for out-of-sample stock data, when compared to a myopic strategy. Anticipating flexible portfolios was a superior strategy for smoother changing artificial and real-world scenarios, when compared to always implementing the decision of median risk and to randomly selecting a portfolio from the evolved anticipatory stochastic Pareto frontier, whereas the median choice strategy performed better for abruptly changing markets. Correlations between the portfolio compositions and future hypervolume were also observed.

[1]  N. S. Iyer,et al.  A family of dominance rules for multiattribute decision making under uncertainty , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[2]  Walter J. Gutjahr,et al.  Stochastic multi-objective optimization: a survey on non-scalarizing methods , 2016, Ann. Oper. Res..

[3]  Roberto Battiti,et al.  Brain-Computer Evolutionary Multiobjective Optimization: A Genetic Algorithm Adapting to the Decision Maker , 2010, IEEE Trans. Evol. Comput..

[4]  Saifallah Benjaafar,et al.  The strategic value of flexibility in sequential decision making , 1995 .

[5]  David Wallace,et al.  Dynamic multi-objective optimization with evolutionary algorithms: a forward-looking approach , 2006, GECCO.

[6]  John A. Buzacott,et al.  Flexibility and decision making , 1990 .

[7]  Nicola Beume,et al.  On the Complexity of Computing the Hypervolume Indicator , 2009, IEEE Transactions on Evolutionary Computation.

[9]  Tjalling C. Koopmans,et al.  On Flexibility of Future Preference , 1962 .

[10]  Vinod Kumar,et al.  Entropic measures of manufacturing flexibility , 1987 .

[11]  Nicola Beume,et al.  SMS-EMOA: Multiobjective selection based on dominated hypervolume , 2007, Eur. J. Oper. Res..

[12]  G. Tian,et al.  Dirichlet and Related Distributions: Theory, Methods and Applications , 2011 .

[13]  Michèle Sebag,et al.  Hypervolume indicator and dominance reward based multi-objective Monte-Carlo Tree Search , 2013, Machine Learning.

[14]  Anabela Simões,et al.  Prediction in evolutionary algorithms for dynamic environments , 2014, Soft Comput..

[15]  C. Puppe An Axiomatic Approach to “Preference for Freedom of Choice” , 1996 .

[16]  Frank J. Fabozzi,et al.  60 Years of portfolio optimization: Practical challenges and current trends , 2014, Eur. J. Oper. Res..

[17]  R. Holmes On random correlation matrices , 1991 .

[18]  Peter J. Fleming,et al.  Active Robust Optimization: Enhancing Robustness to Uncertain Environments , 2014, IEEE Transactions on Cybernetics.

[19]  A D Wissner-Gross,et al.  Causal entropic forces. , 2013, Physical review letters.

[20]  Eckart Zitzler,et al.  Indicator-Based Selection in Multiobjective Search , 2004, PPSN.

[21]  Rolf Klötzler,et al.  Multiobjective dynamic programming , 1978 .

[22]  Anne Auger,et al.  Theory of the hypervolume indicator: optimal μ-distributions and the choice of the reference point , 2009, FOGA '09.

[23]  Jonathan P. How,et al.  Estimation of non-stationary Markov Chain transition models , 2008, 2008 47th IEEE Conference on Decision and Control.

[24]  Jonas Schmitt Portfolio Selection Efficient Diversification Of Investments , 2016 .

[25]  Lothar Thiele,et al.  Quality Assessment of Pareto Set Approximations , 2008, Multiobjective Optimization.

[26]  Shimon Whiteson,et al.  A Survey of Multi-Objective Sequential Decision-Making , 2013, J. Artif. Intell. Res..

[27]  Claudio Rossi,et al.  Tracking Moving Optima Using Kalman-Based Predictions , 2008, Evolutionary Computation.

[28]  Aluizio F. R. Araújo,et al.  Correlation between diversity and hypervolume in evolutionary multiobjective optimization , 2011, 2011 IEEE Congress of Evolutionary Computation (CEC).

[29]  Qingfu Zhang,et al.  A Population Prediction Strategy for Evolutionary Dynamic Multiobjective Optimization , 2014, IEEE Transactions on Cybernetics.

[30]  Peter A. N. Bosman,et al.  Learning and anticipation in online dynamic optimization with evolutionary algorithms: the stochastic case , 2007, GECCO '07.

[31]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..