A Biobjective Optimization Model for Expert Opinions Aggregation and Its Application in Group Decision Making

Expert opinions aggregation is a generic part of the group decision making (GDM) problem. The challenge of expert opinions aggregation is to reduce the subjectivity in the process as much as possible and improve the reliability of the aggregated opinion. Most of the existing literature try to eliminate the subjectivity but seldom consider the reliability of the aggregation result. In this article, we propose a new criterion that contains consensus level and confidence level to improve both objectivity (i.e., consensus) and reliability (i.e., no absurd result) with the experts’ opinions being represented as probability density functions. Subsequently, the expert opinion aggregation problem is formulated as a biobjective optimization model. The Survey of Professional Forecasters is used as an example to examine the feasibility and accuracy of the proposed approach and the result shows that the new approach can provide a better estimation than that of the single objective model in the literature. To our best knowledge, the proposed criterion is new in the literature of GDM along with relevant problems. The proposed criterion is actually a pilot work to probe the problem of the quality of a GDM process, which is largely ignored in the field of GDM.

[1]  Kaplan,et al.  ‘Combining Probability Distributions from Experts in Risk Analysis’ , 2000, Risk analysis : an official publication of the Society for Risk Analysis.

[2]  Fabio Busetti,et al.  Quantile Aggregation of Density Forecasts , 2014 .

[3]  Tingli Su,et al.  Compound Autoregressive Network for Prediction of Multivariate Time Series , 2019, Complex..

[4]  Wenjun Zhang,et al.  A Method to Measure The Resilience of Algorithm for Operation Management , 2016 .

[5]  Fan-Yong Meng,et al.  An Approach for Group Decision Making With Interval Fuzzy Preference Relations Based on Additive Consistency and Consensus Analysis , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[6]  A. Raftery,et al.  Probabilistic forecasts, calibration and sharpness , 2007 .

[7]  Jinliang Ding,et al.  Toward a Resilient Holistic Supply Chain Network System: Concept, Review and Future Direction , 2016, IEEE Systems Journal.

[8]  Runliang Dou,et al.  Management of a holistic supply chain network for proactive resilience: Theory and case study , 2017, Comput. Ind. Eng..

[9]  Wenjun Chris Zhang,et al.  On the principle of design of resilient systems – application to enterprise information systems , 2010, Enterp. Inf. Syst..

[10]  Marianne Alleyne,et al.  Bee-Inspired Evaluation Algorithm Leads to Improved Decision Making in Groups , 2020, IEEE Systems Journal.

[11]  C. A. van Luttervelt,et al.  Toward a resilient manufacturing system , 2011 .

[12]  N. Dalkey,et al.  An Experimental Application of the Delphi Method to the Use of Experts , 1963 .

[13]  Tingli Su,et al.  Deep Hybrid Model Based on EMD with Classification by Frequency Characteristics for Long-Term Air Quality Prediction , 2020, Mathematics.

[14]  Robert LIN,et al.  NOTE ON FUZZY SETS , 2014 .

[15]  Yuting Bai,et al.  Group Decision-Making Support for Sustainable Governance of Algal Bloom in Urban Lakes , 2020, Sustainability.

[16]  Yael Grushka-Cockayne,et al.  Is it Better to Average Probabilities or Quantiles? , 2012, Manag. Sci..

[17]  Wenjun Chris Zhang,et al.  A novel approach to probability distribution aggregation , 2012, Inf. Sci..

[18]  Robert L. Winkler,et al.  The Consensus of Subjective Probability Distributions , 1968 .

[19]  Changjun Liu,et al.  On a Simple and Efficient Approach to Probability Distribution Function Aggregation , 2017, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Ling Li,et al.  Determination of Weights for Multiobjective Decision Making or Machine Learning , 2014, IEEE Systems Journal.

[21]  Brian H. Ross,et al.  On appropriate procedures for combining probability distributions within the same family , 1980 .

[22]  Ting-Li Su,et al.  A Novel Group Decision-Making Method Based on Sensor Data and Fuzzy Information , 2016, Sensors.

[23]  David W. Coit,et al.  Multi-objective optimization using genetic algorithms: A tutorial , 2006, Reliab. Eng. Syst. Saf..

[24]  Bingzhen Sun,et al.  An approach to consensus measurement of linguistic preference relations in multi-attribute group decision making and application , 2015 .

[25]  T. Gneiting,et al.  Combining Predictive Distributions , 2011, 1106.1638.

[26]  Ronald R. Yager,et al.  On ordered weighted averaging aggregation operators in multicriteria decision-making , 1988 .

[27]  Hu Xu,et al.  Uncertain multi-attributes decision making method based on interval number with probability distribution weighted operators and stochastic dominance degree , 2016, Knowl. Based Syst..

[28]  R. Lipshitz,et al.  Coping with Uncertainty: A Naturalistic Decision-Making Analysis , 1997 .

[29]  V. Huynh,et al.  On qualitative multi-attribute group decision making and its consensus measure: A probability based perspective , 2017 .

[30]  Xiao-yi Wang,et al.  Dynamic Correlation Analysis Method of Air Pollutants in Spatio-Temporal Analysis , 2020, International journal of environmental research and public health.

[31]  Baihai Zhang,et al.  A Neuron-Based Kalman Filter with Nonlinear Autoregressive Model , 2020, Sensors.

[32]  Enrique Herrera-Viedma,et al.  A Self-Management Mechanism for Noncooperative Behaviors in Large-Scale Group Consensus Reaching Processes , 2018, IEEE Transactions on Fuzzy Systems.

[33]  Wei-Yu Chiu,et al.  Weight Induced Norm Approach to Group Decision Making for Multiobjective Optimization Problems in Systems Engineering , 2020, IEEE Systems Journal.

[34]  R. Ratcliff.  Group reaction time distributions and an analysis of distribution statistics. , 1979, Psychological bulletin.

[35]  Sally I. McClean,et al.  Aggregation of Imprecise and Uncertain Information in Databases , 2001, IEEE Trans. Knowl. Data Eng..

[36]  Jindong Qin,et al.  A linguistic solution for double large-scale group decision-making in E-commerce , 2018, Comput. Ind. Eng..

[37]  A. V. D. Ven,et al.  The Effectiveness of Nominal, Delphi, and Interacting Group Decision Making Processes , 1974 .

[38]  Charles F. Manski,et al.  Comparing the Point Predictions and Subjective Probability Distributions of Professional Forecasters , 2006 .

[39]  Christian Genest,et al.  Combining Probability Distributions: A Critique and an Annotated Bibliography , 1986 .

[40]  T. Gneiting,et al.  Combining probability forecasts , 2010 .

[41]  Thomas L. Saaty,et al.  DECISION MAKING WITH THE ANALYTIC HIERARCHY PROCESS , 2008 .

[42]  Roberto Casarin,et al.  Bayesian Nonparametric Calibration and Combination of Predictive Distributions , 2015, 1502.07246.

[43]  Guido Carpinelli,et al.  A Probabilistic Competitive Ensemble Method for Short-Term Photovoltaic Power Forecasting , 2017, IEEE Transactions on Sustainable Energy.

[44]  Lotfi A. Zadeh,et al.  Fuzzy logic = computing with words , 1996, IEEE Trans. Fuzzy Syst..

[45]  M. Stone.  The Opinion Pool , 1961 .