The analysis of expert opinions' consensus quality

An analysis of a quality of a consensus determined based on experts' opinions.An analysis of selected representations of experts' opinions.Processing of experts' opinions is enough to assess the consensus' quality.New theorems concerning the consensus' determination with the maximal quality.Modifications of experts' opinions can change the quality of the consensus. In many situations we need to obtain one, common decision (which can be understood as a consistent state of knowledge) out of opinions collected from many experts or any other external sources. This entails a problem concerning the reliability of such decision. We would like to know that decisions based on experts' opinions are trustworthy. Unfortunately, in many cases the determination of such decision is difficult and expensive, especially when big sets of input data are involved in the process. This paper presents a framework which allows to assess the quality of the aforementioned final decision. Its output is based solely on the analysis of its input (e.g. an assumed representation of experts' opinions). Moreover, the paper contains an overview of several types of possible approaches to the considered topic.

[1]  Francisco Herrera,et al.  A Consensus Model to Detect and Manage Noncooperative Behaviors in Large-Scale Group Decision Making , 2014, IEEE Transactions on Fuzzy Systems.

[2]  Yin-Feng Xu,et al.  The OWA-based consensus operator under linguistic representation models using position indexes , 2010, Eur. J. Oper. Res..

[3]  Humberto Bustince,et al.  Consensus in multi-expert decision making problems using penalty functions defined over a Cartesian product of lattices , 2014, Inf. Fusion.

[4]  Ngoc Thanh Nguyen,et al.  An Analysis of Influence of Consistency Degree on Quality of Collective Knowledge Using Binary Vector Structure , 2015, New Trends in Computational Collective Intelligence.

[5]  Ngoc Thanh Nguyen,et al.  Computational Collective Intelligence. Technologies and Applications , 2014, Lecture Notes in Computer Science.

[6]  Zeshui Xu,et al.  An automatic approach to reaching consensus in multiple attribute group decision making , 2009, Comput. Ind. Eng..

[7]  Ngoc Thanh Nguyen,et al.  PROCESSING INCONSISTENCY OF KNOWLEDGE IN DETERMINING KNOWLEDGE OF A COLLECTIVE , 2009, Cybern. Syst..

[8]  Ngoc Thanh Nguyen,et al.  INCONSISTENCY OF KNOWLEDGE AND COLLECTIVE INTELLIGENCE , 2008, Cybern. Syst..

[9]  Matthew Richardson,et al.  Building large knowledge bases by mass collaboration , 2003, K-CAP '03.

[10]  Manoj Kumar Tiwari,et al.  Consensus-based intelligent group decision-making model for the selection of advanced technology , 2006, Decis. Support Syst..

[11]  Ngoc Thanh Nguyen,et al.  A Method for Improving the Quality of Collective Knowledge , 2015, ACIIDS.

[12]  Janusz Kacprzyk,et al.  A consensus‐reaching process under intuitionistic fuzzy preference relations , 2003, Int. J. Intell. Syst..

[13]  Yin-Feng Xu,et al.  Consensus models for AHP group decision making under row geometric mean prioritization method , 2010, Decis. Support Syst..

[14]  Yucheng Dong,et al.  Multiperson decision making with different preference representation structures: A direct consensus framework and its properties , 2014, Knowl. Based Syst..

[15]  K. Bogart.  Preference structures I: Distances between transitive preference relations† , 1973 .

[16]  Ngoc Thanh Nguyen,et al.  Advanced Methods for Inconsistent Knowledge Management , 2007, Advanced Information and Knowledge Processing.

[17]  Francisco Herrera,et al.  Minimizing adjusted simple terms in the consensus reaching process with hesitant linguistic assessments in group decision making , 2015, Inf. Sci..

[18]  Ngoc Thanh Nguyen,et al.  Intelligent Information and Database Systems , 2014, Lecture Notes in Computer Science.

[19]  Luis Martínez-López,et al.  An Adaptive Consensus Support Model for Group Decision-Making Problems in a Multigranular Fuzzy Linguistic Context , 2009, IEEE Transactions on Fuzzy Systems.

[20]  Slawomir Zadrozny,et al.  Consensus reaching via a GDSS with fuzzy majority and clustering of preference profiles , 1994, Ann. Oper. Res..

[21]  Adrianna Kozierkiewicz-Hetmanska,et al.  Comparison of One-Level and Two-Level Consensuses Satisfying the 2-Optimality Criterion , 2012, ICCCI.

[22]  Núria Agell,et al.  Using consensus and distances between generalized multi-attribute linguistic assessments for group decision-making , 2014, Inf. Fusion.

[23]  David Ben-Arieh,et al.  Multi-criteria group consensus under linear cost opinion elasticity , 2007, Decis. Support Syst..

[24]  Yucheng Dong,et al.  Consensus building in multiperson decision making with heterogeneous preference representation structures: A perspective based on prospect theory , 2015, Appl. Soft Comput..

[25]  Ngoc Thanh Nguyen,et al.  Computational Collective Intelligence. Technologies and Applications , 2012, Lecture Notes in Computer Science.

[26]  Ngoc Thanh Nguyen.  Advanced Methods for Inconsistent Knowledge Management (Advanced Information and Knowledge Processing) , 2007 .

[27]  Francisco Herrera,et al.  Consensus under a fuzzy context: Taxonomy, analysis framework AFRYCA and experimental case of study , 2014, Inf. Fusion.