Reducing Bias and Uncertainty in Multievaluator Multicriterion Decision Making

AbstractMany decisions are based on more than one criterion, judged by more than a single evaluator. Multievaluator multicriterion (MEMC) decision making can be controversial if bias or uncertainty find their way into the final decision. In fact, both public and private organizations have recently faced challenges when making decisions. In a previous study, the authors of this paper developed a multievaluator decision making model that reduces the effect of possible uncertainty resulting from an evaluator’s insufficient expertise in a particular criterion. This paper builds on the previous model by also correcting for any possible evaluator favoritism or bias. It presents a more comprehensive mathematical model that supports MEMC decisions and protects decision makers and their agencies from potential criticism. Testing of the model shows that it performs better than the simple averaging method on 100% of the simulations.

[1]  Brenda McCabe,et al.  Introduction Construction , 2022 .

[2]  Joke Harte,et al.  Estimation of attribute weights in a multiattribute choice situation , 1996 .

[3]  Awad S. Hanna,et al.  Uncertainty Reduction in Multi-Evaluator Decision Making , 2012, J. Comput. Civ. Eng..

[4]  E. Zavadskas,et al.  Multi-criteria Optimization System for Decision Making in Construction Design and Management , 2009 .

[5]  Michael Scriven,et al.  Evaluation Bias and its Control* , 2010, Journal of MultiDisciplinary Evaluation.

[6]  Katharina Michaelowa,et al.  Evaluation Bias and Incentive Structures in Bi- and Multi-Lateral Aid Agencies , 2006 .

[7]  Adrian Shehu,et al.  Fuzzy Logic Approach for QoS Routing Analysis , 2012 .

[8]  Edmundas Kazimieras Zavadskas,et al.  Multi-Attribute Decision-Making Methods for Assessment of Quality in Bridges and Road Construction: State-Of-The-Art Surveys , 2008 .

[9]  Awad S. Hanna,et al.  Quantitative Methods for Design-Build Team Selection , 2009 .

[10]  Bruce E. Barrett,et al.  Decision quality using ranked attribute weights , 1996 .

[11]  R. Edward Minchin,et al.  Quality-Based Contractor Rating Model for Qualification and Bidding Purposes , 2005 .

[12]  J S Hammond,et al.  Even swaps: a rational method for making trade-offs. , 1998, Harvard business review.

[13]  Awad S. Hanna,et al.  A fuzzy logic approach to the selection of cranes , 1999 .

[14]  Jeffrey S. Russell.  Decision models for analysis and evaluation of construction contractors , 1992 .

[15]  Awad S. Hanna,et al.  Monte Carlo Simulation Approach to Support Alliance Team Selection , 2009 .

[16]  I. Ashikhmin,et al.  UniComBOS—Intelligent Decision Support System for multi-criteria comparison and choice , 2005 .

[17]  Martin Skitmore,et al.  Contractor selection using multi criteria utility theory: an additive mode , 1998 .

[18]  Gary David Holt,et al.  Applying Cluster Analysis to Construction Contractor Classification , 1996 .

[19]  E. Louis Overstreet.  A/E Selection Process for Public‐School Districts , 1990 .

[20]  Mohamed Marzouk.  An Application of ELECTRE III to Contractor Selection , 2010 .