Merit measures and validation in employee evaluation and selection

Applicants for employment are usually compared subjectively in the selection process, and the selections made are typically not reliable, if only because they are seldom verifiable empirically. The present study describes a process of much more objective selection sequence, one that involves a quantitative/mathematical measure that may be used in selecting a candidate applying for a job, in a process then adds two other independent measures to validate the decision taken. The approach followed is a stepwise combination of SToR methods (Statistics and Operations Research, incorporating SAW, TOPSIS, and WP). In this analysis, SAW (simple additive weighting) is used in the first-cut selection process, and TOPSIS (technique for order preference by similarity to ideal solution) and WP (weighted product) are used to validate selections. A practical exercise was developed from an actual selection problem, part of a real-world recruitment task undertaken in an organization for which the authors consulted, and in which the human resources (HR) department wanted to check if their selection was justifiable, and demonstrably valid. The resulting analytical approach was clearly valid, consistent, reliable, and replicable, and convincing to that HR department, since it considered the determinations made by our system quite satisfactory, while theirs could not stand up to empirical testing or corroboration.

[1]  Douglas J. Miller,et al.  Maximum entropy econometrics: robust estimation with limited data , 1996 .

[2]  J. Sethna Statistical Mechanics: Entropy, Order Parameters, and Complexity , 2021 .

[3]  J. Barclay Improving selection interviews with structure: organisations’ use of “behavioural” interviews , 2001 .

[4]  Ge Wang,et al.  Product-driven supply chain selection using integrated multi-criteria decision-making methodology , 2004 .

[5]  P. Yu Multiple-Criteria Decision Making: "Concepts, Techniques, And Extensions" , 2012 .

[6]  Masatoshi Sakawa,et al.  Genetic Algorithms and Fuzzy Multiobjective Optimization , 2001 .

[7]  Ronald Rosenfeld,et al.  Adaptive Statistical Language Modeling; A Maximum Entropy Approach , 1994 .

[8]  Chen-Tung Chen,et al.  Extensions of the TOPSIS for group decision-making under fuzzy environment , 2000, Fuzzy Sets Syst..

[9]  J. Dennis,et al.  A closer look at drawbacks of minimizing weighted sums of objectives for Pareto set generation in multicriteria optimization problems , 1997 .

[10]  I. Doltsinis,et al.  ROBUST DESIGN OF STRUCTURES USING OPTIMIZATION METHODS , 2004 .

[11]  Achille Messac,et al.  From Dubious Construction of Objective Functions to the Application of Physical Programming , 2000 .

[12]  Ching-Lai Hwang,et al.  A new approach for multiple objective decision making , 1993, Comput. Oper. Res..

[13]  Wei Wang,et al.  Risk and confidence analysis for fuzzy multicriteria decision making , 2006, Knowl. Based Syst..

[14]  Shigeo Kawata,et al.  Workers' placement in an industrial environment , 1999, Fuzzy Sets Syst..

[15]  Liang-Hsuan Chen,et al.  A Fuzzy TOPSIS Decision Making Model with Entropy Weight under Intuitionistic Fuzzy Environment , 2009 .

[16]  Achille Messac,et al.  Physical programming's ability to generate a well-distributed set of Pareto points , 2000 .

[17]  Young-Jou Lai,et al.  IMOST: Interactive Multiple Objective System Technique , 1995 .

[18]  A W Labib,et al.  An intelligent maintenance model (system): an application of the analytic hierarchy process and a fuzzy logic rule-based controller , 1998, J. Oper. Res. Soc..

[19]  Baoding Liu,et al.  Chance constrained integer programming models for capital budgeting in fuzzy environments , 1998, J. Oper. Res. Soc..

[20]  Chen-Tung Chen,et al.  A fuzzy approach for supplier evaluation and selection in supply chain management , 2006 .

[21]  Eng Ung Choo,et al.  A common framework for deriving preference values from pairwise comparison matrices , 2004, Comput. Oper. Res..

[22]  Tien Chin Wang,et al.  Selection by TOPSIS for surveyor of candidates in organisations , 2006 .

[23]  Tien-Chin Wang,et al.  Application of TOPSIS in evaluating initial training aircraft under a fuzzy environment , 2007, Expert Syst. Appl..

[24]  Murray R. Barrick,et al.  Personality and Performance at the Beginning of the New Millennium: What Do We Know and Where Do We Go Next? , 2001 .

[25]  Gary David Holt,et al.  WHICH CONTRACTOR SELECTION METHODOLOGY , 1998 .

[26]  Adem Göleç,et al.  A fuzzy model for competency-based employee evaluation and selection , 2007, Comput. Ind. Eng..

[27]  Rogério Cid Bastos,et al.  Applicants' selection applying a fuzzy multicriteria CBR methodology , 2003, J. Intell. Fuzzy Syst..

[28]  M. M. Capraro,et al.  Myers-Briggs Type Indicator Score Reliability Across: Studies a Meta-Analytic Reliability Generalization Study , 2002 .

[29]  Jin-Lee Kim,et al.  Development of a Resource Scheduling Model Using Optimization , 2005 .

[30]  Sonja Yrjo Olavi Petrovic-Lazarevic,et al.  Personnel Selection Fuzzy Model , 2001 .

[31]  田口 玄一,et al.  Taguchi on robust technology development : bringing quality engineering upstream , 1993 .

[32]  Shyi-Ming Chen,et al.  A new approach for fuzzy risk analysis based on similarity measures of generalized fuzzy numbers , 2009, Expert Syst. Appl..

[33]  Athanasios Drigas,et al.  An expert system for job matching of the unemployed , 2004, Expert Syst. Appl..

[34]  William G. Ferrell,et al.  A methodology for selection problems with multiple, conflicting objectives and both qualitative and quantitative criteria , 2003 .

[35]  Ralph L. Keeney,et al.  Decisions with multiple objectives: preferences and value tradeoffs , 1976 .

[36]  Chung-Hsing Yeh,et al.  Inter-company comparison using modified TOPSIS with objective weights , 2000, Comput. Oper. Res..

[37]  Milan Zeleny,et al.  Multiple Criteria Decision Making (MCDM) , 2004 .

[38]  Mao-Jiun J. Wang,et al.  Personnel placement in a fuzzy environment , 1992, Comput. Oper. Res..

[39]  G. Geoffrey Vining,et al.  Taguchi's parameter design: a panel discussion , 1992 .

[40]  D. J. White,et al.  A Bibliography on the Applications of Mathematical Programming Multiple-objective Methods , 1990 .

[41]  Sai Hong Tang,et al.  TOPSIS and fuzzy multi-objective model integration for supplier selection problem , 2008 .

[42]  Gwo-Hshiung Tzeng,et al.  Group decision-making based on concepts of ideal and anti-ideal points in a fuzzy environment , 2007, Math. Comput. Model..

[43]  D. Wong,et al.  Toward the Development of a Second Generation Computerized Job-Matching System for Persons with Disabilities: A Conceptual Framework , 1992 .

[44]  Bruce Brown,et al.  A fuzzy approach to personnel selection , 1999 .

[45]  Xuan Chen,et al.  Visualizing the optimization process in real-time using physical programming , 1998 .

[46]  Stephen P. Jenkins,et al.  Trends in Income Inequality, Pro-Poor Income Growth and Income Mobility , 2003, SSRN Electronic Journal.

[47]  David L. Olson,et al.  Decision Aids for Selection Problems , 1995 .

[48]  Yildiz Esra Albayrak,et al.  Using analytic hierarchy process (AHP) to improve human performance: An application of multiple criteria decision making problem , 2004, J. Intell. Manuf..

[49]  Carl D. Sorensen,et al.  A general approach for robust optimal design , 1993 .

[50]  P. Yu A Class of Solutions for Group Decision Problems , 1973 .

[51]  G. Hazelrigg Systems Engineering: An Approach to Information-Based Design , 1996 .

[52]  Manoj Kumar,et al.  A fuzzy goal programming approach for vendor selection problem in a supply chain , 2004, Comput. Ind. Eng..

[53]  Philip D. Hattis,et al.  Physical programming design optimization for High Speed Civil Transport , 1996 .

[54]  Josep M. Rosanas,et al.  Fairness, Justice, Subjectivity, Objectivity and Goal Congruence in Management Control Systems , 2012 .

[55]  Hsuan-Shih Lee,et al.  Generalizing TOPSIS for fuzzy multiple-criteria group decision-making , 2007, Comput. Math. Appl..

[56]  Achille Messac,et al.  A robust design approach using Physical Programming , 2000 .

[57]  Neil R. Ullman,et al.  Signal-to-noise ratios, performance criteria, and transformations , 1988 .

[58]  Pekka Korhonen,et al.  A pareto race , 1988 .

[59]  S. H. Ghodsypour,et al.  A weighted additive fuzzy multiobjective model for the supplier selection problem under price breaks in a supply Chain , 2009 .

[60]  Donald R. Houser,et al.  A ROBUST OPTIMIZATION PROCEDURE WITH VARIATIONS ON DESIGN VARIABLES AND CONSTRAINTS , 1995 .

[61]  Ching-Lai Hwang,et al.  Multiple attribute decision making : an introduction , 1995 .

[62]  Wayne F. Cascio,et al.  Statistical Implications of Six Methods of Test Score Use in Personnel Selection , 1991 .

[63]  A. Jungermann Entropy and the Shelf Model: A Quantum Physical Approach to a Physical Property , 2006 .

[64]  Fumiko Seo,et al.  Multiple Criteria Decision Analysis in Regional Planning: Concepts, Methods and Applications , 1987 .

[65]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[66]  Farrokh Mistree,et al.  A procedure for robust design: Minimizing variations caused by noise factors and control factors , 1996 .

[67]  S. Zionts,et al.  Solving the Discrete Multiple Criteria Problem using Convex Cones , 1984 .

[68]  L. Beda Thermal physics , 1994 .