Exploring the Relationship of a Gamified Assessment with Performance

Abstract Our study explores the validity of a game-based assessment method assessing candidates’ soft skills. Using self-reported measures of performance, (job performance, Organizational Citizenship Behaviors (OCBs), and Great Point Average (GPA), we examined the criterion-related and incremental validity of a game-based assessment, above and beyond the effect of cognitive ability and personality. Our findings indicate that a game-based assessment measuring soft skills (adaptability, flexibility, resilience and decision making) can predict self-reported job and academic performance. Moreover, a game-based assessment can predict academic performance above and beyond personality and cognitive ability tests. The effectiveness of gamification in personnel selection is discussed along with research and practical implications introducing recruiters and HR professionals to an innovative selection technique.

[1]  Jerard F Kehoe.  Managing selection in changing organizations : human resource strategies , 2000 .

[2]  D. Gibson,et al.  The Effects of Flexibility in Employee Skills, Employee Behaviors, and Human Resource Practices on Firm Performance , 2005 .

[3]  R. Sherman,et al.  The datafication of talent: how technology is advancing the science of human potential at work , 2017, Current Opinion in Behavioral Sciences.

[4]  Fred S. Switzer,et al.  Meta-analyzing the relationship between grades and job performance. , 1996 .

[5]  Marc A. Brackett,et al.  Enhancing academic performance and social and emotional competence with the RULER feeling words curriculum , 2012 .

[6]  Valerie J. Shute,et al.  Stealth assessment in video games , 2015 .

[7]  Fred Luthans,et al.  Meta-Analysis of the Impact of Positive Psychological Capital on Employee Attitudes, Behaviors, and Performance. , 2011 .

[8]  H. Kwan,et al.  The role of citizenship behavior in personal learning and work-family enrichment , 2011 .

[9]  I. Robertson,et al.  The Five-Factor model of personality and work behaviour in Greece , 2001 .

[10]  Philip L. Roth,et al.  Social Media for Selection? Validity and Adverse Impact Potential of a Facebook-Based Assessment , 2016 .

[11]  Happy Paul,et al.  Employee Resilience and OCB: Mediating Effects of Organizational Commitment , 2016 .

[12]  A. Somech.  Participative Decision Making in Schools: A Mediating-Moderating Analytical Framework for Understanding School and Teacher Outcomes , 2010 .

[13]  Andrew J. Martin,et al.  Academic buoyancy: Towards an understanding of students' everyday academic resilience. , 2008, Journal of school psychology.

[14]  Danny Miller,et al.  The people make the process: commitment to employees, decision making, and performance , 2001 .

[15]  S. Côté,et al.  Emotional Intelligence, Cognitive Intelligence, and Job Performance , 2006 .

[16]  Neal Schmitt,et al.  Personality and Cognitive Ability as Predictors of Effective Performance at Work , 2014 .

[17]  J. P. Near,et al.  ORGANIZATIONAL CITIZENSHIP BEHAVIOR: ITS NATURE AND ANTECEDENTS , 1983 .

[18]  Scott B. MacKenzie,et al.  Common method biases in behavioral research: a critical review of the literature and recommended remedies. , 2003, The Journal of applied psychology.

[19]  Michael S. Fetzer,et al.  Gamification, Serious Games and Personnel Selection , 2017 .

[20]  N. Schmitt.  The Oxford Handbook of Personnel Assessment and Selection , 2012 .

[21]  Elizabeth Nelson,et al.  Towards a definition , 1989 .

[22]  Robert E. Ployhart,et al.  Individual Adaptability (I-ADAPT) Theory: Conceptualizing the Antecedents, Consequences, and Measurement of Individual Differences in Adaptability , 2006 .

[23]  Tarmo Strenze.  Intelligence and socioeconomic success: A meta-analytic review of longitudinal research ☆ , 2007 .

[24]  I. Götz.  On Technology , 2020, How to Think like Shakespeare.

[25]  V. Shute,et al.  Melding the Power of Serious Games and Embedded Assessment to Monitor and Foster Learning: Flow and Grow , 2009 .

[26]  F. Luthans.  The need for and meaning of positive organizational behavior , 2002 .

[27]  A. Poropat.  A meta-analysis of the five-factor model of personality and academic performance. , 2009, Psychological bulletin.

[28]  Richard N. Landers,et al.  Gamifying Recruitment, Selection, Training, and Performance Management: Game-Thinking in Human Resource Management , 2015 .

[29]  James D. A. Parker,et al.  Academic achievement in high school: does emotional intelligence matter? , 2004 .

[30]  Andrew J. Martin,et al.  Academic resilience and its psychological and educational correlates: A construct validity approach , 2006 .

[31]  P. Vrignaud,et al.  Individual and career adaptability: Comparing models and measures , 2013 .

[32]  L. Thompson,et al.  Predicting academic achievement with cognitive ability , 2007 .

[33]  Murray R. Barrick,et al.  Personality and Performance at the Beginning of the New Millennium: What Do We Know and Where Do We Go Next? , 2001 .

[34]  William Revelle,et al.  The international cognitive ability resource: Development and initial validation of a public-domain measure , 2014 .

[35]  Ramiro Montealegre,et al.  How Technology Is Changing Work and Organizations , 2016 .

[36]  Stan N. Finkelstein,et al.  Objective and self‐report work performance measures: a comparative analysis , 2006 .

[37]  Ann Marie Ryan,et al.  A century of selection. , 2014, Annual review of psychology.

[38]  Philip Powell,et al.  Towards a definition of flexibility: in search of the Holy Grail? , 2000 .

[39]  Neal Schmitt,et al.  ARE WE GETTING FOOLED AGAIN? COMING TO TERMS WITH LIMITATIONS IN THE USE OF PERSONALITY TESTS FOR PERSONNEL SELECTION , 2007 .

[40]  Paul E. Spector,et al.  Methodological Urban Legends: The Misuse of Statistical Control Variables , 2011 .

[41]  Harold W. Goldstein,et al.  Book Review:The Wiley Blackwell Handbook of the Psychology of Recruitment, Selection and Employee Retention , 2017, Assessment and Development Matters.

[42]  Richard G. Gardner,et al.  The Five-factor Model of Personality Traits and Organizational Citizenship Behaviors: a Meta-analysis Unresolved Issues regarding Citizenship and Personality , 2022 .

[43]  Mohammad Muzahid Akbar,et al.  ORGANIZATIONAL CITIZENSHIP BEHAVIOR: ITS NATURE AND ANTECEDENTS , 2004 .

[44]  John A. Johnson,et al.  The international personality item pool and the future of public-domain personality measures ☆ , 2006 .

[45]  Robert E. Ployhart,et al.  Assessing the Convergent and Discriminant Validity of Goldberg’s International Personality Item Pool , 2006 .

[46]  A. Furnham,et al.  Personality, intelligence and approaches to learning as predictors of academic performance , 2008 .

[47]  Janneke K. Oostrom,et al.  Webcam tests in personnel selection , 2013 .