Psychology Meets Machine Learning: Interdisciplinary Perspectives on Algorithmic Job Candidate Screening

In a rapidly digitizing world, machine learning algorithms are increasingly employed in scenarios that directly impact humans. This also is seen in job candidate screening. Data-driven candidate assessment is gaining interest, due to high scalability and more systematic assessment mechanisms. However, it will only be truly accepted and trusted if explainability and transparency can be guaranteed. The current chapter emerged from ongoing discussions between psychologists and computer scientists with machine learning interests, and discusses the job candidate screening problem from an interdisciplinary viewpoint. After introducing the general problem, we present a tutorial on common important methodological focus points in psychological and machine learning research. Following this, we both contrast and combine psychological and machine learning approaches, and present a use case example of a data-driven job candidate assessment system, intended to be explainable towards non-technical hiring specialists. In connection to this, we also give an overview of more traditional job candidate assessment approaches, and discuss considerations for optimizing the acceptability of technology-supported hiring solutions by relevant stakeholders. Finally, we present several recommendations on how interdisciplinary collaboration on the topic may be fostered.

[1]  G. Stanley Hall Practical relations between psychology and the war. , 1917 .

[2]  R. Flesch A new readability yardstick. , 1948, The Journal of applied psychology.

[3]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[4]  R. A. Bradley,et al.  RANK ANALYSIS OF INCOMPLETE BLOCK DESIGNS THE METHOD OF PAIRED COMPARISONS , 1952 .

[5]  E A Smith,et al.  Automated readability index. , 1967, AMRL-TR. Aerospace Medical Research Laboratories.

[6]  R. Gunning The Technique of Clear Writing. , 1968 .

[7]  G. Harry McLaughlin,et al.  SMOG Grading - A New Readability Formula. , 1969 .

[8]  C. B. Colby The weirdest people in the world , 1973 .

[9]  R. P. Fishburne,et al.  Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel , 1975 .

[10]  M. Coleman,et al.  A computer readability formula designed for machine scoring. , 1975 .

[11]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[12]  Jonathan Anderson Lix and Rix: Variations on a Little-Known Readability Index. , 1983 .

[13]  Terry A. Beehr,et al.  Effects of applicant sex, applicant physical attractiveness, type of rater and type of job on interview decisions* , 1986 .

[14]  Murray R. Barrick,et al.  THE BIG FIVE PERSONALITY DIMENSIONS AND JOB PERFORMANCE: A META-ANALYSIS , 1991 .

[15]  S. Gilliland The Perceived Fairness of Selection Systems: An Organizational Justice Perspective , 1993 .

[16]  Michael Smith A theory of the validity of predictors in selection , 1994 .

[17]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[18]  Neal Schmitt,et al.  Experience-based and situational interview questions: Studies of validity. , 1995 .

[19]  Robert M. Guion,et al.  Assessment, Measurement, and Prediction for Personnel Decisions , 1997 .

[20]  F. Schmidt,et al.  The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 85 years of research findings. , 1998 .

[21]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[22]  Ann Marie Ryan,et al.  AN INTERNATIONAL LOOK AT SELECTION PRACTICES: NATION AND CULTURE AS EXPLANATIONS FOR VARIABILITY IN PRACTICE , 1999 .

[23]  David C. Funder,et al.  Personality judgment: A realistic approach to person perception. , 1999 .

[24]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Frank J. Bernieri,et al.  Toward a histology of social behavior: Judgmental accuracy from thin slices of the behavioral stream , 2000 .

[26]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Robert E. Ployhart,et al.  Determinants, Detection and Amelioration of Adverse Impact in Personnel Selection Procedures: Issues, Evidence and Lessons Learned , 2001 .

[28]  M. A. Campion,et al.  APPLICANT REACTIONS TO SELECTION: DEVELOPMENT OF THE SELECTION PROCEDURAL JUSTICE SCALE (SPJS) , 2001 .

[29]  Alexandru T. Balaban,et al.  Serendipitous, one-pot formation of 2,3,7-triphenylcyclopenta[c]pyran from 1,2-diphenylethanedione (“benzil”) and cyclopentadiene , 2001 .

[30]  Neil Anderson,et al.  The practitioner‐researcher divide in Industrial, Work and Organizational (IWO) psychology: Where are we now, and where do we go from here? , 2001 .

[31]  P. H. Lodhi,et al.  The Five-Factor Model of Personality , 2002 .

[32]  R. Gibson,et al.  What the Face Reveals , 2002 .

[33]  Jane Webster,et al.  Applicant reactions to face-to-face and technology-mediated interviews: a field investigation. , 2003, The Journal of applied psychology.

[34]  J. Webster,et al.  The Use of Technologies in the Recruiting, Screening, and Selection Processes for Job Candidates , 2003 .

[35]  U. Klehe,et al.  Choosing How to Choose: Institutional Pressures Affecting the Adoption of Personnel Selection Procedures , 2004 .

[36]  A. Pentland Social Dynamics: Signals and Behavior , 2004 .

[37]  M. Cook,et al.  Personnel Selection , 2004 .

[38]  T. Prescott,et al.  The brainstem reticular formation is a small-world, not scale-free, network , 2006, Proceedings of the Royal Society B: Biological Sciences.

[39]  R. Caneel Social signaling in decision making , 2005 .

[40]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[41]  Gary N. Burns,et al.  The Good Judge Revisited: Individual Differences in the Accuracy of Personality Judgments , 2005 .

[42]  Kelly A. Piasentin,et al.  Applicant attraction to organizations and job choice: a meta-analytic review of the correlates of recruiting outcomes. , 2005, The Journal of applied psychology.

[43]  Jennifer S. Tucker,et al.  Selection in the Information Age: The Impact of Privacy Concerns and Computer Experience on Applicant Reactions , 2006 .

[44]  Bernard C. K. Choi,et al.  Multidisciplinarity, interdisciplinarity and transdisciplinarity in health research, services, education and policy: 1. Definitions, objectives, and evidence of effectiveness. , 2006, Clinical and investigative medicine. Medecine clinique et experimentale.

[45]  Khalil Sima'an,et al.  Wired for Speech: How Voice Activates and Advances the Human-Computer Relationship , 2006, Computational Linguistics.

[46]  R. L. Dipboye,et al.  RECONSIDERING THE USE OF PERSONALITY TESTS IN PERSONNEL SELECTION CONTEXTS , 2007 .

[47]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[48]  Heloir,et al.  The Uncanny Valley , 2019, The Animation Studies Reader.

[49]  P. Costa,et al.  The five-factor theory of personality. , 2008 .

[50]  Jason Weston,et al.  A unified architecture for natural language processing: deep neural networks with multitask learning , 2008, ICML '08.

[51]  P. Borkenau,et al.  Extraversion is accurately perceived after a 50-ms exposure to a face. , 2009 .

[52]  S. Gosling,et al.  Personality and Social Psychology Bulletin Personality Judgments Based on Physical Appearance Personality Judgments Based on Physical Appearance , 2022 .

[53]  S. Levinson,et al.  WEIRD languages have misled us, too , 2010, Behavioral and Brain Sciences.

[54]  Cornelius J. König,et al.  Reasons for Being Selective When Choosing Personnel Selection Procedures , 2010 .

[55]  D. Dickstein In this issue/abstract thinking: the new normal. , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[56]  Douglas Eck,et al.  Learning Features from Music Audio with Deep Belief Networks , 2010, ISMIR.

[57]  M. Mount,et al.  Validity of observer ratings of the five-factor model of personality traits: a meta-analysis. , 2011, The Journal of applied psychology.

[58]  Robert M. Guion Assessment, measurement, and prediction for personnel decisions, 2nd ed. , 2011 .

[59]  Douglas Eck,et al.  The need for music information retrieval with user-centered and multimodal strategies , 2011, MIRUM '11.

[60]  Tara S. Behrend,et al.  The viability of crowdsourcing for survey research , 2011, Behavior research methods.

[61]  Daniel Gatica-Perez,et al.  You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube , 2011, ICWSM.

[62]  D. Funder Accurate Personality Judgment , 2012 .

[63]  Eva Derous,et al.  Fairness Perceptions of Video Resumes Among Ethnically Diverse Applicants , 2012 .

[64]  Karl F. MacDorman,et al.  The Uncanny Valley [From the Field] , 2012, IEEE Robotics Autom. Mag..

[65]  Toniann Pitassi,et al.  Fairness through awareness , 2011, ITCS '12.

[66]  Joshua D. Reiss,et al.  Music Information Technology and Professional Stakeholder Audiences: Mind the Adoption Gap , 2012, Multimodal Music Processing.

[67]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Robbert Sanderman,et al.  Correction: Ineffectiveness of Reverse Wording of Questionnaire Items: Let’s Learn from Cows in the Rain , 2013, PLoS ONE.

[69]  Xavier Serra,et al.  Evaluation in Music Information Retrieval , 2013, Journal of Intelligent Information Systems.

[70]  Joy E. Beatty,et al.  The Effects of Video and Paper Resumes on Assessments of Personality, Applied Social Skills, Mental Capability, and Resume Outcomes , 2014 .

[71]  Navdeep Jaitly,et al.  Towards End-To-End Speech Recognition with Recurrent Neural Networks , 2014, ICML.

[72]  Bob L. Sturm A Simple Method to Determine if a Music Information Retrieval System is a “Horse” , 2014, IEEE Transactions on Multimedia.

[73]  T. Sitser Predicting sales performance: Strengthening the personality – job performance linkage , 2014 .

[74]  Daniel Gatica-Perez,et al.  Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior , 2014, IEEE Transactions on Multimedia.

[75]  Cornelius J. König,et al.  Personality testing in personnel selection: Love it? Leave it? Understand it! , 2015 .

[76]  Daniel Gildea,et al.  Automated prediction and analysis of job interview performance: The role of what you say and how you say it , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[77]  Filip Lievens,et al.  An In-Depth Look at Dispositional Reasoning and Interviewer Accuracy , 2015 .

[78]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[79]  M. Kosinski,et al.  Computer-based personality judgments are more accurate than those made by humans , 2015, Proceedings of the National Academy of Sciences.

[80]  Jonathon Shlens,et al.  Explaining and Harnessing Adversarial Examples , 2014, ICLR.

[81]  Peter Robinson,et al.  Cross-dataset learning and person-specific normalisation for automatic Action Unit detection , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[82]  Fulvio Mazzocchi,et al.  Could Big Data be the end of theory in science? , 2015, EMBO reports.

[83]  Sergio Escalera,et al.  ChaLearn LAP 2016: First Round Challenge on First Impressions - Dataset and Results , 2016, ECCV Workshops.

[84]  Yaneer Bar-Yam,et al.  The limits of phenomenology: From behaviorism to drug testing and engineering design , 2013, Complex..

[85]  Ryan Calo,et al.  There is a blind spot in AI research , 2016, Nature.

[86]  R. Hogan,et al.  New Talent Signals: Shiny New Objects or a Brave New World? , 2016, Industrial and Organizational Psychology.

[87]  Emily D. Campion,et al.  Initial investigation into computer scoring of candidate essays for personnel selection. , 2016, The Journal of applied psychology.

[88]  Sergio Escalera,et al.  Overcoming Calibration Problems in Pattern Labeling with Pairwise Ratings: Application to Personality Traits , 2016, ECCV Workshops.

[89]  Tara S. Behrend,et al.  Technology in The employmenT inTerview: A meTA-AnAlysis And FuTure reseArch AgendA , 2016 .

[90]  Adam Tauman Kalai,et al.  Man is to Computer Programmer as Woman is to Homemaker? Debiasing Word Embeddings , 2016, NIPS.

[91]  Or Biran,et al.  Explanation and Justification in Machine Learning : A Survey Or , 2017 .

[92]  Markus Langer,et al.  Examining Digital Interviews for Personnel Selection: Applicant Reactions and Interviewer Ratings , 2017 .

[93]  Eva Derous,et al.  Are they accurate? Recruiters' personality judgments in paper versus video resumes , 2017, Comput. Hum. Behav..

[94]  Cornelius J. König,et al.  Are Observer Ratings of Applicants’ Personality Also Faked? Yes, But Less than Self‐Reports , 2017 .

[95]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[96]  Cynthia C. S. Liem,et al.  Human-Explainable Features for Job Candidate Screening Prediction , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[97]  Albert Ali Salah,et al.  Multi-modal Score Fusion and Decision Trees for Explainable Automatic Job Candidate Screening from Video CVs , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[98]  Gholamreza Anbarjafari,et al.  Automated Screening of Job Candidate Based on Multimodal Video Processing , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[99]  Filip Lievens,et al.  A Closer Look at the Measurement of Dispositional Reasoning: Dimensionality and Invariance Across Assessor Groups , 2017 .

[100]  Stéphane Ayache,et al.  Design of an explainable machine learning challenge for video interviews , 2017, 2017 International Joint Conference on Neural Networks (IJCNN).

[101]  Odette Scharenborg,et al.  Speech perception by humans and machines , 2017 .

[102]  Robert E. Ployhart,et al.  Solving the Supreme Problem: 100 years of selection and recruitment at the Journal of Applied Psychology. , 2017, The Journal of applied psychology.

[103]  Sukma Achmadnoer Sukma Wicaksana Layered Regression Analysis on Multimodal Approach for Personality and Job Candidacy Prediction and Explanation , 2017 .

[104]  Arvind Narayanan,et al.  Semantics derived automatically from language corpora contain human-like biases , 2016, Science.

[105]  J. Levashina,et al.  Impression Management and Interview and Job Performance Ratings: A Meta-Analysis of Research Design with Tactics in Mind , 2017, Front. Psychol..

[106]  Timnit Gebru,et al.  Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification , 2018, FAT.

[107]  Joichi Ito,et al.  Interventions over Predictions: Reframing the Ethical Debate for Actuarial Risk Assessment , 2017, FAT.

[108]  Daniel Gildea,et al.  Automated Analysis and Prediction of Job Interview Performance , 2015, IEEE Transactions on Affective Computing.

[109]  Markus Langer,et al.  Information as a double-edged sword: The role of computer experience and information on applicant reactions towards novel technologies for personnel selection , 2018, Comput. Hum. Behav..

[110]  Stéphane Ayache,et al.  Explaining First Impressions: Modeling, Recognizing, and Explaining Apparent Personality from Videos , 2018, ArXiv.

[111]  P. Ekman,et al.  Facial action coding system , 2019 .

[112]  Alan Hanjalic,et al.  One deep music representation to rule them all? A comparative analysis of different representation learning strategies , 2018, Neural Computing and Applications.

[113]  Tim Miller,et al.  Explanation in Artificial Intelligence: Insights from the Social Sciences , 2017, Artif. Intell..