Characterizing Hirability via Personality and Behavior

While personality traits have been extensively modeled as behavioral constructs, we model \textbf{\textit{job hirability}} as a \emph{personality construct}. On the {\emph{First Impressions Candidate Screening}} (FICS) dataset, we examine relationships among personality and hirability measures. Modeling hirability as a discrete/continuous variable with the \emph{big-five} personality traits as predictors, we utilize (a) apparent personality annotations, and (b) personality estimates obtained via audio, visual and textual cues for hirability prediction (HP). We also examine the efficacy of a two-step HP process involving (1) personality estimation from multimodal behavioral cues, followed by (2) HP from personality estimates. Interesting results from experiments performed on $\approx$~5000 FICS videos are as follows. (1) For each of the \emph{text}, \emph{audio} and \emph{visual} modalities, HP via the above two-step process is more effective than directly predicting from behavioral cues. Superior results are achieved when hirability is modeled as a continuous vis-a-vis categorical variable. (2) Among visual cues, eye and bodily information achieve performance comparable to face cues for predicting personality and hirability. (3) Explanatory analyses reveal the impact of multimodal behavior on personality impressions; \eg, Conscientiousness impressions are impacted by the use of \emph{cuss words} (verbal behavior), and \emph{eye movements} (non-verbal behavior), confirming prior observations.

[1]  L. Spinney The science of swearing , 2007 .

[2]  Roland Göcke,et al.  An Investigation of Depressed Speech Detection: Features and Normalization , 2011, INTERSPEECH.

[3]  M. Ashton,et al.  What is the central feature of extraversion? Social attention versus reward sensitivity. , 2002, Journal of personality and social psychology.

[4]  Fabio Pianesi,et al.  Stressful first impressions in job interviews , 2016, ICMI.

[5]  Alessandro Vinciarelli,et al.  What Do Prospective Students Want? An Observational Study of Preferences About Subject of Study in Higher Education , 2019, Innovations in Big Data Mining and Embedded Knowledge.

[6]  Daniel Gildea,et al.  Automated Analysis and Prediction of Job Interview Performance , 2015, IEEE Transactions on Affective Computing.

[7]  Subramanian Ramanathan,et al.  Putting the pieces together: multimodal analysis of social attention in meetings , 2010, ACM Multimedia.

[8]  Subramanian Ramanathan,et al.  Gender and emotion recognition with implicit user signals , 2017, ICMI.

[9]  Max L. Wilson,et al.  Using fNIRS in Usability Testing: Understanding the Effect of Web Form Layout on Mental Workload , 2016, CHI.

[10]  Mohan S. Kankanhalli,et al.  EEG-based Evaluation of Cognitive Workload Induced by Acoustic Parameters for Data Sonification , 2018, ICMI.

[11]  Brian W. Haas,et al.  I Know How You Feel: The Warm-Altruistic Personality Profile and the Empathic Brain , 2015, PloS one.

[12]  Shruti Shriya Gullapuram,et al.  Recognition of Advertisement Emotions With Application to Computational Advertising , 2019, IEEE Transactions on Affective Computing.

[13]  Stéphane Ayache,et al.  Explaining First Impressions: Modeling, Recognizing, and Explaining Apparent Personality from Videos , 2018, ArXiv.

[14]  T. Loetscher,et al.  Eye Movements During Everyday Behavior Predict Personality Traits , 2018, Front. Hum. Neurosci..

[15]  Louis-Philippe Morency,et al.  OpenFace 2.0: Facial Behavior Analysis Toolkit , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[16]  Subramanian Ramanathan,et al.  On the relationship between head pose, social attention and personality prediction for unstructured and dynamic group interactions , 2013, ICMI '13.

[17]  Sergio Escalera,et al.  Multimodal First Impression Analysis with Deep Residual Networks , 2018, IEEE Transactions on Affective Computing.

[18]  Subramanian Ramanathan,et al.  AVEID: Automatic Video System for Measuring Engagement In Dementia , 2017, IUI.

[19]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Nadia Mana,et al.  Multimodal recognition of personality traits in human-computer collaborative tasks , 2012, ICMI '12.