Hirability in the Wild: Analysis of Online Conversational Video Resumes

Online social media is changing the personnel recruitment process. Until now, resumes were among the most widely used tools for the screening of job applicants. The advent of inexpensive sensors combined with the success of online video platforms has enabled the introduction of a new type of resume. Video resumes are short video messages where job applicants present themselves to potential employers. Online video resumes represent an opportunity to study the formation of first impressions in an employment context at a scale never attempted before, and to our knowledge they have not been studied from a behavioral standpoint. We collected a dataset of 939 conversational English-speaking video resumes from YouTube. Annotations of demographics, skills, and first impressions were collected using the Amazon Mechanical Turk crowdsourcing platform. Basic demographics were then analyzed to understand the population who uses video resumes to find a job, and results showed that applicants mainly consisted of young people looking for internship and junior positions. We developed a computational framework for the prediction of organizational first impressions, where the inference and nonverbal cue extraction steps were fully automated. Results demonstrate automatic prediction of first impressions of up to 27% of the variance explained for extraversion, and up to 20% for social and communication skills.

[1]  C. Piotrowski,et al.  Current Recruitment and Selection Practices: A National Survey of Fortune 1000 Firms , 2006 .

[2]  Robert S. Feldman,et al.  Women and Men's Nonverbal Behavior and Self-Monitoring in a Job Interview Setting , 2002 .

[3]  Vagia Tsiminaki,et al.  Hi YouTube!: personality impressions and verbal content in social video , 2013, ICMI '13.

[4]  Junji Yamato,et al.  Inferring mood in ubiquitous conversational video , 2013, MUM.

[5]  Nicu Sebe,et al.  Content-based multimedia information retrieval: State of the art and challenges , 2006, TOMCCAP.

[6]  L. Bobbitt,et al.  Using One-Minute Video Résumés as a Screening Tool for Sales Applicants , 2013 .

[7]  Elizabeth O'Brien,et al.  Using Video Resumes to Teach Deaf College Students Job Search Skills and Improve Their Communication , 1992, American annals of the deaf.

[8]  T. DeGroot,et al.  Can Nonverbal Cues be Used to Make Meaningful Personality Attributions in Employment Interviews? , 2009 .

[9]  D. Gática-Pérez,et al.  A Nonverbal Behavior Approach to Identify Emergent Leaders in Small Groups , 2012, IEEE Transactions on Multimedia.

[10]  A. Imada,et al.  Influence of nonverbal communication and rater proximity on impressions and decisions in simulated employment interviews. , 1977 .

[11]  Daniel Gildea,et al.  Automated prediction and analysis of job interview performance: The role of what you say and how you say it , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[12]  Daniel Gatica-Perez,et al.  VlogSense: Conversational behavior and social attention in YouTube , 2011, TOMCCAP.

[13]  Daniel Gatica-Perez,et al.  Automatic nonverbal analysis of social interaction in small groups: A review , 2009, Image Vis. Comput..

[14]  Nicu Sebe,et al.  Please, tell me about yourself: automatic personality assessment using short self-presentations , 2011, ICMI '11.

[15]  Annemarie M. F. Hiemstra,et al.  Fairness in Paper and Video Resume Screening , 2009 .

[16]  Daniel Gatica-Perez,et al.  FaceTube: predicting personality from facial expressions of emotion in online conversational video , 2012, ICMI '12.

[17]  Daniel Gatica-Perez,et al.  Hire me: Computational Inference of Hirability in Employment Interviews Based on Nonverbal Behavior , 2014, IEEE Transactions on Multimedia.

[18]  A. Pentland,et al.  Thin slices of negotiation: predicting outcomes from conversational dynamics within the first 5 minutes. , 2007, The Journal of applied psychology.

[19]  Daniel Gatica-Perez,et al.  You Are Known by How You Vlog: Personality Impressions and Nonverbal Behavior in YouTube , 2011, ICWSM.

[20]  Samuel D. Gosling,et al.  Personality Impressions Based on Facebook Profiles , 2007, ICWSM.

[21]  J. Fleiss,et al.  Intraclass correlations: uses in assessing rater reliability. , 1979, Psychological bulletin.

[22]  Nadia Mana,et al.  Multimodal recognition of personality traits in human-computer collaborative tasks , 2012, ICMI '12.

[23]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[24]  Subramanian Ramanathan,et al.  Connecting Meeting Behavior with Extraversion—A Systematic Study , 2012, IEEE Transactions on Affective Computing.

[25]  Daniel Gatica-Perez,et al.  The YouTube Lens: Crowdsourced Personality Impressions and Audiovisual Analysis of Vlogs , 2013, IEEE Transactions on Multimedia.

[26]  J. Fleiss,et al.  The measurement of interrater agreement , 2004 .

[27]  Video Technology: Resumes of the Future. , 1993 .

[28]  Nadia Mana,et al.  Multimodal recognition of personality traits in social interactions , 2008, ICMI '08.

[29]  P. Ekman Emotion in the human face , 1982 .

[30]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[31]  P. Jackson,et al.  Non‐verbal behaviour and the outcome of selection interviews , 1980 .

[32]  K. Heil Please! , 1924, The Hospital and Health Review.

[33]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[34]  Timothy D. Wilson,et al.  The halo effect: Evidence for unconscious alteration of judgments. , 1977 .

[35]  Allen I. Huffcutt,et al.  Identification and meta-analytic assessment of psychological constructs measured in employment interviews. , 2001, The Journal of applied psychology.

[36]  A. Huffcutt,et al.  Identification and meta-analytic assessment of psychological constructs measured in employment interviews. , 2001 .

[37]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[38]  Sumit Basu,et al.  Conversational scene analysis , 2002 .

[39]  Chuohao Yeo,et al.  Modeling Dominance in Group Conversations Using Nonverbal Activity Cues , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[40]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[41]  N. Ambady,et al.  Thin slices of expressive behavior as predictors of interpersonal consequences: A meta-analysis. , 1992 .