Using Machine Learning to Advance Personality Assessment and Theory

Machine learning has led to important advances in society. One of the most exciting applications of machine learning in psychological science has been the development of assessment tools that can powerfully predict human behavior and personality traits. Thus far, machine learning approaches to personality assessment have focused on the associations between social media and other digital records with established personality measures. The goal of this article is to expand the potential of machine learning approaches to personality assessment by embedding it in a more comprehensive construct validation framework. We review recent applications of machine learning to personality assessment, place machine learning research in the broader context of fundamental principles of construct validation, and provide recommendations for how to use machine learning to advance our understanding of personality.

[1]  Daniel Gatica-Perez,et al.  Who's Who with Big-Five: Analyzing and Classifying Personality Traits with Smartphones , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[2]  M. Donnellan,et al.  Experts' Views Regarding the Conceptualization of Narcissism. , 2017, Journal of personality disorders.

[3]  L. Cronbach,et al.  Construct validity in psychological tests. , 1955, Psychological bulletin.

[4]  Robert Rosenthal,et al.  Quantifying construct validity: two simple measures. , 2003 .

[5]  Gregory J. Park,et al.  Automatic personality assessment through social media language. , 2015, Journal of personality and social psychology.

[6]  R. Bernstein Reconceptualizing Personality Disorder Diagnosis in the DSM‐V: The Discriminant Validity Challenge , 1998 .

[7]  Bruce Ratner,et al.  Statistical and Machine-Learning Data Mining: Techniques for Better Predictive Modeling and Analysis of Big Data , 2011 .

[8]  H. Pashler,et al.  Puzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition 1 , 2009, Perspectives on psychological science : a journal of the Association for Psychological Science.

[9]  R. Bornstein Heisenberg, Kandinsky, and the Heteromethod Convergence Problem: Lessons From Within and Beyond Psychology , 2009, Journal of personality assessment.

[10]  Juliane M. Stopfer,et al.  Facebook Profiles Reflect Actual Personality, Not Self-Idealization , 2010, Psychological science.

[11]  T. Yarkoni,et al.  Choosing Prediction Over Explanation in Psychology: Lessons From Machine Learning , 2017, Perspectives on psychological science : a journal of the Association for Psychological Science.

[12]  M. Donnellan,et al.  The two faces of Narcissus? An empirical comparison of the Narcissistic Personality Inventory and the Pathological Narcissism Inventory , 2011 .

[13]  John A. Johnson,et al.  The international personality item pool and the future of public-domain personality measures ☆ , 2006 .

[14]  O. John,et al.  Paradigm shift to the integrative Big Five trait taxonomy: History, measurement, and conceptual issues. , 2008 .

[15]  Lori N. Scott,et al.  The Effect of Pathological Narcissism on Interpersonal and Affective Processes in Social Interactions , 2017, Journal of abnormal psychology.

[16]  K. Markon,et al.  Toward a theory of distinct types of "impulsive" behaviors: A meta-analysis of self-report and behavioral measures. , 2014, Psychological bulletin.

[17]  H. A. Schwartz,et al.  Birds of a Feather Do Flock Together , 2017, Psychological science.

[18]  A. Pincus,et al.  Pathological narcissism and narcissistic personality disorder. , 2010, Annual review of clinical psychology.

[19]  Martin E. P. Seligman,et al.  The Online Social Self , 2014, Assessment.

[20]  D. Campbell,et al.  Convergent and discriminant validation by the multitrait-multimethod matrix. , 1959, Psychological bulletin.

[21]  F. Drasgow Scrutinizing psychological tests: Measurement equivalence and equivalent relations with external variables are the central issues , 1984 .

[22]  J. Loevinger Objective Tests as Instruments of Psychological Theory , 1957 .

[23]  Amit G Singal,et al.  A Primer on Predictive Models , 2014, Clinical and Translational Gastroenterology.

[24]  W. K. Campbell,et al.  Comparing clinical and social-personality conceptualizations of narcissism. , 2008, Journal of personality.

[25]  Gregory J. Park,et al.  From "Sooo excited!!!" to "So proud": using language to study development. , 2014, Developmental psychology.

[26]  Christian Montag,et al.  Psycho-informatics: Big Data shaping modern psychometrics. , 2014, Medical hypotheses.

[27]  D. Funder Global Traits: A Neo-Allportian Approach to Personality , 1991 .

[28]  Jennifer Golbeck,et al.  Predicting personality with social media , 2011, CHI Extended Abstracts.

[29]  R. Bagby,et al.  Personality and psychopathology: mapping the MMPI-2 Restructured Clinical (RC) Scales onto the Five Factor Model of personality. , 2008, Journal of personality disorders.

[30]  Jennifer Golbeck,et al.  Predicting Personality from Twitter , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[31]  R. L. Thorndike,et al.  An evaluation of the attempts to measure social intelligence. , 1937 .

[32]  J. S. Wiggins,et al.  Personality and Prediction: Principles of Personality Assessment , 1973 .

[33]  Robert Rosenthal,et al.  A Comparative Meta-Analysis of Rorschach and MMPI Validity , 2004 .

[34]  Tanja M. Gerlach,et al.  Narcissism and Romantic Relationships: The Differential Impact of Narcissistic Admiration and Rivalry , 2017, Journal of personality and social psychology.

[35]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[36]  Daniel Gatica-Perez,et al.  Mining large-scale smartphone data for personality studies , 2013, Personal and Ubiquitous Computing.

[37]  Goldine C. Gleser,et al.  Maximizing the discriminating power of a multiple-score test , 1953 .

[38]  S. Haynes,et al.  Content validity in psychological assessment: A functional approach to concepts and methods. , 1995 .

[39]  C. Hovanitz,et al.  Do face-valid items have more predictive validity than subtle items? The case of the MMPI Pd Scale. , 1979, Journal of consulting and clinical psychology.

[40]  G. J. Robertson Raven's Progressive Matrices , 2010 .

[41]  Nigel O'Brian,et al.  Generalizability Theory I , 2003 .

[42]  Douglas N. Jackson,et al.  The dynamics of structured personality tests: 1971. , 1971 .

[43]  A. Tellegen Personality traits: Issues of definition, evidence, and assessment. , 1991 .

[44]  J. M. Digman Higher-order factors of the Big Five. , 1997, Journal of personality and social psychology.

[45]  Avshalom Caspi,et al.  Personality development: stability and change. , 2005, Annual review of psychology.

[46]  D. Lynam,et al.  A comparison of the criterion validity of popular measures of narcissism and narcissistic personality disorder via the use of expert ratings. , 2014, Psychological assessment.

[47]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[48]  T. Graepel,et al.  Private traits and attributes are predictable from digital records of human behavior , 2013, Proceedings of the National Academy of Sciences.

[49]  L. Eyde,et al.  Psychological testing and psychological assessment. A review of evidence and issues. , 2001, The American psychologist.

[50]  Francisco Iacobelli,et al.  Large Scale Personality Classification of Bloggers , 2011, ACII.

[51]  Jure Leskovec,et al.  Mining big data to extract patterns and predict real-life outcomes. , 2016, Psychological methods.

[52]  Margaret L. Kern,et al.  Personality, Gender, and Age in the Language of Social Media: The Open-Vocabulary Approach , 2013, PloS one.

[53]  G. Rees,et al.  The structural basis of inter-individual differences in human behaviour and cognition , 2011, Nature Reviews Neuroscience.

[54]  M. Kosinski,et al.  Computer-based personality judgments are more accurate than those made by humans , 2015, Proceedings of the National Academy of Sciences.

[55]  L. Morey,et al.  Personality Assessment Inventory , 2010 .

[56]  Aidan G. C. Wright,et al.  Current Directions in Personality Science and the Potential for Advances through Computing , 2014, IEEE Transactions on Affective Computing.

[57]  Wiebke Bleidorn,et al.  Using big data to advance personality theory , 2017, Current Opinion in Behavioral Sciences.

[58]  Ara Norenzayan,et al.  What do cross-national comparisons of personality traits tell us? The case of conscientiousness. , 2008, Psychological science.

[59]  H. A. Schwartz,et al.  Birds of a Feather Do Flock Together , 2017, Psychological science.

[60]  P. Meehl,et al.  An atlas for the clinical use of the MMPI , 1951 .

[61]  C. Hovanitz,et al.  Do face-valid items have more predictive validity than subtle items? The case of the MMPI Pd Scale. , 1979, Journal of consulting and clinical psychology.

[62]  E. Jensen,et al.  Putting the methodological brakes on claims to measure national happiness through Twitter: Methodological limitations in social media analytics , 2017, PloS one.

[63]  S. Gosling,et al.  Facebook as a research tool for the social sciences: Opportunities, challenges, ethical considerations, and practical guidelines. , 2015, The American psychologist.

[64]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[65]  Paul E. Meehl,et al.  The dynamics of "structured" personality tests. , 2000 .

[66]  Daniele Quercia,et al.  Our Twitter Profiles, Our Selves: Predicting Personality with Twitter , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.