Gamifying Psychological Testing: Insights from Gamifying the TAT

OF THESIS Nowadays, gamification, using game elements in a non-game context, is becoming progressively popular in the research due to their affordances. Technology has the promise of increasing the accessibility and gamification has the capability of bringing engagement. This combination can increase participation in nonengaging contexts such as a test. In this study, we gamified a psychological test, Thematic Apperception Test (TAT), and ran an empirical study to test the effectiveness of such gamification. TAT consists a set of cards showing human figures in ambiguous situations and subjects write up stories about each card. The written stories are used to reveal aspects of the personality of the writers. We used a platform called Mad Science to implement our games and manipulated the test with achievement, exploration and social elements. In the empirical study, all participants did both the paper-based version of the TAT and the gamified version of it and rated their experience in each setting through surveys. We compared the results obtained from the traditional setting and the gamified version in terms of personality themes and detail of the stories to understand the consistency of results in the two settings and if stories in one setting could better reveal aspects of personality. We also looked at the survey results to understand the participants’ preference in each setting. Our results showed that the gamified version of the TAT provided a more motivating and enjoyable experience while at the same time could capture the essence of the TAT. The game could also reveal more personality themes in some of the cases. Submitted in partial fulfillment of the requirements for the degree of Master of Science in Game Science and Design in the Graduate School of the College of Arts, Media and Design of Northeastern University

[1]  Marion J. Faber Mental Tests and Measurements , 1928 .

[2]  H. Freed,et al.  The thematic apperception test. , 1946, Diseases of the nervous system.

[3]  P. Mussen,et al.  The relationships between overt and fantasy aggression. , 1954, Journal of abnormal psychology.

[4]  Robert C. Davis,et al.  The Achieving Society , 1962 .

[5]  M. Golden SOME EFFECTS OF COMBINING PSYCHOLOGICAL TESTS ON CLINICAL INFERENCES. , 1964, Journal of consulting psychology.

[6]  B. Karon,et al.  Quantified judgments of mental health from the rorschach, TAT, and clinical status interview by means of a scaling technique. , 1970, Journal of consulting and clinical psychology.

[7]  An investigation into the comparative validity of several diagnostic tests and test batteries , 1975 .

[8]  D. Winter,et al.  Power motive reliability as a function of retest instructions. , 1977 .

[9]  S. Fineman The Achievement Motive Construct and its Measurement: Where Are We Now?. , 1977 .

[10]  R. Kennedy,et al.  A Video Game for Performance Testing , 1981 .

[11]  D. Mcclelland,et al.  Leadership motive pattern and long-term success in management. , 1982 .

[12]  Marshall B. Jones Video Games as Psychological Tests , 1984 .

[13]  E. Blanchard,et al.  Training in projective testing: A survey of clinical training directors and internship directors , 1988 .

[14]  Valerie J. Shute,et al.  A Large-Scale Evaluation of an Intelligent Discovery World: Smithtown , 1990, Interact. Learn. Environ..

[15]  R. Gregory Psychological Testing: History, Principles, and Applications , 1992 .

[16]  W. D. Spangler Validity of questionnaire and TAT measures of need for achievement: Two meta-analyses. , 1992 .

[17]  R. Dawes Prediction of the future versus an understanding of the past: A basic asymmetry. , 1993 .

[18]  C. Piotrowski,et al.  Training in psychodiagnostic testing in APA-approved PsyD and PhD clinical psychology programs. , 1993, Journal of personality assessment.

[19]  C. E. Watkins,et al.  Contemporary practice of psychological assessment by clinical psychologists. , 1995 .

[20]  C. Steele,et al.  Stereotype threat and the intellectual test performance of African Americans. , 1995, Journal of personality and social psychology.

[21]  C. Piotrowski,et al.  The impact of "managed care" on the practice of psychological testing: preliminary findings. , 1998, Journal of personality assessment.

[22]  P. Erdberg,et al.  Current nonpatient data for the Rorschach, WAIS-R, and MMPI-2 , 1999 .

[23]  S. Lilienfeld,et al.  The Rorschach test in clinical diagnosis: a critical review, with a backward look at Garfield (1947). , 2000, Journal of clinical psychology.

[24]  S. Lilienfeld,et al.  The Scientific Status of Projective Techniques , 2000, Psychological science in the public interest : a journal of the American Psychological Society.

[25]  Nick Yee,et al.  Motivations for Play in Online Games , 2006, Cyberpsychology Behav. Soc. Netw..

[26]  H. Murray,et al.  Explorations in Personality , 2007 .

[27]  Noah J. Goldstein,et al.  The spyglass self: a model of vicarious self-perception. , 2007, Journal of personality and social psychology.

[28]  Ching‐I Teng,et al.  Personality and motivations for playing online games , 2008 .

[29]  H. Jaap van den Herik,et al.  Extraversion in Games , 2010, Computers and Games.

[30]  Christoph Klimmt,et al.  Identification With Video Game Characters as Automatic Shift of Self-Perceptions , 2010 .

[31]  Dan,et al.  [ACM Press the 15th International Academic MindTrek Conference - Tampere, Finland (2011.09.28-2011.09.30)] Proceedings of the 15th International Academic MindTrek Conference on Envisioning Future Media Environments - MindTrek \'11 - From game design elements to gamefulness , 2011 .

[32]  V. Shute SteAlth ASSeSSment in computer-BASed GAmeS to Support leArninG , 2011 .

[33]  Les Nelson,et al.  Introverted elves & conscientious gnomes: the expression of personality in world of warcraft , 2011, CHI.

[34]  Rod McCall,et al.  Infinite Reality: Avatars, Eternal Life, New Worlds, and the Dawn of the Virtual Revolution , 2011, PRESENCE: Teleoperators and Virtual Environments.

[35]  H. Jaap van den Herik,et al.  Games as personality profiling tools , 2011, 2011 IEEE Conference on Computational Intelligence and Games (CIG'11).

[36]  Carl Gutwin,et al.  Effects of gamification on participation and data quality in a real-world market research domain , 2013, Gamification.

[37]  Julian Togelius,et al.  Give me a reason to dig Minecraft and psychology of motivation , 2013, 2013 IEEE Conference on Computational Inteligence in Games (CIG).

[38]  Juho Hamari,et al.  Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification , 2014, 2014 47th Hawaii International Conference on System Sciences.

[39]  M. Blair,et al.  Over the Hill at 24: Persistent Age-Related Cognitive-Motor Decline in Reaction Times in an Ecologically Valid Video Game Task Begins in Early Adulthood , 2014, PloS one.

[40]  Yigal Attali,et al.  Gamification in assessment: Do points affect test performance? , 2015, Comput. Educ..

[41]  Magy Seif El-Nasr,et al.  In Your Face(t) Impact of Personality and Context on Gameplay Behavior , 2015, FDG.

[42]  C. Harteveld Design Considerations for Creating Game-Based Social Experiments , 2015 .

[43]  H. Jaap van den Herik,et al.  Past Our Prime: A Study of Age and Play Style Development in Battlefield 3 , 2015, IEEE Transactions on Computational Intelligence and AI in Games.

[44]  W. Boot Video games as tools to achieve insight into cognitive processes , 2015, Front. Psychol..

[45]  Jesse Fox,et al.  Assessing the effects of gamification in the classroom: A longitudinal study on intrinsic motivation, social comparison, satisfaction, effort, and academic performance , 2015, Comput. Educ..

[46]  Julian Togelius,et al.  Computational intelligence and cognitive performance assessment games , 2016, 2016 IEEE Conference on Computational Intelligence and Games (CIG).

[47]  Gillian Smith,et al.  Standing on the Shoulders of Citizens: Exploring Gameful Collaboration for Creating Social Experiments , 2016, 2016 49th Hawaii International Conference on System Sciences (HICSS).

[48]  Andrew B. Collmus,et al.  Game-Thinking Within Social Media to Recruit and Select Job Candidates , 2016 .

[49]  Steven C. Sutherland,et al.  Personalized Gaming for Motivating Social and Behavioral Science Participation , 2017, HUMANIZE@IUI.

[50]  Wayne D. Gray Game-XP: Action Games as Experimental Paradigms for Cognitive Science , 2017, Top. Cogn. Sci..