Game postmortems vs. developer Reddit AMAs: computational analysis of developer communication

Postmortems and Reddit Ask Me Anything (AMA) threads represent communications of game developers through two different channels about their game development experiences, culture, processes, and practices. We carry out a quantitative text mining based comprehensive analysis of online available postmortems and AMA threads from game developers over multiple years. We find and analyze underlying topics from the postmortems and AMAs as well as their variation among the data sources and over time. The analysis is done based on structural topic modeling, a probabilistic modeling technique for text mining. The extracted topics reveal differing and common interests as well as their evolution of prevalence over time in the two text sources. We have found that postmortems put more emphasis on detail-oriented development aspects as well as technically-oriented game design problems whereas AMAs feature a wider variety of discussion topics that are related to a more general game development process, game-play and game-play experience related game design. The prevalences of the topics also evolve differently over time in postmortems versus AMAs.

[1]  Jyrki Nummenmaa,et al.  Tree-Structured Hierarchical Dirichlet Process , 2018, DCAI.

[2]  Ali Faisal,et al.  Establishing Video Game Genres Using Data-Driven Modeling and Product Databases , 2018, Games Cult..

[3]  Edoardo M. Airoldi,et al.  Summarizing topical content with word frequency and exclusivity , 2012, ICML 2012.

[4]  Marcelo Soares Pimenta,et al.  What went wrong? A survey of problems in game development , 2009, CIE.

[5]  Charles R. Shipan,et al.  The Diffusion of Policy Perceptions: Evidence from a Structural Topic Model , 2016 .

[6]  Kelly Bergstrom,et al.  "Don't feed the troll": Shutting down debate about community expectations on Reddit.com , 2011, First Monday.

[7]  Marcelo Soares Pimenta,et al.  Is agility out there?: agile practices in game development , 2010, SIGDOC '10.

[8]  Annakaisa Kultima.  Developers' perspectives on iteration in game development , 2015, MindTrek.

[9]  Christian Bird,et al.  "What Went Right and What Went Wrong": An Analysis of 155 Postmortems from Game Development , 2016, 2016 IEEE/ACM 38th International Conference on Software Engineering Companion (ICSE-C).

[10]  Emerson R. Murphy-Hill,et al.  Cowboys, ankle sprains, and keepers of quality: how is video game development different from software development? , 2014, ICSE.

[11]  Jyrki Nummenmaa,et al.  Author Tree-Structured Hierarchical Dirichlet Process , 2018, DS.

[12]  Panos E. Kourouthanassis,et al.  Flying to Quality: Cultural Influences on Online Reviews , 2019 .

[13]  Matthew B. Miles,et al.  Qualitative Data Analysis: An Expanded Sourcebook , 1994 .

[14]  Margaret E. Roberts,et al.  A Model of Text for Experimentation in the Social Sciences , 2016 .

[15]  Jaakko Peltonen,et al.  Transfer learning using a nonparametric sparse topic model , 2013, Neurocomputing.

[16]  Andrew McCallum,et al.  Optimizing Semantic Coherence in Topic Models , 2011, EMNLP.

[17]  M. Engle.  Book Review: Qualitative Data Analysis: An Expanded Sourcebook (2nd Ed.) , 1999 .

[18]  Maria Palacin-Silva,et al.  What Concerns Game Developers? A Study on Game Development Processes, Sustainability and Metrics , 2017, 2017 IEEE/ACM 8th Workshop on Emerging Trends in Software Metrics (WETSoM).

[19]  F. Ted Tschang,et al.  Balancing the Tensions Between Rationalization and Creativity in the Video Games Industry , 2007, Organ. Sci..

[20]  J. Farrell.  Corporate funding and ideological polarization about climate change , 2015, Proceedings of the National Academy of Sciences.