Towards Automated Let's Play Commentary

We introduce the problem of generating Let's Play-style commentary of gameplay video via machine learning. We propose an analysis of Let's Play commentary and a framework for building such a system. To test this framework we build an initial, naive implementation, which we use to interrogate the assumptions of the framework. We demonstrate promising results towards future Let's Play commentary generation.

[1]  Ehud Reiter,et al.  Book Reviews: Building Natural Language Generation Systems , 2000, CL.

[2]  Vadim Bulitko,et al.  Automated Story Selection for Color Commentary in Sports , 2014, IEEE Transactions on Computational Intelligence and AI in Games.

[3]  Eric Jones,et al.  SciPy: Open Source Scientific Tools for Python , 2001 .

[4]  Margaret M. Burnett,et al.  How the Experts Do It: Assessing and Explaining Agent Behaviors in Real-Time Strategy Games , 2017, CHI.

[5]  D. Pham,et al.  Selection of K in K-means clustering , 2005 .

[6]  Joseph Macey,et al.  Content structure is king: An empirical study on gratifications, game genres and content type on Twitch , 2017, Comput. Hum. Behav..

[7]  Julian Togelius,et al.  Procedural Content Generation via Machine Learning (PCGML) , 2017, IEEE Transactions on Games.

[8]  Somnath Sengupta,et al.  Event-Importance Based Customized and Automatic Cricket Highlight Generation , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[9]  Matthew Guzdial,et al.  Game Level Generation from Gameplay Videos , 2021, AIIDE.

[10]  Boyang Li,et al.  PlotShot: Generating Discourse-Constrained Stories Around Photos , 2016, AIIDE.

[11]  Antonín Slabý,et al.  Procedural Content Generation via Machine Learning in 2D Indoor Scene , 2020, AVR.

[12]  Andruid Kerne,et al.  Streaming on twitch: fostering participatory communities of play within live mixed media , 2014, CHI.

[13]  Mark O. Riedl,et al.  Rationalization: A Neural Machine Translation Approach to Generating Natural Language Explanations , 2017, AIES.

[14]  Heikki Mannila,et al.  Random projection in dimensionality reduction: applications to image and text data , 2001, KDD '01.

[15]  Nick J. Davis,et al.  Autonomous Sensory Meridian Response (ASMR): a flow-like mental state , 2015, PeerJ.

[16]  Juho Hamari,et al.  Why do people watch others play video games? An empirical study on the motivations of Twitch users , 2017, Comput. Hum. Behav..

[17]  Rogelio E. Cardona-Rivera,et al.  Bardic : Generating Multimedia Narrative Reports for Game Logs , 2017 .