Evaluating musical foreshadowing of videogame narrative experiences

We experiment with mood-expressing, procedurally generated music for narrative foreshadowing in videogames, investigating the relationship between music and the player's experience of narrative events in a game. We designed and conducted a user study in which the game's music expresses true foreshadowing in some trials (e.g. foreboding music before a negative event) and false foreshadowing in others (e.g. happy music that does not lead to a positive event). We observed players playing the game, recorded analytics data, and had them complete a survey upon completion of the gameplay. Thirty undergraduate and graduate students participated in the study. Statistical analyses suggest that the use of musical cues for narrative foreshadowing induces a better perceived consistency between music and game narrative. Surprisingly, false foreshadowing was found to enhance the player's enjoyment.

[1]  R. Thayer The biopsychology of mood and arousal , 1989 .

[2]  J. Russell A circumplex model of affect. , 1980 .

[3]  Robert Michael Young,et al.  A Use of Flashback and Foreshadowing for Surprise Arousal in Narrative Using a Plan-Based Approach , 2008, ICIDS.

[4]  David Birchfield,et al.  Generative model for the creation of musical emotion, meaning, and form , 2003, ETP '03.

[5]  Julian Togelius,et al.  Procedural Content Generation in Games , 2016, Computational Synthesis and Creative Systems.

[6]  R. Lazarus Emotion and Adaptation , 1991 .

[7]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[8]  Federico Peinado,et al.  Minstrel Reloaded: From the Magic of Lisp to the Formal Semantics of OWL , 2006, TIDSE.

[9]  Daniel Lankford Brown,et al.  Mezzo: An Adaptive, Real-Time Composition Program for Game Soundtracks , 2021, MUME@AIIDE.

[10]  Marco Scirea Mood Dependent Music Generator , 2013, Advances in Computer Entertainment.

[11]  Roland Barthes,et al.  S/Z : バルザック「サラジーヌ」の構造分析 , 1973 .

[12]  Benjamin D. Smith,et al.  Improvising Musical Structure with Hierarchical Neural Nets , 2012, MUME@AIIDE.

[13]  U. Ott,et al.  Using music to induce emotions: Influences of musical preference and absorption , 2008 .

[14]  Byung-Chull Bae,et al.  EXPRESSION IN REAL-TIME COMPUTER GENERATED MUSIC USING PURE DATA , 2014 .

[15]  R. Likert “Technique for the Measurement of Attitudes, A” , 2022, The SAGE Encyclopedia of Research Design.

[16]  A. Cohen Music as a source of emotion in film , 2001 .

[17]  G. Genette,et al.  Narrative Discourse, an Essay in Method. , 1980 .

[18]  Roberto Bresin,et al.  “Expressivity comes from within your soul”: A questionnaire study of music students' perspectives on expressivity , 2003 .

[19]  M Boltz,et al.  Effects of background music on the remembering of filmed events , 1991, Memory & cognition.

[20]  G. Genette,et al.  Narrative discourse : an essay in method , 1980 .

[21]  Ben Houge Cell-based Music Organization in Tom Clancy's EndWar , 2012 .

[22]  P. Terry,et al.  Distinctions between emotion and mood , 2005 .

[23]  Andrew R. Brown,et al.  A framework for comparison of process in algorithmic music systems , 2005 .

[24]  P. Hayward Terror Tracks: Music, Sound and Horror Cinema , 2009 .

[25]  S. Chatman,et al.  Story and Discourse: Narrative Structure in Fiction and Film , 1979 .

[26]  C. Brewin Cognitive change processes in psychotherapy. , 1989, Psychological review.

[27]  Seiji Inokuchi,et al.  Sentiment extraction in music , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[28]  Gregory A Petsko,et al.  The walking dead , 2011, Genome Biology.

[29]  L. L. Shaw,et al.  Differentiating affect, mood, and emotion: Toward functionally based conceptual distinctions. , 1992 .

[30]  J. Lerner,et al.  Beyond valence: Toward a model of emotion-specific influences on judgement and choice , 2000 .

[31]  Brett A. S. Martin The influence of gender on mood effects in advertising , 2003 .

[32]  Andrew R. Brown,et al.  Dynamic response: real-time adaptation for music emotion , 2005 .

[33]  Mikael Fridenfalk,et al.  The soundtrack of your mind: mind music - adaptive audio for game characters , 2006, ACE '06.