On the desire to not kill your players: Rethinking sound in pervasive and mixed reality games

A commonly encountered argument for using sound in games is that sound increases the sense of immersion of a game. Immersion refers to an experience of being drawn into the game world, a process is centrally dependent on the players’ simultaneous removal from everyday life also called disassociation. The immersive power of sound has been linked to its capacity to disassociate: to transport the player into a virtual reality which feels more real, more plausible and more consequential than his/ her real physical surroundings, which is problematic especially for in mixed-reality and pervasive gaming. This paper draws on literature to trace exactly how sound contributes to immersion, and proposes how sound design can create immersion without disassociation. It also identifies engaging aesthetic opportunities that require non-immersive sound, which are currently being overlooked because of the assumption that good sound needs to be immersive.

[1]  Frans Mäyrä,et al.  Fundamental Components of the Gameplay Experience: Analysing Immersion , 2005, DiGRA Conference.

[2]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[3]  Thomas B. Sheridan Further Musings on the Psychophysics of Presence , 1996, Presence: Teleoperators & Virtual Environments.

[4]  D. Västfjäll,et al.  Emotional responses to music: the need to consider underlying mechanisms. , 2008, The Behavioral and brain sciences.

[5]  Frauke Behrendt,et al.  The sound of locative media , 2012 .

[6]  T. Lavender,et al.  Portable Presence : Can Mobile Games Be Immersive Games ? , 2012 .

[7]  Mats Liljedahl Sound for Fantasy and Freedom , 2011 .

[8]  Clarisse Sieckenius de Souza,et al.  An exploratory study on non-visual mobile phone interfaces for games , 2008, IHC.

[9]  R. Day Remediation: Understanding new media , 1999 .

[10]  Tapio Lokki,et al.  A mobile augmented reality audio system with binaural microphones , 2011, IwS '11.

[11]  Karen Collins,et al.  Game Sound: An Introduction to the History, Theory, and Practice of Video Game Music and Sound Design , 2008 .

[12]  Álvaro Barbosa,et al.  Murky shooting: the use of auditory (non-speech) feedback on mobile audiogames , 2012, AM '12.

[13]  Bernard Perron,et al.  The Video Game Theory Reader 2 , 2003 .

[14]  Tapio Lokki,et al.  Augmented reality audio for mobile and wearable appliances , 2004 .

[15]  J. Marshall,et al.  Sonic Pleasure, Absence and the History of the Self: An Alternative Approach to the Criticism of Sound Art , 2011 .

[16]  Mark Grimshaw,et al.  Sound And Immersion In The First-Person Shooter , 2007, Int. J. Intell. Games Simul..

[17]  Kenton O'Hara,et al.  Participation, collaboration and spectatorship in an alternate reality game , 2008, OZCHI '08.

[18]  Paul Doornbusch,et al.  Presence and Sound; Identifying Sonic Means to "Be there". , 2004 .

[19]  Stuart Cunningham,et al.  Game Sound Technology and Player Interaction : Concepts and Developments , 2013 .

[20]  Josephine Reid,et al.  Design for coincidence: incorporating real world artifacts in location based games , 2008, DIMEA.

[21]  Petri Lankoski,et al.  Character-driven game design : a design approach and its foundations in character engagement , 2010 .

[22]  Peta Wyeth,et al.  GameFlow: a model for evaluating player enjoyment in games , 2005, CIE.

[23]  Annika Wærn,et al.  The three-sixty illusion: designing for immersion in pervasive games , 2009, CHI.

[24]  Rod McCall,et al.  Using presence to evaluate an augmented reality location aware game , 2010, Personal and Ubiquitous Computing.

[25]  Cesar Ojeda,et al.  A Model of Immersion to Guide the Design of Serious Games , 2008 .

[26]  J. Cutting The Reality of Illusion: An Ecological Approach to Cognitive Film Theory , 1999 .

[27]  Joe Marshall,et al.  Ubikequitous computing: designing interactive experiences for cyclists , 2009, Mobile HCI.

[28]  Frauke Behrendt Mobile sound: media art in hybrid spaces , 2010 .

[29]  Mike Fraser,et al.  Using actuated devices in location-aware systems , 2008, Tangible and Embedded Interaction.

[30]  M. Grimshaw,et al.  Game Sound Technology and Player Interaction: Concepts and Developments , 2010 .

[31]  Regan L. Mandryk,et al.  Hearing is believing: evaluating ambient audio for location-based games , 2011, Advances in Computer Entertainment Technology.

[32]  Mads Haahr,et al.  Design, implementation and evaluation of audio for a location aware augmented reality game , 2010, Fun and Games '10.

[33]  Daniel Hug,et al.  New Wine in New Skins: Sketching the Future of Game Sound Design , 2011 .

[34]  Kirsten Cater,et al.  An investigation into the use of spatialised sound in locative games , 2007, CHI Extended Abstracts.

[35]  Mads Haahr,et al.  Location Aware Interactive Game Audio , 2011 .

[36]  Noriko Tomuro,et al.  The aesthetics of gameplay: a lexical approach , 2010, MindTrek.

[37]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.

[38]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[39]  Carl Machover,et al.  Virtual reality , 1994, IEEE Computer Graphics and Applications.

[40]  P. Humphreys Convergence: The Journal of Research into New Media Technologies , 2002 .

[41]  Frans Mäyrä,et al.  Designing sound for a pervasive mobile game , 2005, ACE '05.

[42]  Liselott Brunnberg,et al.  Believable environments: generating interactive storytelling in vast location-based pervasive games , 2006, ACE '06.

[43]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[44]  J. Sloboda,et al.  Music and emotion: Theory and research , 2001 .

[45]  Annika Wærn,et al.  Play it for Real: Sustained Seamless Life/Game Merger in Momentum , 2007, DiGRA Conference.

[46]  Duncan Rowland,et al.  Interweaving mobile games with everyday life , 2006, CHI.

[47]  Gordon Calleja,et al.  Revising Immersion: A Conceptual Model for the Analysis of Digital Game Involvement , 2007, DiGRA Conference.

[48]  David Benyon,et al.  Presence in blended spaces , 2012, Interact. Comput..

[49]  Sarah Mount,et al.  Sensorium games: usability considerations for pervasive gaming , 2005, SIGDOC '05.

[50]  JegersKalle Pervasive game flow , 2007 .

[51]  Richard D. Sanders,et al.  The effect of sound delivery methods on a user's sense of presence in a virtual environment , 2002 .

[52]  A. Cohen Music as a source of emotion in film , 2001 .