Designed to Thrill: Exploring the Effects of Multimodal Feedback on Virtual World Immersion

The following paper presents research into the effects of multi- and uni- modal output on virtual immersion. It describes the implementation of a balanced experimental study designed to measure participant immersion in a variety of conditions and presents the resulting findings. These demonstrate the potential of primary and secondary modalities on the perception of the participants. The findings of the study can form part of the basis for a set of HCI guidelines for the creation of highly immersive digital experiences.

[1]  Frans Mäyrä,et al.  Fundamental Components of the Gameplay Experience: Analysing Immersion , 2005, DiGRA Conference.

[2]  Daniel Västfjäll,et al.  Better Presence and Performance in Virtual Environments by Improved Binaural Sound Rendering , 2002 .

[3]  Michele D. Dickey.  Engaging by design: How engagement strategies in popular computer and video games can inform instructional design , 2005 .

[4]  Tom Geller,et al.  Overcoming the Uncanny Valley , 2008, IEEE Computer Graphics and Applications.

[5]  Paul A. Cairns,et al.  A grounded investigation of game immersion , 2004, CHI EA '04.

[6]  William R. Sherman,et al.  Understanding Virtual RealityInterface, Application, and Design , 2002, Presence: Teleoperators & Virtual Environments.

[7]  Ernest Adams,et al.  Fundamentals of Game Design , 2006 .

[8]  Mark Reaney.  Virtual Reality and the Theatre: Immersion in Virtual Worlds , 1999, Digit. Creativity.

[9]  H. Bülthoff,et al.  Merging the senses into a robust percept , 2004, Trends in Cognitive Sciences.

[10]  Staffan Björk,et al.  Patterns In Game Design , 2004 .

[11]  Gareth Schott,et al.  Computer Games: Text, Narrative and Play , 2006 .

[12]  Lennart E. Nacke,et al.  Flow and immersion in first-person shooters: measuring the player's gameplay experience , 2008, Future Play.

[13]  Kazuhiko Kawamura,et al.  Uncanny valley revisited , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[14]  Marie-Laure Ryan.  Immersion vs. Interactivity: Virtual Reality and Literary Theory , 1999 .

[15]  Matthew Lombard,et al.  MEASURING PRESENCE: A LITERATURE-BASED APPROACH TO THE DEVELOPMENT OF A STANDARDIZED PAPER-AND-PENCIL INSTRUMENT , 2000 .

[16]  Paul A. Cairns,et al.  Measuring and defining the experience of immersion in games , 2008, Int. J. Hum. Comput. Stud..

[17]  Miguel A. L. Nicolelis,et al.  Brain–machine interfaces: past, present and future , 2006, Trends in Neurosciences.

[18]  E. Tan,et al.  The emotional and cognitive effect of immersion in film viewing , 2010 .

[19]  Laurie N. Taylor.  VIDEO GAMES: PERSPECTIVE, POINT-OF-VIEW, AND IMMERSION , 2002 .

[20]  Christopher B. Stapleton,et al.  Mixed Reality and Experiential Movie Trailers: Combining Emotions and Immersion to Innovate Entertainment Marketing , 2005 .

[21]  Chris Dede,et al.  Immersive Interfaces for Engagement and Learning , 2009, Science.

[22]  Julian Kücklich.  Literary Theory and Computer Games , 2013 .

[23]  Vasile Radu.  Stochastic Modeling of Thermal Fatigue Crack Growth , 2014 .

[24]  G. Priestnall,et al.  Learner immersion engagement in the 3D virtual world: principles emerging from the DELVE project , 2009 .

[25]  Karolien Poels,et al.  Characterising and measuring user experiences in digital games , 2007 .

[26]  A. McMahan.  Immersion, Engagement, and Presence: A Method for Analyzing 3-D Video Games , 2013 .

[27]  Lennart E. Nacke,et al.  From game design elements to gamefulness: defining "gamification" , 2011, MindTrek.

[28]  Noirin Curran,et al.  The psychology of immersion and development of a quantitative measure of immersive response in games , 2013 .

[29]  J. C. Flanagan.  Psychological Bulletin THE CRITICAL INCIDENT TECHNIQUE , 2022 .

[30]  S. Shimojo,et al.  Sensory modalities are not separate modalities: plasticity and interactions , 2001, Current Opinion in Neurobiology.

[31]  Katie Salen,et al.  Rules of play: game design fundamentals , 2003 .