The Sensorama Revisited: Evaluating the Application of Multi-sensory Input on the Sense of Presence in 360-Degree Immersive Film in Virtual Reality

It has been suggested that 360-degree immersive film viewed in virtual environments, does not allow for a sense of presence owing to the lack of interactivity, agency and realism. This paper outlines the findings of a research project to evaluate how such a sense of presence can be enabled through the introduction of multi-sensory input to the viewing experience. Using an original 360-degree film that was shot in Hong Kong’s Chungking Mansions as a basis for research, this paper interrogates Ryan’s assertion that Virtual Reality (VR) that combines interactivity, immersion and narrativity is an example of the “total art” that VR producers need to aspire to. By adding changes in heat and scent to the viewing experience, the extent to which those sensory stimuli, which would not normally be part of a viewing experience, lead to an increased feeling of presence is evaluated. In doing so, we suggest that the viewing experience may not need all three elements of total art to be equivalent in order for a meaningful viewing experience to occur.

[1]  Robert S. Allison,et al.  Personal Space in Virtual Reality , 2003, TAP.

[2]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[3]  M. Slater,et al.  Illusory ownership of a virtual child body causes overestimation of object sizes and implicit attitude changes , 2013, Proceedings of the National Academy of Sciences.

[4]  Kaarina Nikunen.  Media, passion and humanitarian reality television , 2016 .

[5]  B. Höijer.  The Discourse of Global Compassion: The Audience and Media Reporting of Human Suffering , 2004 .

[6]  Gerardo Chowell,et al.  Climate change and influenza: the likelihood of early and severe influenza seasons following warmer than average winters , 2013, PLoS currents.

[7]  Florian Jentsch,et al.  Olfactory Stimuli Increase Presence in Virtual Environments , 2016, PloS one.

[8]  Katsunori Matsuoka,et al.  Autonomic responses during motion sickness induced by virtual reality. , 2007, Auris, nasus, larynx.

[9]  Marie-Laure Ryan,et al.  Narrative as Virtual Reality 2: Revisiting Immersion and Interactivity in Literature and Electronic Media , 2015 .

[10]  Ken Pimentel,et al.  Virtual reality - through the new looking glass , 1993 .

[11]  Mort Heilig,et al.  Beginnings: Sensorama and the Telesphere Mask , 1998 .

[12]  Catherine Bouko.  Identity, otherness and the virtual double , 2011 .

[13]  Peter Otto.  Between the Virtual and the Actual: Robert Barker's Panorama of London and the Multiplication of the Real in late eighteenth-century London , 2007 .

[14]  Edbert B. Hsu,et al.  State of Virtual Reality Based Disaster Preparedness and Response Training , 2013, PLoS currents.

[15]  Shu-Sheng Liaw,et al.  Investigating learners' attitudes toward virtual reality learning environments: Based on a constructivist approach , 2010, Comput. Educ..

[16]  Roger Burrows,et al.  Cyberspace/Cyberbodies/Cyberpunk: Cultures of Technological Embodiment , 1995 .

[17]  Jeremy N. Bailenson,et al.  Equilibrium Theory Revisited: Mutual Gaze and Personal Space in Virtual Environments , 2001, Presence: Teleoperators & Virtual Environments.

[18]  G. Mathews.  Ghetto at the Center of the World: Chungking Mansions, Hong Kong , 2011 .

[19]  Naëm Baron,et al.  How incorporation of scents could enhance immersive virtual experiences , 2014, Front. Psychol..

[20]  Marie-Laure Ryan.  Immersion vs. Interactivity: Virtual Reality and Literary Theory , 1999 .

[21]  Myron W Krueger.  Addition of Olfactory Stimuli to Virtual Reality Simulations for Medical Training Applications , 1996 .

[22]  Sarah Jones,et al.  Disrupting the narrative: immersive journalism in virtual reality , 2017 .

[23]  W. Uricchio.  A ‘proper point of view’: The panorama and some of its early media iterations , 2011 .

[24]  Mel Slater,et al.  A method for generating an illusion of backwards time travel using immersive virtual reality—an exploratory study , 2014, Front. Psychol..

[25]  M. Reiner.  Presence: Brain, virtual reality and robots , 2011, Brain Research Bulletin.

[26]  Mel Slater,et al.  Immersive Journalism: Immersive Virtual Reality for the First-Person Experience of News , 2010, PRESENCE: Teleoperators and Virtual Environments.

[27]  Ajay Heble,et al.  Theory of the Dérive , 2014 .

[28]  Mel Slater,et al.  First-Person Perspective Virtual Body Posture Influences Stress: A Virtual Reality Body Ownership Study , 2016, PloS one.

[29]  Edward T. Hall,et al.  A System for the Notation of Proxemic Behavior1 , 1963 .