Being There in the Midst of the Story: How Immersive Journalism Affects Our Perceptions and Cognitions

Immersive journalism in the form of virtual reality (VR) headsets and 360°-video is becoming more mainstream and is much touted for inducing greater "presence" than traditional text. But, does this presence influence psychological outcomes of reading news, such as memory for story content, perceptions of credibility, and empathy felt toward story characters? We propose that two key technological affordances of VR (modality and interactivity) are responsible for triggering three presence-related cognitive heuristics (being-there, interaction, and realism), which influence news readers' memory and their perceptions of credibility, empathy, and story-sharing intentions. We report a 3 (storytelling medium: VR vs. 360°-video vs. Text) × 2 (story: "The displaced" and "The click effect") mixed-factorial experiment, in which participants (N = 129) experienced two New York Times stories (that differed in their emotional intensity) using one of the three mediums (VR, 360°-video, Text). Participants who experienced the stories using VR and 360°-video outperformed those who read the same stories using text with pictures, not only on such presence-related outcomes as being-there, interaction, and realism, but also on perceived source credibility, story-sharing intention, and feelings of empathy. Moreover, we found that senses of being-there, interaction, and realism mediated the relationship between storytelling medium and reader perceptions of credibility, story recall, and story-sharing intention. These findings have theoretical implications for the psychology of virtual reality, and practical applications for immersive journalism in particular and interactive media in general.

[1]  Paul D. Bolls,et al.  The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements , 2001, Commun. Res..

[2]  Cagatay Basdogan,et al.  An Experiment on the Influence of Haptic Communication on the Sense of Being Together , 1998 .

[3]  Wei Peng,et al.  Effects of screen size, viewing angle, and players' immersion tendencies on game experience , 2012, Comput. Hum. Behav..

[4]  Rick H Hoyle,et al.  Differential predictability of four dimensions of affect intensity , 2012, Cognition & emotion.

[5]  Frank Biocca,et al.  Telepresence via Television: Two Dimensions of Telepresence May Have Different Connections to Memory and Persuasion , 2006, J. Comput. Mediat. Commun..

[6]  Cade McCall,et al.  What Can Virtual Reality Teach Us About Prosocial Tendencies in Real and Virtual Environments? , 2008 .

[7]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[8]  Mark H. Davis,et al.  A Multidimensional Approach to Individual Differences in Empathy , 1980 .

[9]  Giuseppe Riva,et al.  May I experience more presence in doing the same thing in virtual reality than in reality? An answer from a simulated job interview , 2012, Interact. Comput..

[10]  Kristopher J Preacher,et al.  Statistical mediation analysis with a multicategorical independent variable. , 2014, The British journal of mathematical and statistical psychology.

[11]  Béatrice S. Hasler,et al.  Virtual Peacemakers: Mimicry Increases Empathy in Simulated Contact with Virtual Outgroup Members , 2014, Cyberpsychology Behav. Soc. Netw..

[12]  Mariano Alcañiz Raya,et al.  Affective Interactions Using Virtual Reality: The Link between Presence and Emotions , 2007, Cyberpsychology Behav. Soc. Netw..

[13]  G. Riva,et al.  Being Present in a Virtual World , 2014 .

[14]  Turo Uskali,et al.  Virtual Reality Journalism , 2019, The International Encyclopedia of Journalism Studies.

[15]  Ji Young Lee,et al.  To Tweet or to Retweet? That Is the Question for Health Professionals on Twitter , 2013, Health communication.

[16]  S. Sundar,et al.  Multimedia Effects on Processing and Perception of Online News: A Study of Picture, Audio, and Video Downloads , 2000 .

[17]  Giuseppe Riva,et al.  Virtual reality vs television vs web exposure: The impact on brand experience. A preliminary study , 2016 .

[18]  J. Russell,et al.  The circumplex model of affect: An integrative approach to affective neuroscience, cognitive development, and psychopathology , 2005, Development and Psychopathology.

[19]  Shyam Sundar,et al.  A Cognitive-Heuristics Approach to Understanding Presence in Virtual Environments , 2008 .

[20]  Annie Lang,et al.  The limited capacity model of mediated message processing , 2000 .

[21]  Jonathan Steuer,et al.  Defining virtual reality: dimensions determining telepresence , 1992 .

[22]  Eva Lindh Waterworth,et al.  Altered, expanded and distributed embodiment : the three stages of interactive presence , 2014 .

[23]  Henry Been-Lirn Duh,et al.  Effects of field of view on presence, enjoyment, memory, and simulator sickness in a virtual environment , 2002, Proceedings IEEE Virtual Reality 2002.

[24]  Erik P. Bucy.  The Interactivity Paradox: Closer to the News but Confused , 2003 .

[25]  Jeremy N. Bailenson,et al.  Virtual Experiences, Physical Behaviors: The Effect of Presence on Imitation of an Eating Avatar , 2009, PRESENCE: Teleoperators and Virtual Environments.

[26]  J. Bailenson,et al.  Comparing Behavioral and Self-Report Measures of Embodied Agents' Social Presence in Immersive Virtual Environments , 2004 .

[27]  Dianne M. Murray,et al.  5 Presence and Hyperpresence: Implications for Community Awareness , 2014 .

[28]  Giuseppe Riva,et al.  The Role of Immersion and Narrative in Mediated Presence: The Virtual Hospital Experience , 2011, Cyberpsychology Behav. Soc. Netw..

[29]  Mel Slater,et al.  A Framework for Immersive Virtual Environments (FIVE): Speculations on the Role of Presence in Virtual Environments , 1997, Presence: Teleoperators & Virtual Environments.

[30]  Concepción Perpiñá,et al.  Presence and Reality Judgment in Virtual Environments: A Unitary Construct? , 2000, Cyberpsychology Behav. Soc. Netw..

[31]  G. Riva.  The neuroscience of body memory: From the self through the space to the others , 2017, Cortex.

[32]  S. Sundar.  The MAIN Model : A Heuristic Approach to Understanding Technology Effects on Credibility , 2007 .

[33]  Stan Ketterer.  Links Engage Readers of Online Crime Stories , 2001 .

[34]  Jun Ye,et al.  Enhancing empathy instruction using a collaborative virtual learning environment for children with autistic spectrum conditions , 2010, Comput. Educ..

[35]  Paul Skalski,et al.  Image versus Sound: A Comparison of Formal Feature Effects on Presence and Video Game Enjoyment , 2010, PsychNology J..

[36]  Mel Slater,et al.  Immersive Journalism: Immersive Virtual Reality for the First-Person Experience of News , 2010, PRESENCE: Teleoperators and Virtual Environments.

[37]  G. Riva,et al.  Extending the self through the tools and the others: A general framework for presence and social presence in mediated interactions , 2014 .

[38]  Christoph Klimmt,et al.  A Process Model of the Formation of Spatial Presence Experiences , 2007 .

[39]  Jerold L. Hale,et al.  Validation and measurement of the fundamental themes of relational communication , 1987 .

[40]  Anthony M. Limperos,et al.  Uses and Grats 2.0: New Gratifications for New Media , 2013 .

[41]  C. Daniel Batson,et al.  Is Empathy-Induced Helping Due to Self–Other Merging? , 1997 .

[42]  Annie Lang,et al.  The effects of production pacing and arousing content on the information processing of television messages , 1999 .