Audio Drama and the Imagination

Presence describes immersion in a mediated environment such that it seems unmediated. For people with visual impairment, audio description replaces missing visual information with a verbal commentary, transforming an audiovisual medium into audio. Media forms are more or less immersive, with audio-only at the bottom of the scale. Anecdotally, however, pictures are said to be better on radio. Sound effects may contribute by triggering vivid mental images. Yet the role of sound effects on presence has been little explored. The aim of this study was to test the influence of sound effects and visual experience on presence. Participants (N = 73) with full, some, or no sight reported presence levels for a scene from an audio drama presented with or without sound effects. Participants with full vision reported higher levels of ecological and spatial presence for dialogue and sound effects than for dialogue alone. For participants with impaired vision, sound effects made no significant difference to presence leve...

[1]  Louise Fryer,et al.  Audio description as audio drama – a practitioner's point of view , 2010 .

[2]  D. Rubin,et al.  Imagery and retrieval of auditory and visual information: Neural correlates of successful and unsuccessful performance , 2011, Neuropsychologia.

[3]  J. Murray.  Hamlet on the Holodeck , 1997 .

[4]  Jonathan Freeman,et al.  A Cross-Media Presence Questionnaire: The ITC-Sense of Presence Inventory , 2001, Presence: Teleoperators & Virtual Environments.

[5]  Philip J. Piety.  The Language System of Audio Description: An Investigation as a Discursive Process , 2004 .

[6]  R. Saxe,et al.  Language processing in the occipital cortex of congenitally blind adults , 2011, Proceedings of the National Academy of Sciences.

[7]  James R. Marston,et al.  Cognitive load of navigating without vision when guided by virtual sound versus spatial language. , 2006, Journal of experimental psychology. Applied.

[8]  Mel Slater,et al.  Representations Systems, Perceptual Position, and Presence in Immersive Virtual Environments , 1993, Presence: Teleoperators & Virtual Environments.

[9]  Matthew Lombard,et al.  At the Heart of It All: The Concept of Presence , 2006 .

[10]  Paul D. Bolls,et al.  I Can Hear You, but Can I See You? , 2002, Commun. Res..

[11]  Lawrence J. Marks,et al.  Mental Imagery and Sound Effects in Radio Commercials , 1992 .

[12]  Tim Crook,et al.  Radio drama : theory and practice , 1999 .

[13]  Jonathan Freeman,et al.  Cinematic language and the description of film: keeping AD users in the frame , 2013 .

[14]  E. Antôn,et al.  See it on a radio story: sound effects and shots to evoked imagery and attention on audio fiction , 2012 .

[15]  F. Rösler,et al.  Event-related potentials during auditory language processing in congenitally blind and sighted people , 2000, Neuropsychologia.

[16]  Emma Rodero,et al.  See It on a Radio Story , 2012, Commun. Res..

[17]  E. Peli,et al.  Evaluating Visual Information Provided by Audio Description , 1996 .

[18]  Paul Skalski,et al.  Image versus Sound: A Comparison of Formal Feature Effects on Presence and Video Game Enjoyment , 2010, PsychNology J..

[19]  Wijnand A. IJsselsteijn,et al.  Effects of Sensory Information and Prior Experience on Direct Subjective Ratings of Presence , 1999, Presence: Teleoperators & Virtual Environments.

[20]  Naomi B. Pitskel,et al.  Rapid and Reversible Recruitment of Early Visual Cortex for Touch , 2008, PloS one.

[21]  David C. Reutens,et al.  Early but not late-blindness leads to enhanced auditory perception , 2010, Neuropsychologia.

[22]  Andrew J. King.  Development of Multisensory Spatial Integration , 2004 .

[23]  Woodrow Barfield,et al.  Presence and performance within virtual environments , 1995 .

[24]  R. Zatorre,et al.  Crossmodal recruitment of primary visual cortex following brief exposure to bimodal audiovisual stimuli , 2010, Neuropsychologia.

[25]  Á. Pascual-Leone,et al.  The metamodal organization of the brain. , 2001, Progress in brain research.

[26]  Sandra Pauletto,et al.  The Design of an Audio Film: Portraying Story, Action and Interaction through Sound , 2009 .

[27]  Thomas B. Sheridan,et al.  Musings on Telepresence and Virtual Presence , 1992, Presence: Teleoperators & Virtual Environments.