Spatial Perception and Cognition in Multichannel Audio for Electroacoustic Music

Listeners experience electroacoustic music as full of significance and meaning, and they experience spatiality as one of the factors contributing to its meaningfulness. If we want to understand spatiality in electroacoustic music, we must understand how the listener’s mental processes give rise to the experience of meaning. In electroacoustic music as in everyday life, these mental processes unite the peripheral auditory system with human spatial cognition. In the discussion that follows we consider a range of the listener’s mental processes relating space and meaning from the perceptual attributes of spatial imagery to the spatial reference frames for places and navigation. When considering multichannel loudspeaker systems in particular, an important part of the discussion is focused on the distinctive and idiomatic ways in which this particular mode of sound production contributes to and situates meaning. These include the phenomenon of image dispersion, the important consequences of the precedence effect and the influence of source characteristics on spatial imagery. These are discussed in close relation to the practicalities of artistic practice and to the potential for artistic meaning experienced by the listener.

[1]  G. Kendall Meaning in Electroacoustic Music and the Everyday Mind , 2010, Organised Sound.

[2]  Jens Blauert,et al.  Irregularities in the Precedence Effect , 1992 .

[3]  Jonty Harrison Sound, space, sculpture: some thoughts on the ‘what’, ‘how’ and ‘why’ of sound diffusion , 1998 .

[4]  Simon Emmerson Aural landscape: musical space , 1998, Organised Sound.

[5]  Jonas Braasch,et al.  The precedence effect for noise bursts of different bandwidths. I. Psychoacoustical data , 2003 .

[6]  P. Jeffrey Bloom,et al.  Creating Source Elevation Illusions by Spectral Manipulation , 1976 .

[7]  Barbara Tversky,et al.  Cognitive Maps, Cognitive Collages, and Spatial Mental Models , 1993, COSIT.

[8]  Georg Plenge,et al.  Localization of Lateral Phantom Sources , 1976 .

[9]  Francis Rumsey,et al.  Localization Curves for a Regularly-Spaced Octagon Loudspeaker Array , 2009 .

[10]  C. Thinus-Blanc,et al.  Representation of space in blind persons: vision as a spatial sense? , 1997, Psychological bulletin.

[11]  Nick Zacharov,et al.  Unraveling the perception of spatial sound reproduction: Techniques and experimental design , 2001 .

[12]  Richard Toop,et al.  Stockhausen's electronic works; sketches and work‐sheets from 1952–1967 , 1981 .

[13]  Francis Rumsey,et al.  Systematic Evaluation of Perceived Spatial Quality , 2003 .

[14]  Wieslaw Woszczyk,et al.  Sound Source Localization in a Five-Channel Surround Sound Reproduction System , 1999 .

[15]  Christian Clozier The Gmebaphone Concept and the Cybernphone Instrument , 2001, Computer Music Journal.

[16]  Gary S. Kendall,et al.  WHAT IS AN EVENT? The EVENT Schema, Circumstances, Metaphor And Gist , 2008, ICMC.

[17]  Daniel Teruggi Technology and musique concrète: The technical developments of the groupe de recherches musicales and their implication in musical composition , 2007 .

[18]  W. Hartmann Localization of sound in rooms. , 1983, The Journal of the Acoustical Society of America.

[19]  H. Gaskell The precedence effect , 1983, Hearing Research.

[20]  W M Hartmann,et al.  Localization of sound in rooms. IV: The Franssen effect. , 1989, The Journal of the Acoustical Society of America.

[21]  Francis Rumsey,et al.  Spatial quality evaluation for reproduced sound: terminology, meaning and a scene-based paradigm , 2002 .

[22]  Évelyne Gayou,et al.  The GRM: landmarks on a historic route , 2007, Organised Sound.

[23]  B. Tversky,et al.  Perspective in Spatial Descriptions , 1996 .

[24]  Tomlinson Holman Surround Sound: Up and running , 2007 .

[25]  Michael Alcorn,et al.  A Study into the perception of envelopment in Electroacoustic Music , 2008, ICMC.

[26]  Marc Treib Space Calculated in Seconds: The Philips Pavilion, Le Corbusier, Edgard Varèse , 1996 .

[27]  Jie Huang,et al.  The Precedence Effect of Sound from Side Direction , 2007 .

[28]  Denis Smalley,et al.  Space-form and the acousmatic image , 2007, Organised Sound.

[29]  Robert A. Wilson,et al.  The Cambridge Handbook of Situated Cognition: How to Situate Cognition , 2008 .

[30]  G. Lakoff Philosophy in the flesh , 1999 .

[31]  J Blauert,et al.  Localization and the law of the first wavefront in the median plane. , 1971, The Journal of the Acoustical Society of America.

[32]  Barbara Tversky,et al.  The Cambridge Handbook of Situated Cognition: Spatial Cognition , 2008 .

[33]  R. Butler,et al.  Localization of tonal stimuli in the vertical plane. , 1968, The Journal of the Acoustical Society of America.

[34]  William M. Hartmann,et al.  Localization of sound in rooms. , 1982, The Journal of the Acoustical Society of America.

[35]  R. Butler,et al.  Factors that influence the localization of sound in the vertical plane. , 1968, The Journal of the Acoustical Society of America.

[36]  Gary S. Kendall The Artistic Play of Spatial Organization: Spatial Attributes, Scene Analysis and auditory Spatial Schemata , 2007, ICMC.

[37]  W. Hartmann,et al.  Localization of sound in rooms, III: Onset and duration effects. , 1986, The Journal of the Acoustical Society of America.

[38]  Rudolf Susnik,et al.  Coding of Elevation in Acoustic Image of Space , 2005 .

[39]  George Lakoff,et al.  Women, Fire, and Dangerous Things , 1987 .

[40]  N. Presmeg The body in the mind: The bodily basis of meaning, imagination and reason , 1992 .

[41]  T Z Strybel,et al.  Conditions under which the Haas precedence effect may or may not occur. , 1987, The Journal of auditory research.

[42]  D. Etlinger A musically motivated approach to spatial audio for large venues , 2009 .

[43]  Gary S. Kendall,et al.  The Decorrelation of Audio Signals and Its Impact on Spatial Imagery , 1995 .