Spatial Audio for Soundscape Design: Recording and Reproduction

With the advancement of spatial audio technologies, in both recording and reproduction, we are seeing more applications that incorporate 3D sound to create an immersive aural experience. Soundscape design and evaluation for urban planning can now tap into the extensive spatial audio tools for sound capture and 3D sound rendering over headphones and speaker arrays. In this paper, we outline a list of available state-of-the-art spatial audio recording techniques and devices, spatial audio physical and perceptual reproduction techniques, emerging spatial audio techniques for virtual and augmented reality, followed by a discussion on the degree of perceptual accuracy of recording and reproduction techniques in representing the acoustic environment.

[1]  Sascha Spors,et al.  The SoundScape Renderer: A Unified Spatial Audio Reproduction Framework for Arbitrary Rendering Methods , 2008 .

[2]  M. Vorländer,et al.  Past , Present and Future of Dummy Heads , 2004 .

[3]  Pyoung Jik Lee,et al.  Perceptual assessment of quality of urban soundscapes with combined noise sources and water sounds. , 2010, The Journal of the Acoustical Society of America.

[4]  Boaz Rafaely,et al.  Microphone Array Signal Processing , 2008 .

[5]  Renato S. Pellegrini,et al.  Quality assessment of auditory virtual environments , 2001 .

[6]  Jianjun He,et al.  Spatial Audio Reproduction with Primary Ambient Extraction , 2016 .

[7]  C. Guastavino.  The ideal urban soundscape : Investigating the sound quality of french cities , 2006 .

[8]  J. Kang,et al.  Sound Propagation in MicroScale Urban Areas : Simulation and Animation , 2003 .

[9]  Olivier Warusfel,et al.  Binaural and transaural spatialization techniques in multichannel 5.1 production (Anwendung binauraler und transauraler Wiedergabetechnik in der 5.1 Musikproduktion) , 2012 .

[10]  Massimiliano Masullo,et al.  The influence of visual characteristics of barriers on railway noise perception. , 2013, The Science of the total environment.

[11]  Bruce Bartlett,et al.  Practical Recording Techniques: The Step- by- Step Approach to Professional Audio Recording , 2005 .

[12]  Peter Fellgett,et al.  Ambisonics. Part one: General system description , 1975 .

[13]  Daniela D'Auria,et al.  A 3D Audio Augmented Reality System for a Cultural Heritage Management and Fruition , 2015 .

[14]  A. Lex Brown,et al.  A Review of Progress in Soundscapes and an Approach to Soundscape Planning , 2012 .

[15]  Jin Yong Jeon,et al.  Designing sound and visual components for enhancement of urban soundscapes. , 2013, The Journal of the Acoustical Society of America.

[16]  Woon-Seng Gan,et al.  Natural Listening over Headphones in Augmented Reality Using Adaptive Filtering Techniques , 2015, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[17]  William J. Davies,et al.  Development of a soundscape simulator tool , 2009 .

[18]  Yiying Hao,et al.  Assessment of the masking effects of birdsong on the road traffic noise environment. , 2016, The Journal of the Acoustical Society of America.

[19]  Ee-Leng Tan,et al.  Individualization of Binaural Synthesis Using Frontal Projection Headphones , 2013 .

[20]  J. Jeon,et al.  The effects of audio-visual factors on perceptions of environmental noise barrier performance , 2014 .

[21]  Timothy Van Renterghem,et al.  Measurement-based auralization methodology for the assessment of noise mitigation measures , 2016 .

[22]  Duane H. Cooper,et al.  Prospects for Transaural Recording , 1989 .

[23]  Jin Yong Jeon,et al.  Influence of urban contexts on soundscape perceptions: A structural equation modeling approach , 2015 .

[24]  Matti Karjalainen,et al.  AN AUGMENTED REALITY AUDIO HEADSET , 2008 .

[25]  Tapio Lokki,et al.  Augmented reality audio for mobile and wearable appliances , 2004 .

[26]  Mark Lindquist,et al.  Sensory Aspects of Simulation and Representation in Landscape and Environmental Planning: A Soundscape Perspective , 2014 .

[27]  Andra McCartney,et al.  Soundwalking and the Bodily Exploration of Places , 2012 .

[28]  Michael Vorlnder,et al.  Auralization: Fundamentals of Acoustics, Modelling, Simulation, Algorithms and Acoustic Virtual Reality , 2020 .

[29]  Stefan Weinzierl,et al.  Assessing the plausibility of virtual acoustic environments , 2012 .

[30]  Kirill V. Horoshenkov,et al.  The acoustic and visual factors influencing the construction of tranquil space in urban and rural environments tranquil spaces-quiet places? , 2008, The Journal of the Acoustical Society of America.

[31]  R. M. Schafer,et al.  The Soundscape: Our Sonic Environment and the Tuning of the World , 1993 .

[32]  Woon-Seng Gan,et al.  Fast Continuous Acquisition of HRTF for Human Subjects with Unconstrained Random Head Movements in Azimuth and Elevation , 2016 .

[33]  Bert De Coensel,et al.  The influence of traffic flow dynamics on urban soundscapes , 2005 .

[34]  Jason Freeman,et al.  Soundscape Composition and Field Recording as a Platform for Collaborative Creativity , 2011, Organised Sound.

[35]  Jian Kang.  Numerical modeling of the sound fields in urban squares. , 2005, The Journal of the Acoustical Society of America.

[36]  Woon-Seng Gan,et al.  Fast continuous HRTF acquisition with unconstrained movements of human subjects , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[37]  Kirill V. Horoshenkov,et al.  NUMERICAL MODELLING OF THE SOUND FIELD NEAR A TALL BUILDING WITH BALCONIES NEAR A ROAD , 1996 .

[38]  Ee-Leng Tan,et al.  Natural Sound Rendering for Headphones: Integration of signal processing techniques , 2015, IEEE Signal Processing Magazine.

[39]  Sound propagation at micro‐scale in urban areas. , 2011 .

[40]  D. Levitin,et al.  Ecological validity of soundscape reproduction , 2004 .

[41]  Wolfgang Ahnert,et al.  EARS auralization software , 1993 .

[42]  B. Berglund,et al.  A principal components model of soundscape perception. , 2010, The Journal of the Acoustical Society of America.

[43]  Y. Lam.  The effect of sound level on perception of reproduced soundscapes , 2018 .

[44]  Catherine Guastavino,et al.  SPATIAL AUDIO QUALITY EVALUATION: COMPARING TRANSAURAL, AMBISONICS AND STEREO , 2007 .

[45]  Sarah R. Payne,et al.  The production of a Perceived Restorativeness Soundscape Scale , 2013 .

[46]  SOUNDSCAPES AND LIVING SPACES SOCIOLOGICAL AND PSYCHOLOGICAL ASPECTS CONCERNING ACOUSTICAL ENVIRONMENTS , 2002 .

[47]  Michael J. Gerzon.  Periphony: With-Height Sound Reproduction , 1973 .

[48]  Jian Kang,et al.  Soundscape descriptors and a conceptual framework for developing predictive soundscape models , 2016 .

[49]  V. Ralph Algazi,et al.  Motion-Tracked Binaural Sound , 2004 .

[50]  Barry Truax,et al.  Genres and techniques of soundscape composition as developed at Simon Fraser University , 2002, Organised Sound.

[51]  Massimiliano Masullo,et al.  The Effects of Vision-Related Aspects on Noise Perception of Wind Turbines in Quiet Areas , 2013, International journal of environmental research and public health.

[52]  Durand R. Begault,et al.  3-D Sound for Virtual Reality and Multimedia Cambridge , 1994 .

[53]  Rishabh Ranjan.  3D audio reproduction : natural augmented reality headset and next generation entertainment system using wave field synthesis , 2016 .

[54]  Laurent Galbrun,et al.  Acoustical and perceptual assessment of water sounds and their use over road traffic noise. , 2013, The Journal of the Acoustical Society of America.

[55]  Massimiliano Masullo,et al.  Immersive virtual reality in community planning: Acoustic and visual congruence of simulated vs real world , 2016 .

[56]  Maffei Luigi,et al.  On the Validity of Immersive Virtual Reality as Tool for Multisensory Evaluation of Urban Spaces , 2015 .

[57]  Jerry Bruck,et al.  MODERN RECORDING TECHNIQUES , 2005 .

[58]  Massimiliano Masullo,et al.  Immersive virtual reality and environmental noise assessment: An innovative audio-visual approach , 2013 .

[59]  Luc Dekoninck,et al.  The soundscape approach for early stage urban planning: a case study , 2010 .

[60]  William J. Davies,et al.  Soundscape reproduction and synthesis , 2014 .

[61]  B. Schulte‐Fortkamp,et al.  Soundscape analysis in a residential area : An evaluation of noise and people's mind , 2006 .

[62]  Jens Holger.  MODELLING IN AUDITORIUM ACOUSTICS - FROM RIPPLE TANK AND SCALE MODELS TO COMPUTER SIMULATIONS , 2002 .

[63]  F. Aletta,et al.  Towards the integration of urban sound planning in urban development processes: the study of four test sites within the SONORUS project , 2015 .

[64]  Gerhard Eckel,et al.  Immersive audio-augmented environments: the LISTEN project , 2001, Proceedings Fifth International Conference on Information Visualisation.

[65]  Harvey Fletcher,et al.  Symposium on wire transmission of symphonic music and its reproduction in auditory perspective: Basic requirements , 1934 .

[66]  Areti Andreopoulou,et al.  I Hear NY3D: Ambisonic Capture and Reproduction of an Urban Sound Environment , 2013 .

[67]  Luigi Maffei,et al.  Ten questions on the soundscapes of the built environment , 2016 .

[68]  Boaz Rafaely,et al.  Fundamentals of Spherical Array Processing , 2015, Springer Topics in Signal Processing.

[69]  Sarah L. Dumyahn,et al.  What is soundscape ecology? An introduction and overview of an emerging new science , 2011, Landscape Ecology.

[70]  Jian Kang,et al.  Soundscape and Sound Preferences in Urban Squares: A Case Study in Sheffield , 2005 .

[71]  Mei Zhang,et al.  Semantic differential analysis of the soundscape in urban open public spaces , 2010 .

[72]  Francis M. Boland,et al.  Comparing Ambisonic Microphones – Part 1 , 2016 .

[73]  Jordan Lacey.  Site-Specific Soundscape Design for the Creation of Sonic Architectures and the Emergent Voices of Buildings , 2014 .

[74]  Catherine Guastavino,et al.  Perceptual evaluation of multi-dimensional spatial audio reproduction. , 2004, The Journal of the Acoustical Society of America.

[75]  Jian Kang,et al.  A grounded theory approach to the subjective understanding of urban soundscape in Sheffield , 2016 .

[76]  Agnieszka Roginska,et al.  I Hear NY4D: Hybrid Acoustic and Augmented Auditory Display for Urban Soundscapes , 2014 .

[77]  John Eargle,et al.  The Microphone Book : From mono to stereo to surround - a guide to microphone design and Application , 2001 .

[78]  Tapio Lokki,et al.  Evaluation of Concert Hall Auralization with Virtual Symphony Orchestra , 2011 .