RetroSpat: a Perception-Based System for Semi-Automatic Diffusion of Acousmatic Music

We present the RetroSpat system for the semiautomatic diffusion of acousmatic music. This system is intended to be a spatializer with perceptive feedback. More precisely, RetroSpat can guess the positions of physical sound sources ( e.g. loudspeakers) from binaural inputs, and can then output multichannel signals to the loudspeakers while controlling the spatial location of virtual sound sources. Together with a realistic binaural spatialization technique taking into account both the azimuth and the distance, we propose a precise localization method which estimates the azimuth from the interaural cues and the distance from the brightness. This localization can be used by the system to adapt to the room acoustics and to the loudspeaker configuration. We propose a simplified sinusoidal model for the interaural cues, the model parameters being derived from the CIPIC HRTF database. We extend the binaural spatialization to a multi-source and multiloudspeaker spatialization system based on a static adaptation matrix. The methods are currently implemented in a real-time free software. Musical experiments are conducte d at the SCRIME, Bordeaux.

[1]  Ville Pulkki,et al.  Virtual Sound Source Positioning Using Vector Base Amplitude Panning , 1997 .

[2]  K. Yoshihisa.  Calculation of the Absorption of Sound by the Atmosphere , 1997 .

[3]  G. Carter,et al.  The generalized correlation method for estimation of time delay , 1976 .

[4]  John M. Chowning,et al.  THE SIMULATION OF MOVING SOUND SOURCES , 1970 .

[5]  Harald Viste,et al.  Binaural localization and separation techniques , 2004 .

[6]  Christof Faller,et al.  Improved Time Delay Analysis/Synthesis for Parametric Stereo Audio Coding , 2006 .

[7]  John William Strutt.  Scientific Papers: On the Acoustic Shadow of a Sphere , 2009 .

[8]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[9]  C. Avendano,et al.  The CIPIC HRTF database , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[10]  J Molino.  Perceiving the range of a sound source when the direction is known. , 1973, The Journal of the Acoustical Society of America.

[11]  L. Rayleigh,et al.  XII. On our perception of sound direction , 1907 .

[12]  G. F. Kuhn.  Model for the interaural time differences in the azimuthal plane , 1977 .

[13]  Sylvain Marchand,et al.  A Source Localization/Separation/Respatialization System Based on Unsupervised Classification of Interaural Cues , 2006 .

[14]  A. J. Zuckerwar,et al.  Atmospheric absorption of sound: Further developments , 1995 .

[15]  Monson H. Hayes,et al.  Statistical Digital Signal Processing and Modeling , 1996 .

[16]  R. Thouless.  Experimental Psychology , 1939, Nature.

[17]  Tammo Houtgast,et al.  Auditory distance perception in rooms , 1999, Nature.