High-Resolution Analysis and Resynthesis of Environmental Impact Sounds

Impact sounds produced by everyday objects are an important source of information about contact interactions in virtual environments and auditory displays. Impact signals also provide a rich class of real and synthetic percussive musical sounds. However, their perceptually acceptable resynthesis and modification requires accurate estimation of mode parameters, which has proved difficult using traditional methods. In this paper we describe some of the problems posed by impact phenomena when applying standard methods, and present a phase-constrained high-resolution algorithm which allows more accurate estimation of modes and amplitudes for impact signals. The phase-constrained algorithm is based on least squares estimation, with initial estimates obtained from a modified ESPRIT algorithm, and it produces better resynthesis results than previously used methods. We give examples with everyday object impact sounds. [

[1]  Dinesh K. Pai,et al.  The Sounds of Physical Shapes , 1998, Presence.

[2]  Tapan K. Sarkar,et al.  Matrix pencil method for estimating parameters of exponentially damped/undamped sinusoids in noise , 1990, IEEE Trans. Acoust. Speech Signal Process..

[3]  Mandayam A. Srinivasan,et al.  The Effect of Auditory Cues on the Haptic Perception of Stiffness in Virtual Environments , 1997, Dynamic Systems and Control.

[4]  Dinesh K. Pai,et al.  The AHI: an audio and haptic interface for contact interactions , 2000, UIST '00.

[5]  Dinesh K. Pai,et al.  FoleyAutomatic: physically-based sound effects for interactive simulation and animation , 2001, SIGGRAPH.

[6]  Roland Badeau,et al.  A new perturbation analysis for signal enumeration in rotational invariance techniques , 2006, IEEE Transactions on Signal Processing.

[7]  Roland Badeau,et al.  Méthodes à haute résolution pour l'estimation et le suivi de sinusoïdes modulées. Application aux signaux de musique , 2005 .

[8]  A. Swindlehurst,et al.  Subspace-based signal analysis using singular value decomposition , 1993, Proc. IEEE.

[9]  James F. O'Brien,et al.  Synthesizing Sounds from Physically Based Motion , 2001, SIGGRAPH Video Review on Animation Theater Program.

[10]  Dinesh K. Pai,et al.  Precomputed acoustic transfer: output-sensitive, accurate sound generation for geometrically complex vibration sources , 2006, SIGGRAPH 2006.

[11]  Jian Li,et al.  Amplitude estimation of sinusoidal signals: survey, new results, and an application , 2000, IEEE Trans. Signal Process..

[12]  Perry R. Cook,et al.  Real Sound Synthesis for Interactive Applications , 2002 .

[13]  Dinesh K. Pai,et al.  High Resolution Analysis of Impact Sounds and Forces , 2007, Second Joint EuroHaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems (WHC'07).

[14]  Robert D. Howe,et al.  Tactile Display of Vibratory Information in Teleoperation and Virtual Environments , 1995, Presence: Teleoperators & Virtual Environments.

[15]  Eric Krotkov,et al.  Robotic Perception of Material: Experiments with Shape-Invariant Acoustic Measures of Material Type , 1995, ISER.

[16]  Katherine J. Kuchenbecker,et al.  Improving contact realism through event-based haptic feedback , 2006, IEEE Transactions on Visualization and Computer Graphics.

[17]  William W. Gaver What in the World Do We Hear? An Ecological Approach to Auditory Event Perception , 1993 .

[18]  Wolfgang Heidrich,et al.  TimbreFields: 3D Interactive Sound Models for Real-Time Audio , 2007, PRESENCE: Teleoperators and Virtual Environments.

[19]  Petre Stoica,et al.  Spectral Analysis of Signals , 2009 .

[20]  William Buxton Using our ears: an introduction to the use of nonspeech audio cues , 1990, Other Conferences.

[21]  Roland Badeau,et al.  High-resolution spectral analysis of mixtures of complex exponentials modulated by polynomials , 2006, IEEE Transactions on Signal Processing.

[22]  Thomas Kailath,et al.  ESPRIT-A subspace rotation approach to estimation of parameters of cisoids in noise , 1986, IEEE Trans. Acoust. Speech Signal Process..

[23]  Allison M. Okamura,et al.  Reality-based models for vibration feedback in virtual environments , 2001 .

[24]  Dinesh K. Pai,et al.  Perception of Material from Contact Sounds , 2000, Presence: Teleoperators & Virtual Environments.

[25]  Dinesh K. Pai,et al.  MEASUREMENTS OF PERCEPTUAL QUALITY OF CONTACT SOUND MODELS , 2002 .