Modal decomposition of musical instrument sounds via optimization-based non-linear filtering

For musical instrument sounds containing partials, which are referred to as modes, the decaying processes of the modes significantly affect the timbre of musical instruments and characterize the sounds. However, their accurate decomposition around the onset is not an easy task, especially when the sounds have sharp onsets and contain the non-modal percussive components such as the attack. This is because the sharp onsets of modes comprise peaky but broad spectra, which makes it difficult to get rid of the attack component. In this paper, an optimization-based method of modal decomposition is proposed to overcome it. The proposed method is formulated as a constrained optimization problem to enforce the perfect reconstruction property which is important for accurate decomposition and causality of modes. Three numerical simulations and application to the real piano sounds confirm the performance of the proposed method.

[1]  M. Fortin,et al.  Augmented Lagrangian methods : applications to the numerical solution of boundary-value problems , 1983 .

[2]  Slim Essid,et al.  Non-stationary signal parametric modeling techniques with an application to low bit rate audio coding , 2002, 6th International Conference on Signal Processing, 2002..

[3]  Athanasios Mouchtaris,et al.  Evaluating how well filtered white noise models the residual from sinusoidal modeling of musical instrument sounds , 2013, 2013 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics.

[4]  Karim Abed-Meraim,et al.  Damped and delayed sinusoidal model for transient signals , 2005, IEEE Transactions on Signal Processing.

[5]  C. Krumhansl,et al.  Isolating the dynamic attributes of musical timbre. , 1993, The Journal of the Acoustical Society of America.

[6]  Karim Abed-Meraim,et al.  Audio modeling based on delayed sinusoids , 2004, IEEE Transactions on Speech and Audio Processing.

[7]  Karim Abed-Meraim,et al.  Audio transients modeling by damped & delayed sinusoids (DDS) , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[8]  Bertrand David,et al.  EDS PARAMETRIC MODELING AND TRACKING OF AUDIO SIGNALS , 2002 .

[9]  Roland Badeau,et al.  Parametric Audio Coding With Exponentially Damped Sinusoids , 2013, IEEE Transactions on Audio, Speech, and Language Processing.

[10]  Matti Karjalainen,et al.  Efficient modeling and synthesis of bell-like sounds , 2002 .

[11]  S. Handel,et al.  Chapter 12 – Timbre Perception and Auditory Object Identification , 1995 .

[12]  Simon Dixon,et al.  Modelling the decay of piano sounds , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  George P. Kafentzis,et al.  ADAPTIVE MODELING OF SYNTHETIC NONSTATIONARY SINUSOIDS , 2015 .

[14]  Vesa Välimäki,et al.  Physical Modeling of Plucked String Instruments with Application to Real-Time Sound Synthesis , 1996 .

[15]  Yasuhiro Oikawa,et al.  Parametric Approximation of Piano Sound Based on Kautz Model with Sparse Linear Prediction , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  Hugo Benioff,et al.  Factors contributing to the multiple rate of piano tone decay , 1978 .

[17]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[18]  Ed F. Deprettere,et al.  Robust exponential modeling of audio signals , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[19]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[20]  Athanasios Mouchtaris,et al.  Full-Band Quasi-Harmonic Analysis and Synthesis of Musical Instrument Sounds with Adaptive Sinusoids , 2016 .

[21]  Gabriel Weinreich,et al.  Coupled piano strings , 1977 .

[22]  Matti Karjalainen,et al.  Frequency-Zooming ARMA Modeling for Analysis of Noisy String Instrument Tones , 2003, EURASIP J. Adv. Signal Process..

[23]  Heinz H. Bauschke,et al.  Fixed-Point Algorithms for Inverse Problems in Science and Engineering , 2011, Springer Optimization and Its Applications.

[24]  Sabine Van Huffel,et al.  Perceptual audio modeling with exponentially damped sinusoids , 2005, Signal Process..

[25]  George P. Kafentzis,et al.  Adaptive sinusoidal modeling of percussive musical instrument sounds , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[26]  Yasuhiro Oikawa,et al.  Modal Decomposition of Musical Instrument Sound Via Alternating Direction Method of Multipliers , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Richard Kronland-Martinet,et al.  Resynthesis of Coupled Piano String Vibrations Based on Physical Modeling , 2001 .