A Sub-Band Approach to Modification of Musical Transients

The transient modifier is a type of audio effect that changes the level of the transient parts in a musical signal while leaving the steady-state parts unchanged. This article presents a high-performance algorithm for transient detection and modification, one that is capable of modifying transients in polyphonic or multi-voiced signals, and capable of modifying both hard (percussive) and soft (non-percussive) transients. The detection and modification of transients are performed in the frequency-domain using a sub-band approach. Detection is based on both phase and energy information using an adaptive threshold, and modification is carried out independently at each sub-band. The performance of the proposed sub-band approach was compared with other transient-modification algorithms using subjective listening tests. We show that the sub-band approach with adaptive threshold mostly outperforms other approaches.

[1]  M. Davies,et al.  A HYBRID APPROACH TO MUSICAL NOTE ONSET DETECTION , 2002 .

[2]  Xavier Rodet,et al.  Detection and modeling of fast attack transients , 2001, ICMC.

[3]  Rajmil Fischman.  The phase vocoder: theory and practice , 1997 .

[4]  R. Rasch,et al.  The perceptual onset of musical tones , 1981, Perception & psychophysics.

[5]  Guus de Krom,et al.  A Cepstrum-Based Technique for Determining a Harmonics-to-Noise Ratio in Speech Signals , 1993 .

[6]  J. Makhoul,et al.  Linear prediction: A tutorial review , 1975, Proceedings of the IEEE.

[7]  Dimitris Rizopoulos,et al.  The logistic transform for bounded outcome scores. , 2007, Biostatistics.

[8]  M. Davies,et al.  Complex domain onset detection for musical signals , 2003 .

[9]  Mark B. Sandler,et al.  Phase-based note onset detection for music signals , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  Anssi Klapuri,et al.  Sound onset detection by applying psychoacoustic knowledge , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[11]  S. Dixon.  ONSET DETECTION REVISITED , 2006 .

[12]  Julius O. Smith,et al.  Spectral modeling synthesis: A sound analysis/synthesis based on a deterministic plus stochastic decomposition , 1990 .

[13]  Michael M. Goodwin,et al.  Frequency-Domain Algorithms for Audio Signal Enhancement Based on Transient Modification , 2006 .

[14]  Xavier Serra,et al.  A sound analysis/synthesis system based on a deterministic plus stochastic decomposition , 1990 .

[15]  Teresa H. Y. Meng,et al.  Extending Spectral Modeling Synthesis with Transient Modeling Synthesis , 2000, Computer Music Journal.

[16]  Thomas Sporer,et al.  Statistics of MUSHRA Revisited , 2009 .

[17]  W. Andrew Schloss,et al.  On the automatic transcription of percussive music , 1985 .

[18]  Mark B. Sandler,et al.  A tutorial on onset detection in music signals , 2005, IEEE Transactions on Speech and Audio Processing.

[19]  Julius O. Smith,et al.  Detection and modeling of transient audio signals with prior information , 2005 .

[20]  I. Kauppinen,et al.  Methods for detecting impulsive noise in speech and audio signals , 2002, 2002 14th International Conference on Digital Signal Processing Proceedings. DSP 2002 (Cat. No.02TH8628).