Trends in onset detection

Onset detection is the basis for several high-level musical processing tasks such as Beat Tracking, Chord Estimation or Music Genre Classification. In this paper, the complete process that leads from the "raw signal" to onset detection is described. The most important onset detection methods are reviewed, explained and organized in categories, according to the properties of their reduction functions: time domain reduction functions, spectral domain reduction functions, probabilistic reduction functions, pitch-based onset detection techniques and data-driven reduction functions. We also discuss the applications of onset detection to Human-Computer Interaction, more properly on the change of paradigm provided by the new Music Visualization and Browsing methods.

[1]  Simon Dixon,et al.  Automatic Extraction of Tempo and Beat From Expressive Performances , 2001 .

[2]  W. Andrew Schloss,et al.  On the automatic transcription of percussive music , 1985 .

[3]  Nick Collins.  Using a Pitch Detector for Onset Detection , 2005, ISMIR.

[4]  Mark B. Sandler,et al.  A tutorial on onset detection in music signals , 2005, IEEE Transactions on Speech and Audio Processing.

[5]  Michèle Basseville,et al.  Detection of abrupt changes: theory and application , 1993 .

[6]  Fabio Vignoli,et al.  Visual Playlist Generation on the Artist Map , 2005, ISMIR.

[7]  Daniel P. W. Ellis,et al.  Beat Tracking by Dynamic Programming , 2007 .

[8]  Xavier Rodet,et al.  Detection and modeling of fast attack transients , 2001, ICMC.

[9]  Mark B. Sandler,et al.  Phase-based note onset detection for music signals , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[10]  Paul Masri,et al.  Imroved Modelling of Attack Transients in Music Analysis-Resynthesis , 1996, ICMC.

[11]  Nick Collins.  A Comparison of Sound Onset Detection Algorithms with Emphasis on Psychoacoustically Motivated Detection Functions , 2005 .

[12]  S. Dixon.  ONSET DETECTION REVISITED , 2006 .

[13]  Yoichi Muraoka,et al.  Beat Tracking based on Multiple-agent Architecture A Real-time Beat Tracking System for Audio Signals w , 1996 .

[14]  Mark D. Plumbley,et al.  PROBABILITY AS METADATA: EVENT DETECTION IN MUSIC USING ICA AS A CONDITIONAL DENSITY MODEL , 2003 .

[15]  M. Davies,et al.  A HYBRID APPROACH TO MUSICAL NOTE ONSET DETECTION , 2002 .

[16]  Jaakko Astola,et al.  Analysis of the meter of acoustic musical signals , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[17]  George Tzanetakis,et al.  Automatic Musical Genre Classification of Audio Signals , 2001, ISMIR.

[18]  Eric D. Scheirer,et al.  Tempo and beat analysis of acoustic musical signals. , 1998, The Journal of the Acoustical Society of America.

[19]  J. Reiss,et al.  ONSET DETECTION COMBINING ENERGY-BASED AND PITCH-BASED APPROACHES , 2007 .

[20]  Yannis Stylianou,et al.  Three Dimensions of Pitched Instrument Onset Detection , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[21]  Matthew E. P. Davies,et al.  A Combined Phase and Amplitude Based Approach to Onset Detection for Audio Segmentation , 2003 .

[22]  Anssi Klapuri,et al.  Sound onset detection by applying psychoacoustic knowledge , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[23]  Malcolm D. Macleod,et al.  Onset Detection in Musical Audio Signals , 2003, ICMC.

[24]  Anssi Klapuri,et al.  Signal Processing Methods for Music Transcription , 2006 .

[25]  Marc Leman,et al.  Content-Based Music Information Retrieval: Current Directions and Future Challenges , 2008, Proceedings of the IEEE.

[26]  Björn W. Schuller,et al.  Universal Onset Detection with Bidirectional Long Short-Term Memory Neural Networks , 2010, ISMIR.

[27]  Mark B. Sandler,et al.  On the use of phase and energy for musical onset detection in the complex domain , 2004, IEEE Signal Processing Letters.

[28]  Thomas Baer,et al.  A model for the prediction of thresholds, loudness, and partial loudness , 1997 .

[29]  Avery Wang,et al.  The Shazam music recognition service , 2006, CACM.

[30]  Matthew E. P. Davies,et al.  Context-Dependent Beat Tracking of Musical Audio , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[31]  Fabio Vignoli,et al.  Mapping Music In The Palm Of Your Hand, Explore And Discover Your Collection , 2004, ISMIR.

[32]  Jonathan Foote,et al.  Automatic audio segmentation using a measure of audio novelty , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[33]  Alexandre Lacoste.  ONSET DETECTION WITH ARTIFICIAL NEURAL NETWORKS FOR MIREX 2005 , .

[34]  M. Davies,et al.  Complex domain onset detection for musical signals , 2003 .

[35]  Yoichi Muraoka,et al.  A beat tracking system for acoustic signals of music , 1994, MULTIMEDIA '94.