Local Key Estimation From an Audio Signal Relying on Harmonic and Metrical Structures

In this paper, we present a method for estimating the progression of musical key from an audio signal. We address the problem of local key finding by investigating the possible combination and extension of different previously proposed approaches for global key estimation. In this work, key progression is estimated from the chord progression. Specifically, we introduce key dependency on the harmonic and the metrical structures. A contribution of our work is that we address the problem of finding an analysis window length for local key estimation that is adapted to the intrinsic music content of the analyzed piece by introducing information related to the metrical structure in our model. Key estimation is not performed on empirically chosen segments but on segments that are expressed in relationship with the tempo period. We evaluate and analyze our results on two databases of different styles. We systematically analyze the influence of various parameters to determine factors important to our model, we study the relationships between the various musical attributes that are taken into account in our work, and we provide case study examples.

[1]  Mohan S. Kankanhalli,et al.  Precise pitch profile feature extraction from musical audio for key detection , 2006, IEEE Transactions on Multimedia.

[2]  Klaus Obermayer,et al.  A new method for tracking modulations in tonal music in audio data format , 2000, Proceedings of the IEEE-INNS-ENNS International Joint Conference on Neural Networks. IJCNN 2000. Neural Computing: New Challenges and Perspectives for the New Millennium.

[3]  Laurent Oudre,et al.  Concurrent Estimation of Chords and Keys from Audio , 2010, ISMIR.

[4]  Emilia Gómez,et al.  Tonal Description of Polyphonic Audio for Music Content Processing , 2006, INFORMS J. Comput..

[5]  Mark B. Sandler,et al.  Key Estimation Using a Hidden Markov Model , 2006, ISMIR.

[6]  Ye Wang,et al.  Key determination of acoustic musical signals , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  Mohan S. Kankanhalli,et al.  Key-based melody segmentation for popular songs , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  Gerhard Widmer,et al.  Key-Finding with Interval Profiles , 2007, ICMC.

[9]  Emilia Gómez,et al.  Estimating The Tonality Of Polyphonic Audio Files: Cognitive Versus Machine Learning Modelling Strategies , 2004, ISMIR.

[10]  Craig Stuart Sapp Visual hierarchical key analysis , 2005, CIE.

[11]  C. Krumhansl,et al.  Tracing the dynamic changes in perceived tonal organization in a spatial representation of musical keys. , 1982, Psychological review.

[12]  Masataka Goto,et al.  An Audio-based Real-time Beat Tracking System for Music With or Without Drum-sounds , 2001 .

[13]  Karlheinz Brandenburg,et al.  A Symmetry Based Approach for Musical Tonality Analysis , 2007, ISMIR.

[14]  Judith C. Brown Calculation of a constant Q spectral transform , 1991 .

[15]  Geoffroy Peeters,et al.  Joint Estimation of Chords and Downbeats From an Audio Signal , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  Barry Vercoe,et al.  Detection of Key Change in Classical Piano Music , 2005, ISMIR.

[17]  Christopher Raphael,et al.  Functional Harmonic Analysis Using Probabilistic Models , 2004, Computer Music Journal.

[18]  Elaine Chew,et al.  The Spiral Array: An Algorithm for Determining Key Boundaries , 2002, ICMAI.

[19]  Robert O. Gjerdingen,et al.  The Cognition of Basic Musical Structures , 2004 .

[20]  Malcolm Slaney,et al.  A Unified System for Chord Transcription and Key Extraction Using Hidden Markov Models , 2007, ISMIR.

[21]  R. Jackendoff,et al.  A Generative Theory of Tonal Music , 1985 .

[22]  Gregory H. Wakefield,et al.  Mathematical representation of joint time-chroma distributions , 1999, Optics & Photonics.

[23]  Marc Leman,et al.  A Probabilistic Framework for Audio-Based Tonal Key and Chord Recognition , 2006, GfKl.

[24]  Lawrence K. Saul,et al.  Learning Harmonic Relationships in Digital Audio with Dirichlet-Based Hidden Markov Models , 2005, ISMIR.

[25]  Mark Sandler,et al.  Signal Processing Parameters for Tonality Estimation , 2007 .

[26]  Malcolm Slaney,et al.  Acoustic Chord Transcription and Key Extraction From Audio Using Key-Dependent HMMs Trained on Synthesized Audio , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[27]  Steven van de Par,et al.  Musical Key Extraction from Audio Using Profile Training , 2006, ISMIR.

[28]  Hélène Papadopoulos,et al.  Joint Estimation of Musical Content Information From an Audio Signal. (Estimation conjointe d'information de contenu musical d'un signal audio) , 2010 .

[29]  Ching-Hua Chuan,et al.  Audio Key Finding: Considerations in System Design and Case Studies on Chopin's 24 Preludes , 2007, EURASIP J. Adv. Signal Process..

[30]  Emilia Gómez Gutiérrez,et al.  Tonal description of music audio signals , 2006 .

[31]  Özgür Izmirli Localized Key Finding from Audio Using Nonnegative Matrix Factorization for Segmentation , 2007, ISMIR.

[32]  Christopher Raphael,et al.  Harmonic analysis with probabilistic graphical models , 2003, ISMIR.

[33]  Emilia Gómez,et al.  Tonality Visualization of Polyphonic audio , 2005, ICMC.

[34]  Geoffroy Peeters Beat-Marker Location Using a Probabilistic Framework and Linear Discriminant Analysis , 2009 .

[35]  E. Chew Towards a mathematical model of tonality , 2000 .

[36]  Steffen Pauws,et al.  Musical key extraction from audio , 2004, ISMIR.

[37]  D. Howard,et al.  Speech and audio signal processing: processing and perception of speech and music [Book Review] , 2000 .

[38]  Célestin Deliège À propos de l’ouvrage de Lerdahl et Jackendoff : « A Generative Theory of Tonal Music » , 1983 .

[39]  David Temperley,et al.  A Bayesian Approach to Key-Finding , 2002, ICMAI.

[40]  Takuya Fujishima,et al.  Realtime Chord Recognition of Musical Sound: a System Using Common Lisp Music , 1999, ICMC.

[41]  David Temperley A BAYESIAN KEY-FINDING MODEL , 2005 .

[42]  C. Harte,et al.  Detecting harmonic change in musical audio , 2006, AMCMM '06.

[43]  Özgür Izmirli,et al.  Template Based Key Finding from audio , 2005, ICMC.

[44]  Danny Epstein SKEFIS – A SYMBOLIC ( MIDI ) KEY FINDING SYSTEM , 2005 .