The Flamenco Cante : Automatic Characterization of Flamenco Singing by Analyzing Audio Recordings

Flamenco singing is a highly expressive improvisational artform characterized by its deviation from the Western tonal system, freedom in rhythmic interpretation and a high amount of melodic ornamentation. Consequently, a singing performance represents a fusion of style-related constraints and the individual spontaneous interpretation. This study focuses on the description of the characteristics of a particular singer. In order to find suitable feature sets, a genre-specific automatic singer identification is implemented. For Western classical and popular music, related approaches have mainly relied on the extraction of timbre-based features to automatically recognize a singer by analyzing audio recordings. However, a classification solely based on spectral descriptors is prone to errors for low quality audio recordings. In order to obtain a more robust approach, low-level timbre features are combined with vibratoand performance-related descriptors. Furthermore, differences among interpretations within a style are analyzed: Versions of the same a cappella cante have a common melodic skeleton which is subject to strong, individually determined melodic and rhythmic modifications. Similarity among such performances is modeled by applying dynamic time-warping to align automatic transcriptions and extracting performance-related descriptors. Resulting distances are evaluated by analyzing their correlation to human ratings. Computing Reviews (1998)

[1]  Sergio Oramas,et al.  Automatic Detection of Melodic Patterns in Flamenco Singing by Analyzing Polyphonic Music Recordings , 2012 .

[2]  Remco C. Veltkamp,et al.  MUSICAL MODELS FOR FOLK-SONG MELODY ALIGNMENT , 2009 .

[3]  Emilia Gómez,et al.  Comparative Melodic Analysis of A Cappella Flamenco Cantes , 2008 .

[4]  Emilia Gómez,et al.  Musical genre classification using melody features extracted from polyphonic music signals , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  Emilia Gómez,et al.  Fundamental frequency alignment vs. note-based melodic similarity for singing voice assessment , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Efstathios Stamatatos,et al.  Automatic identification of music performers with learning ensembles , 2005, Artif. Intell..

[7]  Jaakko Astola,et al.  The Mel-Frequency Cepstral Coefficients in the Context of Singer Identification , 2005, ISMIR.

[8]  Wei Cai,et al.  Automatic singer identification based on auditory features , 2011, 2011 Seventh International Conference on Natural Computation.

[9]  Xavier Serra,et al.  Automatic performer identification in commercial monophonic Jazz performances , 2010, Pattern Recognit. Lett..

[10]  Hanspeter Herzel,et al.  Analysing and Understanding the Singing Voice: Recent Progress and Open Questions , 2011 .

[11]  José Miguel Díaz-Báñez,et al.  Characterization and Similarity in A Cappella Flamenco Cantes , 2010, ISMIR.

[12]  Wei-Ho Tsai,et al.  Popular singer identification based on cepstrum transformation , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[13]  T. Eerola,et al.  Statistical Features and Perceived Similarity of Folk Melodies , 2001 .

[14]  Kian-Lee Tan,et al.  A novel framework for efficient automated singer identification in large music databases , 2009, TOIS.

[15]  Emilia Gómez,et al.  Melody Extraction From Polyphonic Music Signals Using Pitch Contour Characteristics , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[16]  Jordi Bonada,et al.  Predominant Fundamental Frequency Estimation vs Singing Voice Separation for the Automatic Transcription of Accompanied Flamenco Singing , 2012, ISMIR.

[17]  Mohan S. Kankanhalli,et al.  Similarity matching of continuous melody contours for humming querying of melody databases , 2002, 2002 IEEE Workshop on Multimedia Signal Processing..

[18]  Haizhou Li,et al.  On fusion of timbre-motivated features for singing voice detection and singer identification , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  Emilia Gómez,et al.  Analyzing Melodic Similarity Judgements in Flamenco a Cappella Singing , 2012 .

[20]  Emilia Gómez,et al.  Towards Computer-Assisted Flamenco Transcription: An Experimental Comparison of Automatic Transcription Algorithms as Applied to A Cappella Singing , 2013, Computer Music Journal.

[21]  Gregory H. Wakefield,et al.  Singing voice identification using spectral envelope estimation , 2004, IEEE Transactions on Speech and Audio Processing.

[22]  Nicola Orio,et al.  A Measure of Melodic Similarity based on a Graph Representation of the Music Structure , 2009, ISMIR.

[23]  Jyh-Shing Roger Jang,et al.  On the Improvement of Singing Voice Separation for Monaural Recordings Using the MIR-1K Dataset , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[24]  Emilia Gómez,et al.  Automatic Melodic Transcription of Flamenco Singing , 2008 .

[25]  Preeti Rao,et al.  Context-Aware Features for Singing Voice Detection in Polyphonic Music , 2011, Adaptive Multimedia Retrieval.

[26]  Yves Van de Peer,et al.  zt: A Sofware Tool for Simple and Partial Mantel Tests , 2002 .

[27]  Yves Chauvin,et al.  Backpropagation: theory, architectures, and applications , 1995 .

[28]  T.V. Geetha,et al.  Music Information Retrieval of Carnatic Songs Based on Carnatic Music Singer Identification , 2008, 2008 International Conference on Computer and Electrical Engineering.

[29]  Òscar Celma,et al.  Audio Tag Classification using Weighted-Vote Nearest Neighbor Classification , 2011 .

[30]  Francisca Merchán Higuera,et al.  Expressive characterization of flamenco singing , 2008 .

[31]  Pekka Paalanen,et al.  BAYESIAN CLASSIFICATION USING GAUSSIAN MIXTURE MODEL AND EM ESTIMATION : IMPLEMENTATIONS AND COMPARISONS Information Technology Project , 2004 .

[32]  Mathieu Lagrange,et al.  Robust Singer Identification in Polyphonic Music using Melody Enhancement and Uncertainty-based Learning , 2012, ISMIR.

[33]  Aaron M. Johnson,et al.  Classification of the classical male singing voice using long-term average spectrum. , 2011, Journal of voice : official journal of the Voice Foundation.

[34]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[35]  Hiromasa Fujihara,et al.  A Music Information Retrieval System Based on Singing Voice Timbre , 2007, ISMIR.

[36]  Emilia Gómez,et al.  Automatic Detection of Ornamentation in Flamenco Music , 2011, NIPS 2011.

[37]  Emilia Gómez,et al.  Melodic Transcription of Flamenco Singing from Monophonic and Polyphonic Music Recordings , 2012 .

[38]  Hiromasa Fujihara,et al.  A Modeling of Singing Voice Robust to Accompaniment Sounds and Its Application to Singer Identification and Vocal-Timbre-Similarity-Based Music Information Retrieval , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[39]  Wei-Ho Tsai,et al.  Automatic Singer Identification Based on Speech-Derived Models , 2012 .

[40]  Alan Marsden Interrogating Melodic Similarity: A Definitive Phenomenon or the Product of Interpretation? , 2012 .

[41]  Danièle Dubois,et al.  Characterisation of Voice Quality in Western Lyrical Singing: from Teachers' Judgements to Acoustic Descriptions , 2007 .

[42]  Haizhou Li,et al.  Exploring Vibrato-Motivated Acoustic Features for Singer Identification , 2007, IEEE Transactions on Audio, Speech, and Language Processing.

[43]  T. Zhang System and Method for Automatic Singer Identification , 2003 .

[44]  Youngmoo E. Kim,et al.  Singer Identification in Popular Music Recordings Using Voice Coding Features , 2002 .

[45]  Miguel Molina-Solana,et al.  A state of the art on computational music performance , 2011, Expert Syst. Appl..

[46]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .