Inharmonicity-Based Method for the Automatic Generation of Guitar Tablature

In this paper, a system for the extraction of the tablature of guitar musical pieces using only the audio waveform is presented. The analysis of the inharmonicity relations between the fundamentals and the partials of the notes played is the main process that allows to estimate both the notes played and the string/fret combination that was used to produce that sound. A procedure to analyze chords will also be described. This procedure will also make use of the inharmonicity analysis to find the simultaneous string/fret combinations used to play each chord. The proposed method is suitable for any guitar type: classical, acoustic and electric guitars. The system performance has been evaluated on a series of guitar samples from the RWC instruments database and our own recordings.

[1]  Nicolás Ruiz-Reyes,et al.  Polyphonic transcription based on temporal evolution of spectral similarity of gaussian mixture models , 2009, 2009 17th European Signal Processing Conference.

[2]  Anssi Klapuri,et al.  Multiple fundamental frequency estimation based on harmonicity and spectral smoothness , 2003, IEEE Trans. Speech Audio Process..

[3]  John Fulcher,et al.  Advances in Applied Artificial Intelligence , 2006 .

[4]  C. Traube,et al.  Deriving the plucking point location along a guitar string from a least-square estimation of a comb filter delay , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[5]  Ana M. Barbancho,et al.  Pitch and Played String Estimation in Classic and Acoustic Guitars , 2009 .

[6]  Vincenzo Lombardo,et al.  Guitar Fingering for Music Performance , 2005, ICMC.

[7]  S. Schwerman,et al.  The Physics of Musical Instruments , 1991 .

[8]  Hideo Saito,et al.  Vision-Based Detection of Guitar Players' Fingertips Without Markers , 2007, Computer Graphics, Imaging and Visualisation (CGIV 2007).

[9]  M. P. Friedman,et al.  ACADEMIC PRESS SERIES IN COGNITION AND PERCEPTION , 1982 .

[10]  Masataka Goto,et al.  Development of the RWC Music Database , 2004 .

[11]  Lee Ling Wei,et al.  Optical Tablature Recognition (OTR) system: Using Fourier Descriptors as a recognition tool , 2008, 2008 International Conference on Audio, Language and Image Processing.

[12]  Simon Dixon,et al.  A guitar tablature score follower , 2010, 2010 IEEE International Conference on Multimedia and Expo.

[13]  Daniel R. Tuohy,et al.  Guitar Tablature Creation with Neural Networks and Distributed Genetic Search , 2006 .

[14]  Hirokazu Kameoka,et al.  Specmurt Analysis of Polyphonic Music Signals , 2008, IEEE Transactions on Audio, Speech, and Language Processing.

[15]  Thomas D. Rossing,et al.  The Science of String Instruments , 2010 .

[16]  Peter F. Driessen,et al.  Path Difference Learning for Guitar Fingering Problem , 2004, ICMC.

[17]  Mihalis Exarhos,et al.  Automated classification of piano-guitar notes , 2006, IEEE Transactions on Audio, Speech, and Language Processing.

[18]  Hanna Järveläinen,et al.  Is Inharmonicity Perceivable in the Acoustic Guitar , 2005 .

[19]  Walter D. Potter,et al.  Generating Guitar Tablature with LHF Notation Via DGA and ANN , 2006, IEA/AIE.

[20]  Scott Rickard,et al.  Automatic hexaphonic guitar transcription using non-negative constraints , 2009 .

[21]  Anders Askenfelt,et al.  Study of the Spectral Inharmonicity of Musical Sound by the Algorithms of Pitch Extraction , 2000 .

[22]  M. Davy,et al.  Bayesian computational models for inharmonicity in musical instruments , 2005, IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, 2005..

[23]  Zhang Junxing,et al.  Piano Fundamental Frequency Estimation Algorithm Based on Weighted Least Square Method , 2009, International Forum on Information Technology and Applications.

[24]  Marcelo M. Wanderley,et al.  Visual Methods for the Retrieval of Guitarist Fingering , 2006, NIME.

[25]  Harvey Fletcher,et al.  Quality of Piano Tones , 1962 .

[26]  R. Lefebvre,et al.  A neural network approach for preclassification in musical chords recognition , 2003, The Thrity-Seventh Asilomar Conference on Signals, Systems & Computers, 2003.

[27]  Vesa Välimäki,et al.  Fast automatic inharmonicity estimation algorithm. , 2007, The Journal of the Acoustical Society of America.

[28]  Vesa Välimäki,et al.  Perception and Adjustment of Pitch in Inharmonic String Instrument Tones , 2002 .

[29]  Benoit Huet,et al.  A multimodal approach to music transcription , 2008, 2008 15th IEEE International Conference on Image Processing.

[30]  Anders Askenfelt,et al.  Signal representation and estimation of spectral parameters by inharmonic comb filters with application to the piano , 1999, IEEE Trans. Speech Audio Process..

[31]  Axel Röbel,et al.  Multiple Fundamental Frequency Estimation and Polyphony Inference of Polyphonic Music Signals , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[32]  Jakob Abeßer,et al.  Feature-based extraction of plucking and expression styles of the electric bass guitar , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[33]  Vesa Välimäki,et al.  Acoustic guitar plucking point estimation in real time , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[34]  Julius O. Smith,et al.  Extracting the fingering and the plucking points on a guitar string from a recording , 2001, Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics (Cat. No.01TH8575).

[35]  A Lewis,et al.  THE SCIENCE OF SOUND , 1997 .