A Low-Cost Real-Time Tracking System for Violin

This paper presents two low-cost, real-time methods for performance tracking on the violin. Low-latency pitch detection is achieved by using finger position measurements from a resistive fingerboard to inform audio analysis; the combination outperforming audio-only methods. Bow position and pressure are tracked using four optical reflectance sensors placed on the bow stick, allowing the displacement of the hair to be measured under the force of the string. Both sensor arrangements for this system can be fitted to existing violins without damaging the instrument. A case study demonstrating the utility of these techniques is presented finding fingered and bowed note onsets during performance.

[1]  Erwin Schoonderwaldt,et al.  MusicJacket—Combining Motion Capture and Vibrotactile Feedback to Teach Violin Bowing , 2011, IEEE Transactions on Instrumentation and Measurement.

[2]  Udo Zölzer,et al.  COMPARISON OF PITCH TRACKERS FOR REAL-TIME GUITAR EFFECTS , 2010 .

[3]  Diana Young.  WIRELESS SENSOR SYSTEM FOR MEASUREMENT OF VIOLIN BOWING PARAMETERS , 2003 .

[4]  Alexander Refsum Jensenius,et al.  Effective and Expressive Movements in a French-Canadian fiddler's Performance , 2011, NIME.

[5]  Andrew P. McPherson,et al.  Low-Latency Audio Pitch Tracking: A Multi-Modal Sensor-Assisted Approach , 2014, NIME.

[6]  Dan Overholt,et al.  The Overtone Violin: a New Computer Music Instrument , 2005, ICMC.

[7]  Serge Lemouton,et al.  The augmented violin project: research, composition and performance report , 2006, NIME.

[8]  Frédéric Bevilacqua,et al.  Gesture Analysis of Violin Bow Strokes , 2005, Gesture Workshop.

[9]  Nick Collins.  A Comparison of Sound Onset Detection Algorithms with Emphasis on Psychoacoustically Motivated Detection Functions , 2005 .

[10]  Ajay Kapur,et al.  The Electronic Sitar Controller , 2004, NIME.

[11]  M. Mathews,et al.  Electronic simulation of violin resonances , 1973 .

[12]  Adrian Freed,et al.  "Old" is the New "New": a Fingerboard Case Study in Recrudescence as a NIME Development Strategy , 2013, NIME.

[13]  Emmanouil Benetos,et al.  Automatic Transcription of Polyphonic Music Exploiting Temporal Evolution , 2012 .

[14]  Andrew P. McPherson,et al.  Near-Field Optical Reflective Sensing for Bow Tracking , 2013, NIME.

[15]  Florian Krebs,et al.  Evaluating the Online Capabilities of Onset Detection Methods , 2012, ISMIR.

[16]  Gerhard Tröster,et al.  Sensor Based Measurements of Musicians' Synchronization Issues , 2012, NIME.

[17]  Florian Krebs,et al.  ONLINE REAL-TIME ONSET DETECTION WITH RECURRENT NEURAL NETWORKS , 2012 .

[18]  Arshia Cont,et al.  Antescofo: Anticipatory Synchronization and control of Interactive parameters in Computer Music , 2008, ICMC.

[19]  Hideki Kawahara,et al.  YIN, a fundamental frequency estimator for speech and music. , 2002, The Journal of the Acoustical Society of America.

[20]  Amar Chaudhary,et al.  Operating Systems Latency Measurement and Analysis for Sound Synthesis and Processing Applications , 1997, ICMC.

[21]  S. Dixon.  ONSET DETECTION REVISITED , 2006 .

[22]  G. Widmer,et al.  MAXIMUM FILTER VIBRATO SUPPRESSION FOR ONSET DETECTION , 2013 .

[23]  Perry R. Cook,et al.  BoSSA: The Deconstructed Violin Reconstructed , 2000, ICMC.

[24]  W. Buxton,et al.  The computer as musical accompanist , 1986, CHI '86.

[25]  Cornelius Pöpel,et al.  Recent Developments in Violin-related Digital Musical Instruments: Where Are We and Where Are We Going? , 2006, NIME.

[26]  V. Pendred.  University of London , 1907, Nature.

[27]  Joseph A. Paradiso,et al.  Musical Applications of Electric Field Sensing , 1997 .

[28]  Anders Askenfelt,et al.  Measurement of bow motion and bow force in violin playing , 1986 .

[29]  Gerhard Tröster,et al.  Finger Position and Pressure Sensing Techniques for String and Keyboard Instruments , 2013, NIME.

[30]  Diana Young,et al.  The Hyperbow Controller: Real-Time Dynamics Measurement of Violin Performance , 2002, NIME.

[31]  Dan Stowell,et al.  Adaptive whitening for Improved Real-Time audio onset Detection , 2007, ICMC.

[32]  Keith A. McMillen.  Stage-Worthy Sensor Bows for Stringed Instruments , 2008, NIME.

[33]  Nick Collins.  Using a Pitch Detector for Onset Detection , 2005, ISMIR.

[34]  Erwin Schoonderwaldt,et al.  Extraction of bowing parameters from violin performance combining motion capture and sensors. , 2009, The Journal of the Acoustical Society of America.

[35]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[36]  Jordi Bonada,et al.  Acquisition of Violin instrumental gestures using a Commercial EMF tracking Device , 2007, ICMC.

[37]  A. Askenfelt.  Measurement of the bowing parameters in violin playing. II: Bow–bridge distance, dynamic range, and limits of bow force , 1989 .

[38]  Dan Overholt.  The Overtone Fiddle: an Actuated Acoustic Instrument , 2011, NIME.

[39]  Matthias Demoucron.  On the control of virtual violins - Physical modelling and control of bowed string instruments , 2008 .

[40]  Anssi Klapuri,et al.  Sound onset detection by applying psychoacoustic knowledge , 1999, 1999 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings. ICASSP99 (Cat. No.99CH36258).

[41]  Jordi Bonada,et al.  Calibration Method to Measure Accurate Bow Force for Real Violin Performances , 2009, ICMC.

[42]  Diana Young,et al.  Bowstroke database: a web-accessible archive of violin bowing data , 2007, NIME '07.

[43]  Dan Overholt,et al.  Violin-Related HCI: A Taxonomy Elicited by the Musical Interface Technology Design Space , 2011, ArtsIT.

[44]  Marcelo M. Wanderley,et al.  String Bowing Gestures at Varying Bow Stroke Frequencies: A Case Study , 2007, Gesture Workshop.