Muscular Interactions. Combining EMG and MMG sensing for musical practice

We present the first combined use of the electromyogram (EMG) and mechanomyogram (MMG), two biosignals that result from muscular activity, for interactive music applications. We exploit differences between these two signals, as reported in the biomedical literature, to create bi-modal sonification and sound synthesis mappings that allow performers to distinguish the two components in a single complex arm gesture. We study non-expert players’ ability to articulate the different modalities. Results show that purposely designed gestures and mapping techniques enable novices to rapidly learn to independently control the two biosignals.

[1]  J. Silva,et al.  MMG-based classification of muscle activity for prosthesis control , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  Frank W. Jobe,et al.  An EMG analysis of the shoulder in throwing and pitching , 1983, The American journal of sports medicine.

[3]  Atau Tanaka,et al.  Musical Technical Issues in Using Interactive Instrument Technology with Application to the BioMuse , 1993, International Conference on Mathematics and Computing.

[4]  .. S. Day Important Factors in surface EMG measurement By Dr , 2002 .

[5]  James A. Johnson,et al.  Electromyographic activity and strength during maximum isometric pronation and supination efforts in healthy adults , 2004, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[6]  Marco Donnarumma Music for Flesh II: informing interactive music performance with the viscerality of the body system , 2012, NIME.

[7]  J. S. Jaffe,et al.  Low frequency sounds from sustained contraction of human skeletal muscle. , 1980, Biophysical journal.

[8]  Scott M Lephart,et al.  The sensorimotor system, part I: the physiologic basis of functional joint stability. , 2002, Journal of athletic training.

[9]  Atau Tanaka,et al.  Multimodal Interaction in Music Using the Electromyogram and Relative Position Sensing , 2002, NIME.

[10]  Atau Tanaka,et al.  Body and Space : Combining Modalities for Musical Expression , 2013 .

[11]  P Madeleine,et al.  Mechanomyography and electromyography force relationships during concentric, isometric and eccentric contractions. , 2001, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.

[12]  Miguel Ortiz A Brief History of Biosignal-Driven Art: From biofeedback to biophysical performance , 2012 .

[13]  Yoichi Nagashima,et al.  Bio-Sensing Systems and Bio-Feedback Systems for Interactive Media Arts , 2003, NIME.

[14]  Mats Djupsjöbacka,et al.  Acquisition, Processing and Analysis of the Surface Electromyogram , 1999 .

[15]  B. Freriks,et al.  Development of recommendations for SEMG sensors and sensor placement procedures. , 2000, Journal of electromyography and kinesiology : official journal of the International Society of Electrophysiological Kinesiology.