Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces

We explore the feasibility of muscle-computer interfaces (muCIs): an interaction methodology that directly senses and decodes human muscular activity rather than relying on physical device actuation or user actions that are externally visible or audible. As a first step towards realizing the mu-CI concept, we conducted an experiment to explore the potential of exploiting muscular sensing and processing technologies for muCIs. We present results demonstrating accurate gesture classification with an off-the-shelf electromyography (EMG) device. Specifically, using 10 sensors worn in a narrow band around the upper forearm, we were able to differentiate position and pressure of finger presses, as well as classify tapping and lifting gestures across all five fingers. We conclude with discussion of the implications of our results for future muCI designs.

[1]  Ian Witten,et al.  Data Mining , 2000 .

[2]  Ian H. Witten,et al.  Data mining: practical machine learning tools and techniques, 3rd Edition , 1999 .

[3]  A. Adler,et al.  An improved method for muscle activation detection during gait , 2004, Canadian Conference on Electrical and Computer Engineering 2004 (IEEE Cat. No.04CH37513).

[4]  Regan L. Mandryk,et al.  A continuous and objective evaluation of emotional experience with interactive play environments , 2006, CHI.

[5]  MH Schieber.  Muscular production of individuated finger movements: the roles of extrinsic finger muscles , 1995, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[6]  Enrico Costanza,et al.  Toward subtle intimate interfaces for mobile devices using an EMG controller , 2005, CHI.

[7]  Hiroshi Yokoi,et al.  Development of a multi-DOF electromyography prosthetic system using the adaptive joint mechanism , 2006 .

[8]  J. Platt.  Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[9]  Frank W. Jobe,et al.  EMG analysis of the scapular muscles during a shoulder rehabilitation program , 1992, The American journal of sports medicine.

[10]  Marimuthu Palaniswami,et al.  Hand gestures for HCI using ICA of EMG , 2006 .

[11]  G.F. Inbar,et al.  Classification of finger activation for use in a robotic prosthesis arm , 2002, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  F. Mohd-Yasin,et al.  Techniques of EMG signal analysis: detection, processing, classification and applications , 2006, Biological Procedures Online.

[13]  Hiroyuki Manabe,et al.  A ring-shaped EMG measurement system for applying to user interface , 2003, Proceedings of the 25th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE Cat. No.03CH37439).

[14]  Richard Shiavi,et al.  Electromyography: Physiology, Engineering, and Noninvasive Applications [Book Review] , 2006, IEEE Engineering in Medicine and Biology Magazine.

[15]  J. Basmajian.  Muscles Alive—their functions revealed by electromyography , 1963 .

[16]  Toshio Fukuda,et al.  Neuro-fuzzy control of a robotic exoskeleton with EMG signals , 2004, IEEE Transactions on Fuzzy Systems.

[17]  R. B. Jerard,et al.  Computational requirements for control of the utah arm , 1974, ACM '74.

[18]  Charles Jorgensen,et al.  Gestures as Input: Neuroelectric Joysticks and Keyboards , 2003, IEEE Pervasive Comput..

[19]  H. Devries.  MUSCLES ALIVE-THEIR FUNCTIONS REVEALED BY ELECTROMYOGRAPHY , 1976 .

[20]  Pattie Maes,et al.  Intimate interfaces in action: assessing the usability and subtlety of emg-based motionless gestures , 2007, CHI.

[21]  D T Barry,et al.  Acoustic and surface EMG diagnosis of pediatric muscle disease , 1990, Muscle & nerve.

[22]  M.W. Jiang,et al.  A Method of Recognizing Finger Motion Using Wavelet Transform of Surface EMG Signal , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[23]  Desney S. Tan,et al.  Using a low-cost electroencephalograph for task classification in HCI research , 2006, UIST.

[24]  R. Röhrig,et al.  Computer Keyboard and Mouse as a Reservoir of Pathogens in an Intensive Care Unit , 2003, Journal of Clinical Monitoring and Computing.