A novel HCI based on EMG and IMU

The technology of human-computer interaction (HCI) is developing rapidly in tandem with the advancement of information and biological technologies. Many new types input device are introduced into this field; some of them are aimed to benefit special groups of people like old or disabled persons. In the meantime, Electromyography (EMG) and Inertia Measure Unit (IMU) have been readily available and extensively applied in control systems in many fields. In this paper, we propose a novel EMG-IMU based mouse controller that controls cursor movements based on IMU signals. The displacement of the cursor is determined by integrating the acceleration signal from the IMU, which moves with the operator's arm. The mouse operations such as left click, right click and wheel scroll, are commanded through EMG signals. The pattern recognition algorithm, Linear Discriminant Analysis (LDA), is adopted to classify the EMG data into several clusters, which correspond to the pre-defined mouse operations. Experimental results have indicated that the proposed mouse controller can achieve an accuracy of 88%.

[1]  S H Park,et al.  EMG pattern recognition based on artificial intelligence techniques. , 1998, IEEE transactions on rehabilitation engineering : a publication of the IEEE Engineering in Medicine and Biology Society.

[2]  Gi-Joon Nam,et al.  Two-dimensional position deteciton system with MEMS accelerometer for MOUSE applications , 2001, DAC '01.

[3]  J. Chae,et al.  Two-dimensional position detection system with MEMS accelerometer for mouse applications , 2001, Proceedings of the 38th Design Automation Conference (IEEE Cat. No.01CH37232).

[4]  Masaki Yoshida,et al.  Mouse cursor control system using EMG , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Wookho Son,et al.  A new means of HCI: EMG-MOUSE , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[6]  David G Lloyd,et al.  Neuromusculoskeletal modeling: estimation of muscle forces and joint moments and movements from measurements of neural command. , 2004, Journal of applied biomechanics.

[7]  Adrian D. C. Chan,et al.  Continuous myoelectric control for powered prostheses using hidden Markov models , 2005, IEEE Transactions on Biomedical Engineering.

[8]  Blake Hannaford,et al.  Hill-Based Model as a Myoprocessor for a Neural Controlled Powered Exoskeleton Arm - Parameters Optimization , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[9]  Peng Lu,et al.  Head nod and shake recognition based on multi-view model and hidden Markov model , 2005, International Conference on Computer Graphics, Imaging and Visualization (CGIV'05).

[10]  Gi-Joon Nam,et al.  Two-dimensional position detection system with MEMS accelerometers, readout circuitry, and microprocessor for padless mouse applications , 2005, IEEE Transactions on Very Large Scale Integration (VLSI) Systems.

[11]  Huosheng Hu,et al.  GA-based Feature Subset Selection for Myoelectric Classification , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[12]  Jun-Uk Chu,et al.  Conjugate prior penalized learning of Gaussian mixture models for EMG pattern recognition , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Adrian D. C. Chan,et al.  Myoelectric Control Development Toolbox , 2007 .

[14]  Guanglin Li,et al.  Principal Components Analysis Preprocessing for Improved Classification Accuracies in Pattern-Recognition-Based Myoelectric Control , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Toshio Tsuji,et al.  A Hybrid Motion Classification Approach for EMG-Based Human–Robot Interfaces Using Bayesian and Neural Networks , 2009, IEEE Transactions on Robotics.

[16]  Kongqiao Wang,et al.  A Framework for Hand Gesture Recognition Based on Accelerometer and EMG Sensors , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[17]  Jianda Han,et al.  A Novel Motion Estimate Method of Human Joint with EMG-Driven Model , 2011, 2011 5th International Conference on Bioinformatics and Biomedical Engineering.