Hand gesture recognition using force myography of the forearm activities and optimized features

Hand gesture recognition has emerged as an attractive and promising method in human-machine interaction. Applying the simple, efficient and inexpensive devices is necessary for this kind of the application. In this paper, we propose a novel hand gesture recognition by investigating the forearm muscles movement data processing sensed by an array of 8 Force Sensor Resistor (FSR). The acquired data is sent by the wireless device to the processing unit that is more convenient for users. The feature extraction scheme is proposed to get some useful information about the data. A graph of the FSR sensed signals are constructed by considering the extracted features from them. Weights of the graph edge are computed by finding the differences between correspondents pair of sensors. Multiobjective optimization is applied to find the optimum parameters and providing the best description of the sensors' relations in each class. The proposed approach will be evaluated by conducting experiments. 10 volunteered persons participated in gathering FMG data in different classes of the hand gestures. As the results show the proposed method has good performance to recognize hand gestures and has almost 93% accuracy in the overall.

[1]  Chong Wang,et al.  Superpixel-Based Hand Gesture Recognition With Kinect Depth Camera , 2015, IEEE Transactions on Multimedia.

[2]  Mahasak Ketcham,et al.  The message notification for patients care system using hand gestures recognition , 2017, 2017 International Conference on Digital Arts, Media and Technology (ICDAMT).

[3]  Antonio Bicchi,et al.  Development of a robotic teaching interface for human to human skill transfer , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[4]  Anthony D. Whitehead,et al.  Gesture recognition using Markov Systems and wearable wireless inertial sensors , 2015, IEEE Transactions on Consumer Electronics.

[5]  Mohan M. Trivedi,et al.  Hand Gesture Recognition in Real Time for Automotive Interfaces: A Multimodal Vision-Based Approach and Evaluations , 2014, IEEE Transactions on Intelligent Transportation Systems.

[6]  Carlo Menon,et al.  Force Myography to Control Robotic Upper Extremity Prostheses: A Feasibility Study , 2016, Front. Bioeng. Biotechnol..

[7]  Jasbir S. Arora,et al.  Survey of multi-objective optimization methods for engineering , 2004 .

[8]  Ruize Xu,et al.  MEMS Accelerometer Based Nonspecific-User Hand Gesture Recognition , 2012, IEEE Sensors Journal.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Mohamad Sawan,et al.  A Mixed-Signal Multichip Neural Recording Interface With Bandwidth Reduction , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[11]  Fernando Jaureguizar,et al.  Temporal Pyramid Matching of Local Binary Subpatterns for Hand-Gesture Recognition , 2016, IEEE Signal Processing Letters.

[12]  Ephraim Speech enhancement using a minimum mean square error short-time spectral amplitude estimator , 1984 .

[13]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[14]  Carlo Menon,et al.  Continuous Prediction of Finger Movements Using Force Myography , 2016 .

[15]  Guido Bugmann,et al.  Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography , 2013, IEEE Journal of Biomedical and Health Informatics.

[16]  Xia Sun,et al.  Similarity Matching-Based Extensible Hand Gesture Recognition , 2015, IEEE Sensors Journal.

[17]  Yuehai Wang,et al.  Entertainment Robot Hand Gesture Recognition , 2010, 2010 2nd International Workshop on Database Technology and Applications.

[18]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[19]  Renqiang Xie,et al.  Accelerometer-Based Hand Gesture Recognition by Neural Network and Similarity Matching , 2016, IEEE Sensors Journal.

[20]  Ken Chen,et al.  Natural Gesture Modeling and Recognition Approach Based on Joint Movements and Arm Orientations , 2016, IEEE Sensors Journal.

[21]  Majid Ahmadi,et al.  A novel approach to provide safe indoor industrial environment , 2016, 2016 International Conference on High Performance Computing & Simulation (HPCS).

[22]  Jaime Fernando Delgado Saa,et al.  EEG Signal Classification Using Power Spectral Features and linear Discriminant Analysis: A Brain Computer Interface Application , 2010 .