Gesture Recognition Based on Kinect and sEMG Signal Fusion

A weighted fusion method of D-S evidence theory in decision making is proposed to aim at the problem of lacking in the distribution of trust, data processing and precision in D-S evidential theory. The method of gesture recognition based on Kinect and sEMG signal are established. Weighted D-S evidence theory is used to fuse Kinect and sEMG signals and the simulation experiment is made respectively. The stimulation results show that comparing with other experimental methods, the decision fusion method based on weighted D-S evidence theory has higher utilization efficiency and recognition rate.

[1]  Dong-Soo Kwon,et al.  Design of emergency braking algorithm for pedestrian protection based on multi-sensor fusion , 2017 .

[2]  Gongfa Li,et al.  Numerical simulation of the influence factors for rotary kiln in temperature field and stress field and the structure optimization , 2015 .

[3]  Honghai Liu,et al.  Gesture recognition based on modified adaptive orthogonal matching pursuit algorithm , 2017, Cluster Computing.

[4]  Toshiaki Ejima,et al.  Real-Time Hand Tracking and Gesture Recognition System , 2005 .

[5]  Bart Koopman,et al.  The effect of tyre and rider properties on the stability of a bicycle , 2015 .

[6]  Stephan Olariu,et al.  Training a Wireless Sensor Network , 2005, Mob. Networks Appl..

[7]  Honghai Liu,et al.  Simultaneous Calibration: A Joint Optimization Approach for Multiple Kinect and External Cameras , 2017, Sensors.

[8]  Honghai Liu,et al.  Gesture recognition based on sparse representation , 2016 .

[9]  Honghai Liu,et al.  Fusion hand gesture segmentation and extraction based on CMOS sensor and 3D sensor , 2017 .

[10]  Honghai Liu,et al.  Computation of grasping and manipulation for multi-fingered robotic hands , 2015 .

[11]  Honghai Liu,et al.  A Unified Fuzzy Framework for Human-Hand Motion Recognition , 2011, IEEE Transactions on Fuzzy Systems.

[12]  Hugo Jair Escalante,et al.  A naïve Bayes baseline for early gesture recognition , 2016, Pattern Recognit. Lett..

[13]  Jiantao Zhou,et al.  Distribution of primary additional errors in fractal encoding method , 2014, Multimedia Tools and Applications.

[14]  Wang Wen.  Chinese Sign Language Recognition Based on Multiple Sensors Information Detection and Fusion , 2010 .

[15]  Honghai Liu,et al.  D-S evidential theory on sEMG signal recognition , 2017, Int. J. Comput. Sci. Math..

[16]  Zhao Aifan.  Gesture recognition fused with multi-information in complex environment , 2014 .

[17]  Xinjun Sheng,et al.  Toward an Enhanced Human–Machine Interface for Upper-Limb Prosthesis Control With Combined EMG and NIRS Signals , 2017, IEEE Transactions on Human-Machine Systems.

[18]  Hussam Muhamedsalih,et al.  Burg algorithm for enhancing measurement performance in wavelength scanning interferometry , 2016 .

[19]  Honghai Liu,et al.  Intelligent computation in grasping control of dexterous robot hand , 2015 .

[20]  Fu Hua.  Multi-sensor Optimum Fusion Based on the Bayes Estimation , 2005 .

[21]  Bruno Jedynak,et al.  Learning to Match: Deriving Optimal Template-Matching Algorithms from Probabilistic Image Models , 2010, International Journal of Computer Vision.

[22]  Gongfa Li,et al.  Coke Oven Intelligent Integrated Control System , 2013 .

[23]  Sanjeev Wagh,et al.  Extending lifetime of wireless sensor networks using multi-sensor data fusion , 2017 .

[24]  Honghai Liu,et al.  Hand gesture recognition based on convolution neural network , 2017, Cluster Computing.

[25]  Ke Yan,et al.  Hand gesture recognition based on concentric circular scan lines and weighted K-nearest neighbor algorithm , 2016, Multimedia Tools and Applications.

[26]  Johannes Wagner,et al.  Bi-channel sensor fusion for automatic sign language recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[27]  Honghai Liu,et al.  Gesture recognition based on an improved local sparse representation classification algorithm , 2017, Cluster Computing.

[28]  Honghai Liu,et al.  Intelligent control model and its simulation of flue temperature in coke oven , 2015 .

[29]  Honghai Liu,et al.  An Interactive Image Segmentation Method in Hand Gesture Recognition , 2017, Sensors.

[30]  Gongfa Li,et al.  D-S evidential theory on sEMG signal recognition , 2017 .

[31]  Zen Chen,et al.  A Zernike Moment Phase-Based Descriptor for Local Image Representation and Matching , 2010, IEEE Transactions on Image Processing.

[32]  Gongfa Li,et al.  Numerical simulation of temperature field and thermal stress field in the new type of ladle with the nanometer adiabatic material , 2015 .

[33]  Shuai Liu,et al.  A review of visual moving target tracking , 2017, Multimedia Tools and Applications.

[34]  Gongfa Li,et al.  Intelligent Control of Air Compressor Production Process , 2013 .

[35]  Shuai Liu,et al.  Fractal generation method based on asymptote family of generalized Mandelbrot set and its application , 2017 .

[36]  Honghai Liu,et al.  Recognizing Hand Grasp and Manipulation Through Empirical Copula , 2010, Int. J. Soc. Robotics.

[37]  Federico Álvarez,et al.  Adaptive Fingerprinting in Multi-Sensor Fusion for Accurate Indoor Tracking , 2017, IEEE Sensors Journal.

[38]  Fuji Ren,et al.  Facial expression recognition based on multi-regional D–S evidences theory fusion , 2017 .

[39]  Honghai Liu,et al.  Optimal grasp planning of multi-fingered robotic hands:a review , 2015 .

[40]  Xiangyang Zhu,et al.  A Multichannel Surface EMG System for Hand Motion Recognition , 2015, Int. J. Humanoid Robotics.

[41]  Gongfa Li,et al.  Influence of Working Lining Parameters on Temperature and Stress Field of Ladle , 2013 .

[42]  Stan Sclaroff,et al.  A Unified Framework for Gesture Recognition and Spatiotemporal Gesture Segmentation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[43]  Maziar Loghman,et al.  Real-Time Refinement of Kinect Depth Maps using Multi-Resolution Anisotropic Diffusion , 2014, Mob. Networks Appl..

[44]  Honghai Liu,et al.  Intelligent computational control of multi-fingered dexterous robotic hand , 2015 .