An Intelligent Discovery and Error Correction Algorithm for Misunderstanding Gesture Based on Probabilistic Statistics Model

Numerous experiments have shown that there are similar gestures in visual-based gesture recognition. In order to solve the problem, this paper proposes a new algorithm based on Convolution neural network. According to the model test results, the confusion matrix is established. And according to the correspondence between each gesture and the predicted result, misjudgment probability matrix is established. Based on the misjudgment probability matrix, we correct the gestures that have been incorrectly identified by the Convolution neural network model. After this algorithm, the recognition rate of similar gestures is increased by 5% to 12%. The innovation of this paper lies in the secondary error correction of the wrong gesture of Convolution neural network structure.

[1]  Hyotaek Lim,et al.  Hand tracking and gesture recognition system for human-computer interaction using low-cost hardware , 2015, Multimedia Tools and Applications.

[2]  Dongxu Li,et al.  Research on Gesture Recognition Based on Convolutional Neural Network and SVM , 2019 .

[3]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[4]  Sameem Abdul Kareem,et al.  Fingerprint image enhancement and recognition algorithms: a survey , 2012, Neural Computing and Applications.

[5]  Tamás Roska,et al.  The CNN universal machine: an analogic array computer , 1993 .

[6]  Juan Pablo Wachs,et al.  HEGM: A hierarchical elastic graph matching for hand gesture recognition , 2014, Pattern Recognit..

[7]  Shwetak N. Patel,et al.  Whole-home gesture recognition using wireless signals , 2013, MobiCom.

[8]  Kazuyuki Murase,et al.  Real-Time Hand Gesture Recognition Using Complex-Valued Neural Network (CVNN) , 2011, ICONIP.

[9]  Jean Meunier,et al.  Static Hand Gesture Recognition Using Artificial Neural Network , 2013 .

[10]  Petros Maragos,et al.  Multimodal gesture recognition via multiple hypotheses rescoring , 2015, J. Mach. Learn. Res..

[11]  Yuji Iwahori,et al.  A novel set of features for continuous hand gesture recognition , 2014, Journal on Multimodal User Interfaces.

[12]  Ivan Laptev,et al.  Learning and Transferring Mid-level Image Representations Using Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  Junsong Yuan,et al.  Robust hand gesture recognition based on finger-earth mover's distance with a commodity depth camera , 2011, ACM Multimedia.

[14]  Pietro Zanuttigh,et al.  Hand gesture recognition with leap motion and kinect devices , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[15]  Ulrich Neumann,et al.  Lexical Gesture Interface , 2006, Fourth IEEE International Conference on Computer Vision Systems (ICVS'06).

[16]  James W. Davis,et al.  GESTURE RECOGNITION , 2023, International Research Journal of Modernization in Engineering Technology and Science.

[17]  Iztok Fister,et al.  A biometric authentication model using hand gesture images , 2013, BioMedical Engineering OnLine.

[18]  Sameem Abdul Kareem,et al.  Gesture Feature Extraction for Static Gesture Recognition , 2013 .

[19]  Robin R. Murphy,et al.  Hand gesture recognition with depth images: A review , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[21]  Andrew Zisserman,et al.  Flowing ConvNets for Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[22]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[23]  S. Abdul-Kareem,et al.  Static hand gesture recognition using neural networks , 2012 .

[24]  Luca Maria Gambardella,et al.  Max-pooling convolutional neural networks for vision-based hand gesture recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[25]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  Chin-Chen Chang,et al.  New Approach for Static Gesture Recognition , 2006, J. Inf. Sci. Eng..

[28]  Pavlo Molchanov,et al.  Hand gesture recognition with 3D convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Prabin Kumar Bora,et al.  A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments , 2013, Pattern Recognit..

[30]  Mohamed F. Tolba,et al.  Arabic sign language continuous sentences recognition using PCNN and graph matching , 2012, Neural Computing and Applications.

[31]  Xia Sun,et al.  Similarity Matching-Based Extensible Hand Gesture Recognition , 2015, IEEE Sensors Journal.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[34]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Eung-Joo Lee,et al.  Hand Gesture Recognition Using Neural Network , 2007 .

[36]  Junsong Yuan,et al.  Robust Part-Based Hand Gesture Recognition Using Kinect Sensor , 2013, IEEE Transactions on Multimedia.

[37]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[38]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Stefan Wermter,et al.  A Multichannel Convolutional Neural Network for Hand Posture Recognition , 2014, ICANN.

[40]  Julie A. Jacko.  Human-Computer Interaction. Interaction Techniques and Environments , 2011, Lecture Notes in Computer Science.

[41]  Anupam Agrawal,et al.  Vision based hand gesture recognition for human computer interaction: a survey , 2012, Artificial Intelligence Review.

[42]  William T. Freeman,et al.  Orientation Histograms for Hand Gesture Recognition , 1995 .

[43]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[44]  Haitao Yu,et al.  Real-Time Markerless Hand Gesture Recognition with Depth Camera , 2012, PCM.

[45]  Zhang Liang,et al.  Hand Gesture Recognition Based on Hausdorff Distance , 2002 .

[46]  B. Watanapa,et al.  Human gesture recognition using Kinect camera , 2012, 2012 Ninth International Conference on Computer Science and Software Engineering (JCSSE).

[47]  Nikos Papamarkos,et al.  Hand gesture recognition using a neural network shape fitting technique , 2009, Eng. Appl. Artif. Intell..

[48]  Bharti Bansal,et al.  Gesture Recognition: A Survey , 2016 .