Gesture recognition based on transfer learning

At present, the general methods of gesture recognition are machine learning method and deep learning method. However, machine learning method has the disadvantage of extracting image features manually, while deep learning method requires high hardware requirements and is easy to over-fitting in small samples. To solve above problems, this paper proposes gesture recognition based on transfer learning. Firstly, transfer the pre-trained model and convolutional layer parameters on the Image-Net dataset to the gesture dataset with small samples. And then frozen the convolution layer as the feature extractor and fine-tune the output layer of the network to fit the target data. Finally, initialize the 3 fully connection layer of the network with improved normal distribution initialization method and retrain the net again. The simulation results show that the proposed method has a good recognition rate in the small sample gesture image dataset and avoid the over-fitting, which has a great significance for gesture recognition.

[1]  Xin‐Xing Tang.  Virtual Reality - Human Computer Interaction , 2012 .

[2]  Hongxun Wu,et al.  Classifier Model Based on Machine Learning Algorithms: Application to Differential Diagnosis of Suspicious Thyroid Nodules via Sonography. , 2016, AJR. American journal of roentgenology.

[3]  Sergio Escalera,et al.  Deep Learning for Action and Gesture Recognition in Image Sequences: A Survey , 2017, Gesture Recognition.

[4]  Alexandros Iosifidis,et al.  Object proposals using CNN-based edge filtering , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[5]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[6]  Fang Chen,et al.  Vehicle Detection Method for Intelligent Vehicle at Night Time Based on Video and Laser Information , 2018, Int. J. Pattern Recognit. Artif. Intell..

[7]  Ren Hai.  Vision-Based Recognition of Hand Gestures:A Survey , 2000 .

[8]  Doron Lancet,et al.  A feature extraction method for chemical sensors in electronic noses , 2003 .

[9]  Wang Liang,et al.  Dynamic and combined gestures recognition based on multi-feature fusion in a complex environment , 2015 .

[10]  Ravi Vaidyanathan,et al.  Hand gesture recognition with convolutional neural networks for the multimodal UAV control , 2017, 2017 Workshop on Research, Education and Development of Unmanned Aerial Systems (RED-UAS).

[11]  Stefan Wermter,et al.  An analysis of Convolutional Long Short-Term Memory Recurrent Neural Networks for gesture recognition , 2017, Neurocomputing.