An Improved Human Action Recognition Method Based on 3D Convolutional Neural Network

Aiming at the problems such as complex feature extraction, low recognition rate and low robustness in the traditional human action recognition algorithms, an improved 3D convolutional neural network method for human action recognition is proposed. The network only uses grayscale images and the number of image frames as input. At the same time, two layers of nonlinear convolutional layers are added to the problem of less convolution and convolution kernels in the original network, which not only increases the number of convolution kernels in the network. Quantity, and make the network have better abstraction ability, at the same time in order to prevent the network from appearing the phenomenon of overfitting, the dropout technology was added in the network to regularize. Experiments were performed on the UCF101 data set, achieving an accuracy of 96%. Experimental results show that the improved 3D convolutional neural network model has a higher recognition accuracy in human action recognition.

[1]  Limin Wang,et al.  Action recognition with trajectory-pooled deep-convolutional descriptors , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Yann LeCun,et al.  Convolutional Learning of Spatio-temporal Features , 2010, ECCV.

[4]  Liang Wang,et al.  Multi-view descriptor mining via codeword net for action recognition , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[5]  Yaser Sheikh,et al.  Exploring the space of a human action , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[6]  Alex Pentland,et al.  Coupled hidden Markov models for complex action recognition , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Limin Wang,et al.  Bag of visual words and fusion methods for action recognition: Comprehensive study and good practice , 2014, Comput. Vis. Image Underst..

[9]  Ming Yang,et al.  3D Convolutional Neural Networks for Human Action Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Mubarak Shah,et al.  UCF101: A Dataset of 101 Human Actions Classes From Videos in The Wild , 2012, ArXiv.

[11]  Mubarak Shah,et al.  Recognizing 50 human action categories of web videos , 2012, Machine Vision and Applications.