A New Residual Dense Network for Dance Action Recognition From Heterogeneous View Perception

At present, part of people's body is in the state of sub-health, and more people pay attention to physical exercise. Dance is a relatively simple and popular activity, it has been widely concerned. The traditional action recognition method is easily affected by the action speed, illumination, occlusion and complex background, which leads to the poor robustness of the recognition results. In order to solve the above problems, an improved residual dense neural network method is used to study the automatic recognition of dance action images. Firstly, based on the residual model, the features of dance action are extracted by using the convolution layer and pooling layer. Then, the exponential linear element (ELU) activation function, batch normalization (BN) and Dropout technology are used to improve and optimize the model to mitigate the gradient disappearance, prevent over-fitting, accelerate convergence and enhance the model generalization ability. Finally, the dense connection network (DenseNet) is introduced to make the extracted dance action features more rich and effective. Comparison experiments are carried out on two public databases and one self-built database. The results show that the recognition rate of the proposed method on three databases are 99.98, 97.95, and 0.97.96%, respectively. It can be seen that this new method can effectively improve the performance of dance action recognition.

[1]  Nazli Ikizler-Cinbis,et al.  Recognizing human actions in images using segment and contour features , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[2]  Juan Li,et al.  Human Activity Recognition Based on Gramian Angular Field and Deep Convolutional Neural Network , 2020, IEEE Access.

[4]  Xiaolin Zhang,et al.  PGCN-TCA: Pseudo Graph Convolutional Network With Temporal and Channel-Wise Attention for Skeleton-Based Action Recognition , 2020, IEEE Access.

[5]  Asif Ali Laghari,et al.  A Review on Application of Soft Computing Techniques in Machining of Particle Reinforcement Metal Matrix Composites , 2019, Archives of Computational Methods in Engineering.

[6]  Shoulin Yin,et al.  An optimised multi-scale fusion method for airport detection in large-scale optical remote sensing images , 2020 .

[7]  Zhongmin Wang,et al.  Human activity recognition based on transformed accelerometer data from a mobile phone , 2016, Int. J. Commun. Syst..

[8]  Zhikui Chen,et al.  A Survey on Deep Learning for Multimodal Data Fusion , 2020, Neural Computation.

[9]  Shoulin Yin,et al.  Medical Image Annotation Based on Deep Transfer Learning , 2018, 2018 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData).

[10]  Yang Xiao,et al.  Action Recognition for Depth Video using Multi-view Dynamic Images , 2018, Inf. Sci..

[11]  Sung-Bae Cho,et al.  Activity recognition with android phone using mixture-of-experts co-trained with labeled and unlabeled data , 2014, Neurocomputing.

[12]  Gita Alaghband,et al.  GPRAR: Graph Convolutional Network based Pose Reconstruction and Action Recognition for Human Trajectory Prediction , 2021, ArXiv.

[13]  Hong Chen,et al.  Voxelwise detection of cerebral microbleed in CADASIL patients by leaky rectified linear unit and early stopping , 2017, Multimedia Tools and Applications.

[14]  Peng Li,et al.  An Incremental Deep Convolutional Computation Model for Feature Learning on Industrial Big Data , 2019, IEEE Transactions on Industrial Informatics.

[15]  Kok-Chin Khor,et al.  A Multiple Classifiers System for Anomaly Detection in Credit Card Data With Unbalanced and Overlapped Classes , 2020, IEEE Access.

[16]  Surapa Thiemjarus,et al.  A Device-Orientation Independent Method for Activity Recognition , 2010, 2010 International Conference on Body Sensor Networks.

[17]  Lin Teng,et al.  DMCNN: A Deep Multiscale Convolutional Neural Network Model for Medical Image Segmentation , 2019, Journal of healthcare engineering.

[18]  Zhang Chun,et al.  A Survey of Selective Ensemble Learning Algorithms , 2011 .

[19]  Shoulin Yin,et al.  A New Feature Fusion Network for Student Behavior Recognition in Education , 2021 .

[20]  Shoulin Yin,et al.  Dynamic Gesture Recognition Based on Deep Learning in Human-to-Computer Interfaces , 2020 .

[21]  Laurence T. Yang,et al.  An Improved Stacked Auto-Encoder for Network Traffic Flow Classification , 2018, IEEE Network.

[22]  Luis Miguel Soria Morillo,et al.  Low Energy Physical Activity Recognition System on Smartphones , 2015, Sensors.

[23]  Yun Fu,et al.  Residual Dense Network for Image Super-Resolution , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  Hong Chen,et al.  A Novel Feature Selection Method for Affective Recognition Based on Pulse Signal , 2011, 2011 Fourth International Symposium on Computational Intelligence and Design.