Sensor Fusion Basketball Shooting Posture Recognition System Based on CNN

In recent years, with the development of wearable sensor devices, research on sports monitoring using inertial measurement units has received increasing attention; however, a specific system for identifying various basketball shooting postures does not exist thus far. In this study, we designed a sensor fusion basketball shooting posture recognition system based on convolutional neural networks. The system, using the sensor fusion framework, collected the basketball shooting posture data of the players’ main force hand and main force foot for sensor fusion and used a deep learning model based on convolutional neural networks for recognition. We collected 12,177 sensor fusion basketball shooting posture data entries of 13 Chinese adult male subjects aged 18–40 years and with at least 2 years of basketball experience without professional training. We then trained and tested the shooting posture data using the classic visual geometry group network 16 deep learning model. The intratest achieved a 98.6% average recall rate, 98.6% average precision rate, and 98.6% accuracy rate. The intertest achieved an average recall rate of 89.8%, an average precision rate of 91.1%, and an accuracy rate of 89.9%.

[1]  Wu Chen,et al.  Deep Learning-Based Human Activity Real-Time Recognition for Pedestrian Navigation , 2020, Sensors.

[2]  Yoon Kim,et al.  Convolutional Neural Networks for Sentence Classification , 2014, EMNLP.

[3]  Hyunwoo Lee,et al.  Heart Rate Estimated from Body Movements at Six Degrees of Freedom by Convolutional Neural Networks , 2018, Sensors.

[4]  Julius Hannink,et al.  Activity recognition in beach volleyball using a Deep Convolutional Neural Network , 2017, Data Mining and Knowledge Discovery.

[5]  Huosheng Hu,et al.  Using Distributed Wearable Sensors to Measure and Evaluate Human Lower Limb Motions , 2016, IEEE Transactions on Instrumentation and Measurement.

[6]  Gang Hua,et al.  A convolutional neural network cascade for face detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  María Camila Sacristán Gutiérrez,et al.  Design and validation of a system for improving the effectiveness of basketball players: a biomechanical analysis of the free throw , 2018, 2018 IX International Seminar of Biomedical Engineering (SIB).

[8]  A. Paoli,et al.  Different intensities of basketball drills affect jump shot accuracy of expert and junior players , 2018, PeerJ.

[9]  Jie Li,et al.  Inertial Sensor-Based Analysis of Equestrian Sports Between Beginner and Professional Riders Under Different Horse Gaits , 2018, IEEE Transactions on Instrumentation and Measurement.

[10]  Rita Noumeir,et al.  A Hierarchical Learning Approach for Human Action Recognition , 2020, Sensors.

[11]  Mingzhi Huang,et al.  Application of novel hybrid deep leaning model for cleaner production in a paper industrial wastewater treatment system , 2021 .

[12]  Peter B. Shull,et al.  Differences in arm motion timing characteristics for basketball free throw and jump shooting via a body-worn sensorized sleeve , 2017, 2017 IEEE 14th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[13]  Edin Golubovic,et al.  Towards an artificial training expert system for basketball , 2017, 2017 10th International Conference on Electrical and Electronics Engineering (ELECO).

[14]  Ryutaro Tao,et al.  Cultivar discrimination of litchi fruit images using deep learning , 2020 .

[15]  M. Hubbard,et al.  Dynamics of the basketball shot with application to the free throw , 2006, Journal of sports sciences.

[16]  Yann LeCun,et al.  Convolutional networks and applications in vision , 2010, Proceedings of 2010 IEEE International Symposium on Circuits and Systems.

[17]  Zhong Zhang,et al.  Basketball Footwork Recognition using Smart Insoles Integrated with Multiple Sensors , 2020, 2020 IEEE/CIC International Conference on Communications in China (ICCC).

[18]  Suci Aulia,et al.  Hand gesture recognition using discrete wavelet transform and convolutional neural network , 2020, Bulletin of Electrical Engineering and Informatics.

[19]  K. Watanabe,et al.  Measurement and analyze of jump shoot motion in basketball using a 3-D acceleration and gyroscopic sensor , 2012, 2012 Proceedings of SICE Annual Conference (SICE).

[20]  Monica Bordegoni,et al.  A Wearable Device to Detect in Real-Time Bimanual Gestures of Basketball Players During Training Sessions , 2018, J. Comput. Inf. Sci. Eng..

[21]  Erik Štrumbelj,et al.  Basketball Shot Types and Shot Success in Different Levels of Competitive Basketball , 2015, PloS one.

[22]  Lei Yan,et al.  An Acceleration Based Fusion of Multiple Spatiotemporal Networks for Gait Phase Detection , 2020, International journal of environmental research and public health.

[23]  Ting Liu,et al.  Recent advances in convolutional neural networks , 2015, Pattern Recognit..

[24]  Chen-Yi Lee,et al.  A Real-Time Wearable Assist System for Upper Extremity Throwing Action Based on Accelerometers , 2020, Sensors.

[25]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[26]  M. Peng,et al.  Utilize Smart Insole to Recognize Basketball Motions , 2018, 2018 IEEE 4th International Conference on Computer and Communications (ICCC).

[27]  Jaehyun Lee,et al.  Automatic Classification of Squat Posture Using Inertial Sensors: Deep Learning Approach , 2020, Sensors.

[28]  Jochen Schiller,et al.  Next Generation Cooperative Wearables: Generalized Activity Assessment Computed Fully Distributed Within a Wireless Body Area Network , 2017, IEEE Access.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Abhishek Verma,et al.  Compressed residual-VGG16 CNN model for big data places image recognition , 2018, 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC).

[31]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[32]  Chee Siang Ang,et al.  weSport: Utilising wrist-band sensing to detect player activities in basketball games , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[33]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[34]  Lei Zhao,et al.  Detection and recognition of human body posture in motion based on sensor technology , 2020 .

[35]  Bo Hu,et al.  Fingerspelling Identification for Chinese Sign Language via AlexNet-Based Transfer Learning and Adam Optimizer , 2020, Sci. Program..

[36]  Hongyi Li,et al.  A method to deal with installation errors of wearable accelerometers for human activity recognition , 2011, Physiological measurement.