Strikes-Thrusts Activity Recognition Using Wrist Sensor Towards Pervasive Kendo Support System

In this paper, we focus on Kendo, which is a traditional sport in Japan, and propose a strikes-thrusts activity recognition method using a wrist sensor towards a pervasive Kendo support system. We collected the inertial sensor data set from 6 subjects. We attached 3 inertial sensor units (IMUs) on the subjects body, and 2 IMUs on the Shinai (bamboo sword used for Kendo). On the body, IMUs were placed on the Right Wrist, Waist and Right Ankle. On the Shinai, they were placed on the Tsuba and Saki-Gawa. We first classified strikes-thrusts activities consisting of 4 general types, Men, Tsuki, Do, and Kote, followed by further classification into 8 detailed types. We achieved 90.0% of F-measure in the case of 4-type classification and 82.6% of F-measure in the case of 8-type classification when learning and testing the same subjects data for only Right Wrist. Further, when adding data of sensors attached to the Waist and Right Ankle, we achieved 97.5% of F-measure for 4-type classification and 91.4% of F-measure for 8-type classification. As a result of leave-one-person-out cross-validation from 6 subjects to confirm generalized performance, in the case of 4-type classification, we achieved 77.5% of F-measure by using only 2 IMUs (Right Wrist and Shinai Tsuba).

[1]  Yutaka Arakawa,et al.  Multi-Stage Activity Inference for Locomotion and Transportation Analytics of Mobile Users , 2018, UbiComp/ISWC Adjunct.

[2]  Yutaka Arakawa,et al.  Investigating the Capitalize Effect of Sensor Position for Training Type Recognition in a Body Weight Training Support System , 2018, UbiComp/ISWC Adjunct.

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  Björn Eskofier,et al.  Sensor-based stroke detection and stroke type classification in table tennis , 2015, SEMWEB.

[5]  Daniel Arthur James,et al.  Dynamics of swing: A study of classical japanese swordsmanship using accelerometers , 2005 .

[6]  Florian Daiber,et al.  ClimbSense: Automatic Climbing Route Recognition using Wrist-worn Inertia Measurement Units , 2015, CHI.

[7]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[8]  H. M. Karara,et al.  Direct Linear Transformation from Comparator Coordinates into Object Space Coordinates in Close-Range Photogrammetry , 2015 .

[9]  Chee Siang Ang,et al.  weSport: Utilising wrist-band sensing to detect player activities in basketball games , 2016, 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops).

[10]  Y. I. Abdel-Aziz Direct linear transformation from comparator coordinates in close-range photogrammetry , 1971 .

[11]  Peter Kokol,et al.  Exercise repetition detection for resistance training based on smartphones , 2012, Personal and Ubiquitous Computing.

[12]  Yutaka Arakawa,et al.  SenStick: Comprehensive Sensing Platform with an Ultra Tiny All-In-One Sensor Board for IoT Research , 2017, J. Sensors.

[13]  Peter Merton McGinnis,et al.  Biomechanics Of Sport And Exercise , 1999 .

[14]  Franz Konstantin Fuss,et al.  Development of a Smart Kendo Sword and Assessment of Grip Pressure of Kamai Stance and Kote Cut , 2015 .

[15]  Daniel Arthur James The Application of Inertial Sensors in Elite Sports Monitoring , 2006 .