Body Part Extraction and Pose Estimation Method in Rowing Videos

This paper describes an image processing approach capable of estimating the pose of athletes exercising on indoor rowing machines in video sequences. The proposed algorithm finds and tracks the wrist, elbow, shoulder, ankle, knee, hip and head, and the line of the back also. Our contribution is twofold. The first contri- bution is a new background subtraction method, which can reliably separate the silhouette of athletes under some assumptions related to the videos. Furthermore, the paper introduces – as the second contribution – a skeleton fitting method to find the joints of the athletes based on the results of the background subtraction. This algorithm is based on anthropometric data and special movement patterns. The overall solution works on a real time setting in the test environment. Compar- ing the results, it is shown that our method surpasses the most accurate state-of-the-art general pose estima- tion solution for indoor rowing specific videos based on two commonly used metrics, as well.

[1]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Adrian Kaehler,et al.  Learning OpenCV, 2nd Edition , 2014 .

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Silvio Savarese,et al.  Articulated part-based model for joint object detection and pose estimation , 2011, 2011 International Conference on Computer Vision.

[5]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[6]  Barry D. Wilson Development in video technology for coaching , 2008 .

[7]  Larry S. Davis,et al.  Non-parametric Model for Background Subtraction , 2000, ECCV.

[8]  Georgios Tzimiropoulos,et al.  Human Pose Estimation via Convolutional Part Heatmap Regression , 2016, ECCV.

[9]  Peter V. Gehler,et al.  DeepCut: Joint Subset Partition and Labeling for Multi Person Pose Estimation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[11]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Rita Cucchiara,et al.  The Sakbot System for Moving Object Detection and Tracking , 2002 .

[13]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[15]  Zoran Zivkovic,et al.  Improved adaptive Gaussian mixture model for background subtraction , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[16]  Nina Schaffert,et al.  Designing an Acoustic Feedback System for On-Water Rowing Training , 2010, Int. J. Comput. Sci. Sport.

[17]  John T. McConville,et al.  Anthropometric source book. Volume 1: Anthropometry for designers , 1978 .

[18]  Franz Gravenhorst,et al.  Identifying Unique Biomechanical Fingerprints for Rowers and Correlations with Boat Speed - A Data-driven Approach for Rowing Performance Analysis , 2015, Int. J. Comput. Sci. Sport.

[19]  Andrew Zisserman,et al.  Flowing ConvNets for Human Pose Estimation in Videos , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[20]  Bernt Schiele,et al.  2D Human Pose Estimation: New Benchmark and State of the Art Analysis , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Valery Kleshnev,et al.  Biomechanics of Rowing , 2016 .

[22]  Juergen Gall,et al.  Multi-person Pose Estimation with Local Joint-to-Person Associations , 2016, ECCV Workshops.

[23]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[24]  Bernt Schiele,et al.  DeeperCut: A Deeper, Stronger, and Faster Multi-person Pose Estimation Model , 2016, ECCV.