Learning Football Body-Orientation as a Matter of Classification

Orientation is a crucial skill for football players that becomes a differential factor in a large set of events, especially the ones involving passes. However, existing orientation estimation methods, which are based on computer-vision techniques, still have a lot of room for improvement. To the best of our knowledge, this article presents the first deep learning model for estimating orientation directly from video footage. By approaching this challenge as a classification problem where classes correspond to orientation bins, and by introducing a cyclic loss function, a well-known convolutional network is refined to provide player orientation data. The model is trained by using ground-truth orientation data obtained from wearable EPTS devices, which are individually compensated with respect to the perceived orientation in the current frame. The obtained results outperform previous methods; in particular, the absolute median error is less than 12 degrees per player. An ablation study is included in order to show the potential generalization to any kind of football video footage.

[1]  Varun Ramakrishna,et al.  Pose Machines: Articulated Pose Estimation via Inference Machines , 2014, ECCV.

[2]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[3]  Javier Fernández,et al.  Decomposing the Immeasurable Sport: A deep learning expected possession value framework for soccer , 2019 .

[4]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Lotte Bransen,et al.  Player Chemistry: Striving for a Perfectly Balanced Soccer Team , 2020, ArXiv.

[6]  Bernard Ghanem,et al.  SoccerNet: A Scalable Dataset for Action Spotting in Soccer Videos , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Henry Carrillo,et al.  As Seen on TV: Automatic Basketball Video Production using Gaussian-based Actionness and Game States Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[8]  Jesse Davis,et al.  Actions Speak Louder than Goals: Valuing Player Actions in Soccer , 2018, KDD.

[9]  Pascal Fua,et al.  Real-time camera pose estimation for sports fields , 2020, Machine Vision and Applications.

[10]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Marc Van Droogenbroeck,et al.  ARTHuS: Adaptive Real-Time Human Segmentation in Sports Through Online Distillation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Michael Stöckl,et al.  Making Offensive Play Predictable-Using a Graph Convolutional Network to Understand Defensive Performance in Soccer , 2021 .

[13]  Adrià Arbués Sangüesa,et al.  Always Look On The Bright Side Of The Field: Merging Pose And Contextual Data To Estimate Orientation Of Soccer Players , 2020, 2020 IEEE International Conference on Image Processing (ICIP).

[14]  L. Bornn,et al.  Wide Open Spaces: A statistical technique for measuring space creation in professional soccer , 2018 .

[15]  Zijian Zhang,et al.  Score-CAM: Score-Weighted Visual Explanations for Convolutional Neural Networks , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  Shuliang Wang,et al.  Data Mining and Knowledge Discovery , 2005, Mathematical Principles of the Internet.

[17]  Gloria Haro,et al.  Using Player's Body-Orientation to Model Pass Feasibility in Soccer , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Bernard Ghanem,et al.  A Context-Aware Loss Function for Action Spotting in Soccer Videos , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  The right place at the right time: Advanced off-ball metrics for exploiting an opponent’s spatial weaknesses in soccer , 2020 .

[20]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Amit Marathe,et al.  Soft Labels for Ordinal Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  M. I. Rosenberg,et al.  Naval Research Logistics Quarterly. , 1958 .

[23]  Siavash Gorji,et al.  Group Activity Detection from Trajectory and Video Data in Soccer , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[24]  Austin Basye,et al.  Physics-Based Modeling of Pass Probabilities in Soccer , 2017 .