Team Tactics Estimation in Soccer Videos Based on a Deep Extreme Learning Machine and Characteristics of the Tactics

A novel method for estimating team tactics in soccer videos based on a Deep Extreme Learning Machine (DELM) and unique characteristics of tactics is presented in this paper. The proposed method estimates the tactics of each team from players’ formations and enables successful training from a limited amount of training data. Specifically, the estimation of tactics consists of two stages. First, by utilizing two DELMs corresponding to the two teams, the proposed method estimates the provisional tactics of each team. Second, the proposed method updates the team tactics based on unique characteristics of soccer tactics, the relationship between tactics of the two teams and information on ball possession. Consequently, since the proposed method estimates the team tactics that satisfy these characteristics, accurate estimation results can be obtained. In an experiment, the proposed method is applied to actual soccer videos to verify its effectiveness.

[1]  Christian Wolf,et al.  Action Classification in Soccer Videos with Long Short-Term Memory Recurrent Neural Networks , 2010, ICANN.

[2]  Miki Haseyama,et al.  Decision level fusion-based team tactics estimation in soccer videos , 2016, 2016 IEEE 5th Global Conference on Consumer Electronics.

[3]  Charles Perin,et al.  SoccerStories: A Kick-off for Visual Soccer Analysis , 2013, IEEE Transactions on Visualization and Computer Graphics.

[4]  Larry S. Davis,et al.  A Logic Framework for Sports Video Summarization Using Text-Based Semantic Annotation , 2008, 2008 Third International Workshop on Semantic Media Adaptation and Personalization.

[5]  Florent Perronnin,et al.  High-dimensional signature compression for large-scale image classification , 2011, CVPR 2011.

[6]  Tatsuya Harada,et al.  Football Action Recognition Using Hierarchical LSTM , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Keigo Majima,et al.  Hybridcast: A new media experience by integration of broadcasting and broadband , 2013, 2013 Proceedings of ITU Kaleidoscope: Building Sustainable Communities.

[9]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  C. Cushion,et al.  The impact of video feedback on professional youth football coaches’ reflection and practice behaviour: a longitudinal investigation of behaviour change , 2015 .

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Chaur-Heh Hsieh,et al.  A Novel Model-based Segmentation Approach to Extract Caption Contents on Sports Videos , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[13]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[14]  Luis Miguel Bergasa,et al.  Expert video-surveillance system for real-time detection of suspicious behaviors in shopping malls , 2015, Expert Syst. Appl..

[15]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[16]  Shohreh Kasaei,et al.  Event Detection and Summarization in Soccer Videos Using Bayesian Network and Copula , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[17]  Mubarak Shah,et al.  Tracking When the Camera Looks Away , 2015, 2015 IEEE International Conference on Computer Vision Workshop (ICCVW).

[18]  Hirokatsu Kataoka,et al.  Player position estimation by monocular camera for soccer video analysis , 2011, SICE Annual Conference 2011.

[19]  Daniel Rascher,et al.  The Application of Sports Technology and Sports Data for Commercial Purposes , 2018, The Use of Technology in Sport - Emerging Challenges.

[20]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[21]  P. Potrac,et al.  An elite hockey player’s experiences of video-based coaching: A poststructuralist reading , 2017 .

[22]  Rik Van de Walle,et al.  Generic architecture for event detection in broadcast sports video , 2010, AIEMPro '10.

[23]  Noboru Babaguchi,et al.  Event based indexing of broadcasted sports video by intermodal collaboration , 2002, IEEE Trans. Multim..

[24]  Guang-Bin Huang,et al.  Extreme learning machine: a new learning scheme of feedforward neural networks , 2004, 2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541).

[25]  Qi Tian,et al.  Trajectory-based ball detection and tracking with applications to semantic analysis of broadcast soccer video , 2003, MULTIMEDIA '03.

[26]  Yung-Yu Chuang,et al.  Multiple Kernel Fuzzy Clustering , 2012, IEEE Transactions on Fuzzy Systems.

[27]  Jürgen Perl,et al.  Tactics Analysis in Soccer - An Advanced Approach , 2013, Int. J. Comput. Sci. Sport.

[28]  Peter E. Hart,et al.  Nearest neighbor pattern classification , 1967, IEEE Trans. Inf. Theory.

[29]  Miki Haseyama,et al.  [Paper] Active Grid-based Pass Region Estimation from Multiple Frames of Broadcast Soccer Videos , 2013 .

[30]  Guang Li,et al.  Summarization-based Video Caption via Deep Neural Networks , 2015, ACM Multimedia.

[31]  Tomonori Sano,et al.  Human behavior in a staircase during a total evacuation drill in a high‐rise building , 2017 .

[32]  Gerardo Hermosillo,et al.  Supervised learning from multiple experts: whom to trust when everyone lies a bit , 2009, ICML '09.

[33]  Xiaoru Yuan,et al.  Visual Traffic Jam Analysis Based on Trajectory Data , 2013, IEEE Transactions on Visualization and Computer Graphics.

[34]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[35]  Chng Eng Siong,et al.  Automatic replay generation for soccer video broadcasting , 2004, MULTIMEDIA '04.

[36]  Lifeng Sun,et al.  Automatic player detection, labeling and tracking in broadcast soccer video , 2009, Pattern Recognition Letters.

[37]  Wen Gao,et al.  Event Tactic Analysis Based on Broadcast Sports Video , 2009, IEEE Trans. Multim..

[38]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[39]  Jian Zhang,et al.  Deep Extreme Learning Machine and Its Application in EEG Classification , 2015 .

[40]  Victor C. M. Leung,et al.  Extreme Learning Machines [Trends & Controversies] , 2013, IEEE Intelligent Systems.