Large-Scale Analysis of Formations in Soccer

Due to the demand for better and deeper analysis in sports, organizations (both professional teams and broadcasters) are looking to use spatiotemporal data in the form of player tracking information to obtain an advantage over their competitors. However, due to the large volume of data, its unstructured nature, and lack of associated team activity labels (e.g. strategic/tactical), effective and efficient strategies to deal with such data have yet to be deployed. A bottleneck restricting such solutions is the lack of a suitable representation (i.e. ordering of players) which is immune to the potentially infinite number of possible permutations of player orderings, in addition to the high dimensionality of temporal signal (e.g. a game of soccer last for 90 mins). Leveraging a recent method which utilizes a "role-representation", as well as a feature reduction strategy that uses a spatiotemporal bilinear basis model to form a compact spatiotemporal representation. Using this representation, we find the most likely formation patterns of a team associated with match events across nearly 14 hours of continuous player and ball tracking data in soccer. Additionally, we show that we can accurately segment a match into distinct game phases and detect highlights. (i.e. shots, corners, free-kicks, etc) completely automatically using a decision-tree formulation.

[1]  P. Lucey,et al.  “ Sweet-Spot ” : Using Spatiotemporal Data to Discover and Predict Shots in Tennis , 2013 .

[2]  Okan Arikan Compression of motion capture databases , 2006, ACM Trans. Graph..

[3]  Peter Carr,et al.  Assessing team strategy using spatiotemporal data , 2013, KDD.

[4]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[5]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[6]  Takeo Kanade,et al.  Trajectory Space: A Dual Representation for Nonrigid Structure from Motion , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Indriyati Atmosukarto,et al.  Automatic Recognition of Offensive Team Formation in American Football Plays , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  Pascal Fua,et al.  Take your eyes off the ball: Improving ball-tracking by focusing on team play , 2014, Comput. Vis. Image Underst..

[9]  Peter Carr,et al.  Characterizing Multi-Agent Team Behavior from Partial Team Tracings: Evidence from the English Premier League , 2012, AAAI.

[10]  Svetlana Lazebnik,et al.  Locality-sensitive binary codes from shift-invariant kernels , 2009, NIPS.

[11]  Wen Gao,et al.  Trajectory based event tactics analysis in broadcast sports video , 2007, ACM Multimedia.

[12]  Yu-Han Chang,et al.  Deconstructing the Rebound with Optical Tracking Data , 2012 .

[13]  Larry S. Davis,et al.  Recognizing Plays in American Football Videos , 2009 .

[14]  Ling Shao,et al.  Intelligent Video Event Analysis and Understanding , 2010, Intelligent Video Event Analysis and Understanding.

[15]  A. Murat Tekalp,et al.  Automatic soccer video analysis and summarization , 2003, IEEE Trans. Image Process..

[16]  Luc Van Gool,et al.  You'll never walk alone: Modeling social behavior for multi-target tracking , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[17]  Matej Kristan,et al.  A trajectory-based analysis of coordinated team activity in a basketball game , 2009, Comput. Vis. Image Underst..

[18]  Bernd Girod,et al.  Transform coding of image feature descriptors , 2009, Electronic Imaging.

[19]  Aaron F. Bobick,et al.  Recognizing Planned, Multiperson Action , 2001, Comput. Vis. Image Underst..

[20]  Rama Chellappa,et al.  Learning multi-modal densities on Discriminative Temporal Interaction Manifold for group activity recognition , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Alan Fern,et al.  An Application of Transfer to American Football: From Observation of Raw Video to Control in a Simulated Environment , 2011, AI Mag..

[22]  Rama Chellappa,et al.  Group motion segmentation using a Spatio-Temporal Driving Force Model , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Yaser Sheikh,et al.  Monocular Object Detection Using 3D Geometric Primitives , 2012, ECCV.

[24]  Sridha Sridharan,et al.  Recognising Team Activities from Noisy Data , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[25]  Yaser Sheikh,et al.  Representing and Discovering Adversarial Team Behaviors Using Player Roles , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Irfan A. Essa,et al.  Motion fields to predict play evolution in dynamic sport scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[27]  Stuart Morgan,et al.  Visualization and Analysis of Spatial Characteristics of Attacks in Field Hockey , 2013 .

[28]  Larry S. Davis,et al.  Multi-agent event recognition in structured scenarios , 2011, CVPR 2011.

[29]  Mubarak Shah,et al.  Floor Fields for Tracking in High Density Crowd Scenes , 2008, ECCV.

[30]  Yaser Sheikh,et al.  Bilinear spatiotemporal basis models , 2012, TOGS.

[31]  Aaron F. Bobick,et al.  A Framework for Recognizing Multi-Agent Action from Visual Evidence , 1999, AAAI/IAAI.

[32]  Harold W. Kuhn,et al.  The Hungarian method for the assignment problem , 1955, 50 Years of Integer Programming.

[33]  Cordelia Schmid,et al.  Product Quantization for Nearest Neighbor Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.