Temporal segmentation and recognition of team activities in sports

A method for temporal segmentation and recognition of team activities in sports, based on a new activity feature extraction, is presented. Given the positions of team players from a plan view of the playground at any given time, we generate a smooth distribution on the whole playground, termed the position distribution of the team. Computing the position distribution for each frame provides a sequence of distributions, which we process to extract motion features for activity recognition. We can classify six different team activities in European handball and eight different team activities in field hockey datasets. The field hockey dataset is a new, large and challenging dataset that is presented for the first time for continuous segmentation of team activities. Our approach is different from other trajectory-based methods. These methods extract activity features using the explicitly defined trajectories, where the players have specific positions. In our work, given the specific positions of the team players at a frame, we construct a position distribution for the team on the whole playground and process the sequence of position distribution images to extract activity features. Extensive evaluation and results show that our approach is effective.

[1]  J. Pers,et al.  Multiple interacting targets tracking with application to team sports , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[2]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Irfan A. Essa,et al.  Motion fields to predict play evolution in dynamic sport scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Noboru Babaguchi,et al.  Event tactic analysis in sports video using spatio-temporal pattern , 2010, 2010 IEEE International Conference on Image Processing.

[5]  Song-Chun Zhu,et al.  CERN: Confidence-Energy Recurrent Network for Group Activity Recognition , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Yang Liu,et al.  Locally linear embedding: a survey , 2011, Artificial Intelligence Review.

[8]  Noel E. O'Connor,et al.  Team behavior analysis in sports using the Poisson equation , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  Matej Kristan,et al.  A trajectory-based analysis of coordinated team activity in a basketball game , 2009, Comput. Vis. Image Underst..

[10]  Caroline Sunderland,et al.  The validity of a non-differential global positioning system for assessing player movement patterns in field hockey , 2009, Journal of sports sciences.

[11]  Aaron F. Bobick,et al.  Recognizing Planned, Multiperson Action , 2001, Comput. Vis. Image Underst..

[12]  Anthony Hoogs,et al.  Learning and Recognizing American Football Plays , .

[13]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[14]  Xiaoqin Zhang,et al.  Group Action Recognition Using Space-Time Interest Points , 2009, ISVC.

[15]  Patrick Bouthemy,et al.  Trajectory-based handball video understanding , 2009, CIVR '09.

[16]  Greg Mori,et al.  A Hierarchical Deep Temporal Model for Group Activity Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Xiaoqin Zhang,et al.  Learning Group Activity in Soccer Videos from Local Motion , 2009, ACCV.

[18]  Matej Kristan,et al.  Analysis of multi-agent activity using petri nets , 2010, Pattern Recognit..

[19]  Martin Braun Differential equations and their applications , 1976 .

[20]  Bob Fisher,et al.  Recognition of coordinated multi agent activities, the individual vs the group , 2006 .

[21]  David A. Clausi,et al.  Hockey Action Recognition via Integrated Stacked Hourglass Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Tatsuya Harada,et al.  Football Action Recognition Using Hierarchical LSTM , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[23]  Rama Chellappa,et al.  Recognizing offensive strategies from football videos , 2010, 2010 IEEE International Conference on Image Processing.

[24]  Noel E. O'Connor,et al.  Team Activity Recognition in Sports , 2012, ECCV.

[25]  Raúl Montoliu,et al.  ATM-based analysis and recognition of handball team activities , 2015, Neurocomputing.

[26]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[27]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.

[28]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[29]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[30]  Rama Chellappa,et al.  Learning multi-modal densities on Discriminative Temporal Interaction Manifold for group activity recognition , 2009, CVPR.

[31]  Xiaoqin Zhang,et al.  Group action recognition in soccer videos , 2008, 2008 19th International Conference on Pattern Recognition.

[32]  Indriyati Atmosukarto,et al.  A Topic Model Approach to Representing and Classifying Football Plays , 2013, BMVC.