Team Activity Recognition in Sports

We introduce a novel approach for team activity recognition in sports. Given the positions of team players from a plan view of the playing field at any given time, we solve a particular Poisson equation to generate a smooth distribution defined on whole playground, termed the position distribution of the team. Computing the position distribution for each frame provides a sequence of distributions, which we process to extract motion features for team activity recognition. The motion features are obtained at each frame using frame differencing and optical flow. We investigate the use of the proposed motion descriptors with Support Vector Machines (SVM) classification, and evaluate on a publicly available European handball dataset. Results show that our approach can classify six different team activities and performs better than a method that extracts features from the explicitly defined positions. Our method is new and different from other trajectory-based methods. These methods extract activity features using the explicitly defined trajectories, where the players have specific positions at any given time, and ignore the rest of the playground. In our work, on the other hand, given the specific positions of the team players at a frame, we construct a position distribution for the team on the whole playground and process the sequence of position distribution images to extract motion features for activity recognition. Results show that our approach is effective.

[1]  J.K. Aggarwal,et al.  Human activity analysis , 2011, ACM Comput. Surv..

[2]  Bob Fisher,et al.  Proc. Workshop on Computer Vision Based Analysis in Sport Environments (CVBASE) , 2006 .

[3]  Martin Braun Differential equations and their applications , 1976 .

[4]  Bob Fisher,et al.  Recognition of coordinated multi agent activities, the individual vs the group , 2006 .

[5]  Jitendra Malik,et al.  Recognizing action at a distance , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[6]  Rama Chellappa,et al.  Recognizing offensive strategies from football videos , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Matej Kristan,et al.  Analysis of multi-agent activity using petri nets , 2010, Pattern Recognit..

[8]  Xiaoqin Zhang,et al.  Group action recognition in soccer videos , 2008, 2008 19th International Conference on Pattern Recognition.

[9]  Noel E. O'Connor,et al.  Team behavior analysis in sports using the Poisson equation , 2012, 2012 19th IEEE International Conference on Image Processing.

[10]  Matej Kristan,et al.  A trajectory-based analysis of coordinated team activity in a basketball game , 2009, Comput. Vis. Image Underst..

[11]  Xiaoqin Zhang,et al.  Group Action Recognition Using Space-Time Interest Points , 2009, ISVC.

[12]  Patrick Bouthemy,et al.  Trajectory-based handball video understanding , 2009, CIVR '09.

[13]  Xiaoqin Zhang,et al.  Learning Group Activity in Soccer Videos from Local Motion , 2009, ACCV.

[14]  Aaron F. Bobick,et al.  Recognizing Planned, Multiperson Action , 2001, Comput. Vis. Image Underst..

[15]  Rama Chellappa,et al.  Direct Analytical Methods for Solving Poisson Equations in Computer Vision Problems , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Noboru Babaguchi,et al.  Event tactic analysis in sports video using spatio-temporal pattern , 2010, 2010 IEEE International Conference on Image Processing.

[17]  J. Pers,et al.  Multiple interacting targets tracking with application to team sports , 2005, ISPA 2005. Proceedings of the 4th International Symposium on Image and Signal Processing and Analysis, 2005..

[18]  Irfan A. Essa,et al.  Motion fields to predict play evolution in dynamic sport scenes , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[19]  Hongbin Zha,et al.  Computer Vision - ACCV 2009, 9th Asian Conference on Computer Vision, Xi'an, China, September 23-27, 2009, Revised Selected Papers, Part III , 2010, Asian Conference on Computer Vision.

[20]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[21]  Paul Lukowicz,et al.  Performance metrics for activity recognition , 2011, TIST.