Multi-player detection in soccer broadcast videos using a blob-guided particle swarm optimization method

Soccer is the most popular sport around the world, and automatic processing of soccer images is a precious alternative to the manual solutions regarding the explosive growth of soccer videos. A new multi-player detection algorithm in far view frames as an initial step to a wide range of applications, such as player tracking, is addressed in this paper. In the proposed detector, a two-step blob detection (grass-based blob detection followed by an edge-based blob detection) is combined with an efficient search mechanism based on particle swarm optimization (PSO) by assigning sub-swarms to each detected blob. Then, a sub-swarm is initialized and tripled to search for three models corresponding to two teams and the referee. Therefore, the most player-like regions in detected blobs are simultaneously searched by all sub-swarms flying through the solution space, thus expanding the scope of single player detection to multi-player detection. Experimental results demonstrate the efficiency and robustness of the algorithm.

[1]  Shamik Sural,et al.  Graph-Based Multiplayer Detection and Tracking in Broadcast Soccer Videos , 2008, IEEE Transactions on Multimedia.

[2]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[3]  Luc Van Gool,et al.  Tracking People in Broadcast Sports , 2010, DAGM-Symposium.

[4]  Patrick Ndjiki-Nya,et al.  Unsupervised color classifier training for soccer player detection , 2013, 2013 Visual Communications and Image Processing (VCIP).

[5]  Wen Gao,et al.  Automatic Multi-Player Detection and Tracking in Broadcast Sports Video using Support Vector Machine and Particle Filter , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[6]  Yu Huang,et al.  Players and Ball Detection in Soccer Videos Based on Color Segmentation and Shape Analysis , 2007, MCAM.

[7]  R. Anido,et al.  Distributed real-time soccer tracking , 2004, VSSN '04.

[8]  Mohsin Bilal,et al.  Modified particle swarm optimization and fuzzy regularization for pseudo de-convolution of spatially variant blurs , 2015, Multimedia Tools and Applications.

[9]  Jia Liu,et al.  Automatic Player Detection, Labeling and Tracking in Broadcast Soccer Video , 2007, BMVC.

[10]  Nicolas Vandenbroucke,et al.  Color image segmentation by pixel classification in an adapted hybrid color space. Application to soccer image analysis , 2003, Comput. Vis. Image Underst..

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[14]  Michael Beetz,et al.  Camera-based observation of football games for analyzing multi-agent activities , 2006, AAMAS '06.

[15]  Wen Gao,et al.  A new method to segment playfield and its applications in match analysis in sports video , 2004, MULTIMEDIA '04.

[16]  Slawomir Mackowiak.  Segmentation of Football Video Broadcast , 2013 .

[17]  Mohammad Rahmati,et al.  Automatic soccer players tracking in goal scenes by camera motion elimination , 2009, Image Vis. Comput..

[18]  J.R. Nunez,et al.  Soccer video segmentation: Referee and player detection , 2008, 2008 15th International Conference on Systems, Signals and Image Processing.

[19]  M. Heydari,et al.  An MLP-based player detection and tracking in broadcast soccer video , 2012, 2012 International Conference of Robotics and Artificial Intelligence.

[20]  Wei-Chang Yeh,et al.  A categorized particle swarm optimization for object tracking , 2015, 2015 IEEE Congress on Evolutionary Computation (CEC).

[21]  Shu-Yuan Chen,et al.  Automatic Broadcast Soccer Video Analysis, Player Detection, and Tracking Based on Color Histogram , 2013 .

[22]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[23]  Ching-Yi Chen,et al.  Evolutionary design of multiplierless lifting-based 2D DWT filters for low-resolution image processing , 2015, Multimedia Tools and Applications.

[24]  Lin Chen,et al.  An interval type-2 T-S fuzzy classification system based on PSO and SVM for gender recognition , 2014, Multimedia Tools and Applications.

[25]  Pinar Duygulu Sahin,et al.  Sentioscope: A Soccer Player Tracking System Using Model Field Particles , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[26]  Rama Chellappa,et al.  A Multiple-Hypothesis Approach for Multiobject Visual Tracking , 2007, IEEE Transactions on Image Processing.

[27]  Jaihie Kim,et al.  Player Segmentation Evaluation for Trajectory Estimation in Soccer Games , 2003 .

[28]  Stefan Carlsson,et al.  Tracking and Labelling of Interacting Multiple Targets , 2006, ECCV.

[29]  Hideo Saito,et al.  Virtual Viewpoint Replay for a Soccer Match by View Interpolation From Multiple Cameras , 2007, IEEE Transactions on Multimedia.

[30]  Hideo Saito,et al.  Tracking soccer players based on homography among multiple views , 2003, Visual Communications and Image Processing.

[31]  Enrique F. Torres Moreno,et al.  Real-time GPU color-based segmentation of football players , 2011, Journal of Real-Time Image Processing.

[32]  Yan Meng,et al.  A swarm-intelligence based algorithm for face tracking , 2009, Int. J. Intell. Syst. Technol. Appl..

[33]  Tiziana D'Orazio,et al.  A Semi-automatic System for Ground Truth Generation of Soccer Video Sequences , 2009, 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance.

[34]  Young-Kyu Yang,et al.  A Soccer Image Sequence Mosaicking and Analysis Method Using Line and Advertisement Board Detection , 2002 .

[35]  M. Manafifard,et al.  Discrete Particle Swarm Optimization for Player Trajectory Extraction in Soccer Broadcast Videos , 2015 .

[36]  Suziah Sulaiman,et al.  A Review on Particle Swarm Optimization Algorithm and Its Variants to Human Motion Tracking , 2014 .

[37]  Luc Van Gool,et al.  An adaptive color-based particle filter , 2003, Image Vis. Comput..

[38]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[39]  Vijay John,et al.  Markerless human articulated tracking using hierarchical particle swarm optimisation , 2010, Image Vis. Comput..

[40]  Jacek Konieczny,et al.  A complex system for football player detection in broadcasted video , 2010, ICSES 2010 International Conference on Signals and Electronic Circuits.

[41]  Guizhong Liu,et al.  Field lines and players detection and recognition in soccer video , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[42]  Xiaoqin Zhang,et al.  Multiple Object Tracking Via Species-Based Particle Swarm Optimization , 2010, IEEE Transactions on Circuits and Systems for Video Technology.

[43]  Marc Schlipsing,et al.  Adaptive pattern recognition in real-time video-based soccer analysis , 2017, Journal of Real-Time Image Processing.

[44]  Tiziana D'Orazio,et al.  An Investigation Into the Feasibility of Real-Time Soccer Offside Detection From a Multiple Camera System , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[45]  Mubarak Shah,et al.  Tracking Multiple Occluding People by Localizing on Multiple Scene Planes , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[46]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[47]  Yongduek Seo,et al.  Automatic initialization for 3D soccer player tracking , 2011, Pattern Recognit. Lett..

[48]  Shihong Lao,et al.  Multiple Player Tracking in Sports Video: A Dual-Mode Two-Way Bayesian Inference Approach With Progressive Observation Modeling , 2011, IEEE Transactions on Image Processing.

[49]  José M. Martínez,et al.  A semi-supervised system for players detection and tracking in multi-camera soccer videos , 2014, Multimedia Tools and Applications.