Discrete Particle Swarm Optimization for Player Trajectory Extraction in Soccer Broadcast Videos

Tremendous broadcast soccer videos demand automatic semantic representation for event and tactic analysis. Player tracking is an important step which can be further processed and analyzed by sport experts to evaluate player or team performance. A novel scheme for player tracking in soccer broadcast videos is proposed in this research. Following player detection using Adaboost, player labeling, occlusion handling and mosaic construction, player tracking is formulated as an optimization problem allowing us to extract player trajectories using Particle Swarm Optimization (PSO). PSO is an optimization method inspired by the flocking behavior of birds which was originally customized for continuous function value optimization. In this paper, a new application of discrete particle swarm optimization for player tracking in soccer videos is proposed. Updating equations for particle swarm optimization algorithm are modified based on problem characteristics and discrete variables to extract player trajectory. Experimental results show that the modified PSO is promising in solving soccer player tracking problem.

[1]  Pascal Fua,et al.  Tracking multiple people under global appearance constraints , 2011, 2011 International Conference on Computer Vision.

[2]  Ming Xu,et al.  Multi-camera video surveillance for real-time analysis and reconstruction of soccer games , 2010, Machine Vision and Applications.

[3]  Mohammad Rahmati,et al.  Automatic soccer players tracking in goal scenes by camera motion elimination , 2009, Image Vis. Comput..

[4]  Chunguang Zhou,et al.  Particle swarm optimization for traveling salesman problem , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[5]  Michael Beetz,et al.  Visually Tracking Football Games Based on TV Broadcasts , 2007, IJCAI.

[6]  P. Yin.  Genetic particle swarm optimization for polygonal approximation of digital curves , 2006, Pattern Recognition and Image Analysis.

[7]  Ichiro Ide,et al.  An object detection method for describing soccer games from video , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[8]  Ricardo M. L. Barros,et al.  Tracking soccer players aiming their kinematical motion analysis , 2006, Comput. Vis. Image Underst..

[9]  Tiziana D'Orazio,et al.  An Investigation Into the Feasibility of Real-Time Soccer Offside Detection From a Multiple Camera System , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Wen Gao,et al.  A new method to segment playfield and its applications in match analysis in sports video , 2004, MULTIMEDIA '04.

[11]  Wen Gao,et al.  Event Tactic Analysis Based on Broadcast Sports Video , 2009, IEEE Trans. Multim..

[12]  Jin-Jang Leou,et al.  An Improved Mean Shift Algorithm Based Tracking System for Soccer Game Analysis , 2009 .

[13]  HongJiang Zhang,et al.  Automatic parsing of TV soccer programs , 1995, Proceedings of the International Conference on Multimedia Computing and Systems.

[14]  Jake K. Aggarwal,et al.  Tracking soccer players using broadcast TV images , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[15]  Jia Liu,et al.  Automatic Player Detection, Labeling and Tracking in Broadcast Soccer Video , 2007, BMVC.

[16]  Li Xian-lib.  Discrete particle swarm optimization for TSP based on neighborhood , 2011 .

[17]  Nicole Vincent,et al.  A Fast Snake-Based Method to Track Football Player , 2000, MVA.

[18]  Wang Cheng,et al.  Solving traveling salesman problems with time windows by genetic particle swarm optimization , 2008, 2008 IEEE Congress on Evolutionary Computation (IEEE World Congress on Computational Intelligence).

[19]  A. Singhal,et al.  Tracking soccer players using the graph representation , 2008 .

[20]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[21]  Pascal Fua,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Multiple Object Tracking Using K-shortest Paths Optimization , 2022 .

[22]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[23]  Alberto Del Bimbo,et al.  Semantic annotation of soccer videos: automatic highlights identification , 2003, Comput. Vis. Image Underst..

[24]  Xianglong Tang,et al.  A novel approach for tracking high speed skaters in sports using a panning camera , 2009, Pattern Recognit..

[25]  Yu Huang,et al.  Players and Ball Detection in Soccer Videos Based on Color Segmentation and Shape Analysis , 2007, MCAM.

[26]  Shihong Lao,et al.  Multiple Player Tracking in Sports Video: A Dual-Mode Two-Way Bayesian Inference Approach With Progressive Observation Modeling , 2011, IEEE Transactions on Image Processing.

[27]  Russell C. Eberhart,et al.  A discrete binary version of the particle swarm algorithm , 1997, 1997 IEEE International Conference on Systems, Man, and Cybernetics. Computational Cybernetics and Simulation.

[28]  Tiziana D'Orazio,et al.  A review of vision-based systems for soccer video analysis , 2010, Pattern Recognit..

[29]  Pan Chen,et al.  Particle swarm optimization with simulated annealing for TSP , 2007 .

[30]  Yoshiaki Shirai,et al.  Tracking players and a ball in video image sequence and estimating camera parameters for 3D interpretation of soccer games , 2002, Object recognition supported by user interaction for service robots.

[31]  Robert G. Abbott,et al.  Multiple target tracking with lazy background subtraction and connected components analysis , 2009, Machine Vision and Applications.