Distributed visual sensing for virtual top-view trajectory generation in football videos

In this paper, we propose a distributed sensing algorithm that integrates players' trajectories observed from multiple cameras during a football game. Football scenes present several situations where players occlude each other, thus generating ambiguities that may lead to tracking failures. The integration of tracks from different views may help disambiguate players tracks. The proposed approach first uses homography to synthesize the ground plane virtual top-view and then transforms players locations from the camera image plane to the ground plane. Finally, the tracking on the ground plane is performed applying the graph theory. We demonstrate the results of our algorithm on football scenario.

[1]  Justus H. Piater,et al.  Multi-view Object Tracking Using Sequential Belief Propagation , 2006, ACCV.

[2]  Ricardo M. L. Barros,et al.  Tracking soccer players aiming their kinematical motion analysis , 2006, Comput. Vis. Image Underst..

[3]  Hideo Saito,et al.  Parallel tracking of all soccer players by integrating detected positions in multiple view images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Kenichi Kanatani.  Optimal Homography Computation with a Reliability Measure , 1998, MVA.

[5]  Hassan Foroosh,et al.  Trajectory Rectification and Path Modeling for Video Surveillance , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[7]  Yaser Sheikh,et al.  Trajectory Association across Multiple Airborne Cameras , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Tiziana D'Orazio,et al.  Moving object segmentation by background subtraction and temporal analysis , 2006, Image Vis. Comput..

[9]  Akira Utsumi,et al.  Multiple-camera-based human tracking using non-synchronous observations , 2000 .

[10]  Mubarak Shah,et al.  A noniterative greedy algorithm for multiframe point correspondence , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Yoshihiro Fujita,et al.  Robust Tracking of Athletes Using Multiple Features of Multiple Views , 2004, WSCG.

[12]  A. M. Tekalp,et al.  Multiple camera tracking of interacting and occluded human motion , 2001, Proc. IEEE.

[13]  Richard M. Karp,et al.  A n^5/2 Algorithm for Maximum Matchings in Bipartite Graphs , 1971, SWAT.

[14]  Yongduek Seo,et al.  Where Are the Ball and Players? Soccer Game Analysis with Color Based Tracking and Image Mosaick , 1997, ICIAP.

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  H. Opower.  Multiple view geometry in computer vision , 2002 .

[17]  Harpreet S. Sawhney,et al.  Real-time wide area multi-camera stereo tracking , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  Aaron F. Bobick,et al.  Visual Tracking Using Closed-Worlds , 1995 .

[19]  Wen Gao,et al.  Trajectory based event tactics analysis in broadcast sports video , 2007, ACM Multimedia.

[20]  Yoshiaki Shirai,et al.  Optical flow-based person tracking by multiple cameras , 2001, Conference Documentation International Conference on Multisensor Fusion and Integration for Intelligent Systems. MFI 2001 (Cat. No.01TH8590).

[21]  Andrea Cavallaro,et al.  Robust Homography-Based Trajectory Transformation for Multi-Camera Scene Analysis , 2007, 2007 First ACM/IEEE International Conference on Distributed Smart Cameras.

[22]  Roger D. Boyle,et al.  Tracking multiple sports players through occlusion, congestion and scale , 2001, BMVC.

[23]  Isaac Cohen,et al.  Jeju Island , Korea TRACKING PEOPLE IN CROWDED SCENES ACROSS MULTIPLE CAMERAS , 2004 .

[24]  Jake K. Aggarwal,et al.  Tracking Human Motion in Structured Environments Using a Distributed-Camera System , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  Richard M. Karp,et al.  A n^5/2 Algorithm for Maximum Matchings in Bipartite Graphs , 1971, SWAT.

[26]  Gian Luca Foresti,et al.  Trajectory clustering and its applications for video surveillance , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[27]  Pierre Roduit,et al.  Trajectory Analysis for Sport and Video Surveillance , 2005 .

[28]  Ming Xu,et al.  Architecture and algorithms for tracking football players with multiple cameras , 2005 .

[29]  Luc Van Gool,et al.  Color-Based Object Tracking in Multi-camera Environments , 2003, DAGM-Symposium.

[30]  Jean-Bernard Hayet,et al.  Collaborative Multi-Camera Tracking of Athletes in Team Sports , 2006 .

[31]  Jun-ichi Hasegawa,et al.  Development of motion analysis system for quantitative evaluation of teamwork in soccer games , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[32]  Michael Beetz,et al.  Visually Tracking Football Games Based on TV Broadcasts , 2007, IJCAI.