Person tracking for ambient camera selection in complex sports environments

As pervasive computing technologies are gradually penetrating sport, we are witnessing a proliferating number of research systems that can track athletes during training and/or in competition. Indeed, athlete tracking is a particularly challenging research tasks, which is also a key enabler for a wide range of applications such as ambient personalized broadcasting. In this paper we survey person tracking systems for sport applications and illustrate their limitations for realistic sports environments. As a real-life example we present the robust and high-performance person tracking system developed at the Athens Information Technology, and explain its inability to deal with occlusions, interlacing, adverse and changing light conditions and mostly the strain of the athletes, which are very common in high activity athletic scenes. We also present techniques for dealing with these challenges, along with an architecture for building ambient camera selection environments for broadcasting purposes. These techniques form the basis for the person tracking and ambient camera selection systems that are developed in the scope of the my-e-Director 2012 EC project, which is working towards a realistic prototype system for the London 2012 Olympics.

[1]  A. Pnevmatikakis,et al.  Robust Estimation of Background for Fixed Cameras , 2006, 2006 15th International Conference on Computing.

[2]  Justus H. Piater,et al.  A modular multi-camera framework for team sports tracking , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[3]  Patrick Pérez,et al.  Data fusion for visual tracking with particles , 2004, Proceedings of the IEEE.

[4]  Aristodemos Pnevmatikakis,et al.  The AIT Outdoor Tracker for Vehicles and Pedestrians in CLEAR2007 , 2007, CLEAR.

[5]  Gaetano Borriello,et al.  Guest Editors' Introduction: Pervasive Computing in Sports Technologies , 2005, IEEE Pervasive Comput..

[6]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[7]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Roger D. Boyle,et al.  Tracking multiple sports players through occlusion, congestion and scale , 2001, BMVC.

[9]  Gary Bradski,et al.  Learning-Based Computer Vision with Intels Open Source Computer Vision Library , 2005 .

[10]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[11]  James J. Little,et al.  A Boosted Particle Filter: Multitarget Detection and Tracking , 2004, ECCV.

[12]  Roberto Brunelli,et al.  A Generative Approach to Audio-Visual Person Tracking , 2006, CLEAR.

[13]  Neil J. Gordon,et al.  A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking , 2002, IEEE Trans. Signal Process..

[14]  Jean-Bernard Hayet,et al.  Collaborative Multi-Camera Tracking of Athletes in Team Sports , 2006 .

[15]  Yves Jean,et al.  Real time tracking for enhanced tennis broadcasts , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[16]  Brian C. Lovell,et al.  Visual tracking for sports applications , 2005 .

[17]  David J. Fleet,et al.  Monocular 3D tracking of the golf swing , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[18]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jan Skaloud,et al.  Athletic Analysis With a Racing Heart , 2001 .

[20]  Ming Xu,et al.  Architecture and algorithms for tracking football players with multiple cameras , 2005 .