Physics based 3D ball tracking for tennis videos

Professional sport is a highly competitive field, and training tools are playing an increasingly important role. Recent improvements in sensor technology allow managers to monitor many new factors during training, but analyzing this data is time consuming, thus the need for specialized signal processing techniques. This paper presents our work on high level data extraction from tennis multi-view video. A full video indexing platform has been developed involving an innovative physics-based 3D ball tracking algorithm. This paper focuses on the tracking algorithm, which makes accurate ball tracking possible despite sparse detections and numerous false alarms, and gives access to very interesting parameters for coaching purposes such as bounce location and approximative ball spin. Our tool has been tested by a professional tennis coaching team resulting in very positive feedback.

[2]  Rod Crossa.  Measurements of the horizontal coefficient of restitution for a superball and a tennis ball , 2002 .

[3]  William J. Christmas,et al.  A Maximum A Posteriori Probability Viterbi Data Association Algorithm for Ball Tracking in Sports Video , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  William J. Christmas,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Layered Data Association Using Graph-theoretic Formulation with Application to Tennis Ball Tracking in Monocular Sequences , 2022 .

[5]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[6]  Balasubramanian Raman,et al.  Automated Stroke Classification in Tennis , 2007, ICIAR.

[7]  Jungong Han,et al.  Ball-path inference based on a combination of audio and video clues in tennis video sequences , 2006 .

[8]  Peter H. N. de With,et al.  Generic 3-D Modeling for Content Analysis of Court-Net Sports Sequences , 2007, MMM.

[9]  Gordon Hunter,et al.  Modelling Tennis Rallies Using Information from both Video and Audio Signals , 2007 .

[10]  Willem Jonker,et al.  Recognizing Strokes in Tennis Videos using Hidden Markov Models , 2001, VIIP.

[11]  R. Garwin.  Kinematics of an Ultraelastic Rough Ball , 1969 .

[12]  Alan F. Smeaton,et al.  TennisSense: A Multi-Modal Sensing Platform for Sport , 2009, ERCIM News.

[13]  Firoz Alam,et al.  Effects of Spin on Tennis Ball Aerodynamics: An Experimental and Computational Study , 2007 .

[14]  Jinzi Mao,et al.  Tracking a tennis ball using image processing techniques , 2006 .

[15]  Peter H. N. de With,et al.  A real-time augmented-reality system for sports broadcast video enhancement , 2007, ACM Multimedia.

[16]  Peter H. N. de With,et al.  A unified and efficient framework for court-net sports video analysis using 3D camera modeling , 2007, Electronic Imaging.

[17]  William J. Christmas,et al.  A Tennis Ball Tracking Algorithm for Automatic Annotation of Tennis Match , 2005, BMVC.

[18]  H. Brody,et al.  That’s how the ball bounces , 1984 .

[19]  Anil K. Jain,et al.  Automatic classification of tennis video for high-level content-based retrieval , 1998, Proceedings 1998 IEEE International Workshop on Content-Based Access of Image and Video Database.

[20]  Xinguo Yu,et al.  Trajectory-based ball detection and tracking with aid of homography in broadcast tennis video , 2007, Electronic Imaging.

[21]  Jirí Hrebícek,et al.  Solving Problems in Scientific Computing Using Maple and MATLAB® , 2004, Springer Berlin Heidelberg.