A Low-Cost Computer Vision System for Real-Time Tennis Analysis

This paper describes a low-cost vision-based system for real-time tennis game analysis. The system elaborates videos captured by four synchronized and calibrated cameras installed at the sides of the court in order to accurately localize ball and players, and track them in real-time. From this low-level data mid-level events, like shots, bounces, ball in net, and high-level events, like stroke type and line calling, are detected. All this data is made available to the players both on-court during the play or through a web device at the end of the session. Currently, system prototypes are undergoing a field test in three locations in Italy. In addition to positive comments of users, robustness and reliability of the system have been demonstrated with specific evaluation tests. Detection rate of shots is 99.7% while miss detection rate is less than 0.8%. Reliability of the stroke classification is 97.1% and of in/out evaluation is 99.5%. On average reaction time for line calling is 152 ms.

[1]  H. Brody Bounce of a tennis ball. , 2003, Journal of science and medicine in sport.

[2]  Songlin Nie,et al.  Effects of key structural parameters on solid–liquid separation behavior of hydrocyclone separator applied to hydraulic oil purification , 2013 .

[3]  Vito Renó,et al.  A technology platform for automatic high-level tennis game analysis , 2017, Comput. Vis. Image Underst..

[4]  R. Cross The bounce of a ball , 1999 .

[5]  Yves Jean,et al.  LucentVision: converting real world events into multimedia experiences , 2000, 2000 IEEE International Conference on Multimedia and Expo. ICME2000. Proceedings. Latest Advances in the Fast Changing World of Multimedia (Cat. No.00TH8532).

[6]  Adrian Hilton,et al.  Computer vision for sports: Current applications and research topics , 2017, Comput. Vis. Image Underst..

[7]  N. Owens,et al.  Hawk-eye tennis system , 2003 .

[8]  R. Cross Measurements of the horizontal coefficient of restitution for a superball and a tennis ball , 2002 .

[9]  Noel E. O'Connor,et al.  TennisSense: A platform for extracting semantic information from multi-camera tennis data , 2009, 2009 16th International Conference on Digital Signal Processing.

[10]  Yves Jean,et al.  Instantly indexed multimedia databases of real world events , 2002, IEEE Trans. Multim..

[11]  Livier Reithler,et al.  Physics based 3D ball tracking for tennis videos , 2010, 2010 International Workshop on Content Based Multimedia Indexing (CBMI).

[12]  Stefano Messelodi,et al.  A Kalman Filter Based Background Updating Algorithm Robust to Sharp Illumination Changes , 2005, ICIAP.

[13]  David Windridge,et al.  Automatic annotation of tennis games: An integration of audio, vision, and learning , 2014, Image Vis. Comput..

[14]  Noel E. O'Connor,et al.  An automatic visual analysis system for tennis , 2013 .

[15]  Arit Thammano,et al.  Players tracking and ball detection for an automatic tennis video annotation , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[16]  Rod Cross The footprint of a tennis ball , 2014 .

[17]  Yan Baodong Hawkeye technology using tennis match , 2014 .

[18]  Wook-Sung Yoo,et al.  Painless Tennis Ball Tracking System , 2018, 2018 IEEE 42nd Annual Computer Software and Applications Conference (COMPSAC).

[19]  Rod Cross,et al.  Measurements of drag and lift on tennis balls in flight , 2014 .