Calibrating Cameras in Poor-Conditioned Pitch-Based Sports Games

Camera calibration is a preliminary step in sports analytics which enables us to transform player positions to standard playing area coordinates. While many camera calibration systems work well when the visual content contains sufficient clues, such as a key frame, calibrating without such information, such as may be needed when processing footage captured by a coach from the sidelines or stands, is challenging. In this paper an innovative automatic camera calibration system, which does not make use of any key frames, is presented for sports analytics. The proposed system consists of three components: a robust linear panorama module, a playing area estimation module, and a homography estimation module. It can eliminate distortion and calibrate the camera in each frame simultaneously, using correspondences between pairs of consecutive frames. Experiments on real data evaluate the performance and demonstrate the robustness of the system.

[1]  Michael Elad,et al.  The Generalized Eigenvalue Problem for Nonsquare Pencils Using a Minimal Perturbation Approach , 2005, SIAM J. Matrix Anal. Appl..

[2]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[3]  Min-Chun Hu,et al.  Robust Camera Calibration and Player Tracking in Broadcast Basketball Video , 2011, IEEE Transactions on Multimedia.

[4]  José M. Soto-Hidalgo,et al.  A fuzzy approach for retrieving images in databases using dominant color and texture descriptors , 2010, International Conference on Fuzzy Systems.

[5]  Hung-Kuo Chu,et al.  Court Reconstruction for Camera Calibration in Broadcast Basketball Videos. , 2016, IEEE transactions on visualization and computer graphics.

[6]  Sridha Sridharan,et al.  Understanding and analyzing a large collection of archived swimming videos , 2014, IEEE Winter Conference on Applications of Computer Vision.

[7]  James J. Little,et al.  Learning to Track and Identify Players from Broadcast Sports Videos , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michael Unser,et al.  Multiresolution moment filters: theory and applications , 2004, IEEE Transactions on Image Processing.

[9]  Aleksandra Mojsilovic,et al.  Adaptive perceptual color-texture image segmentation , 2005, IEEE Transactions on Image Processing.

[10]  Ehud Rivlin,et al.  Color Invariants for Person Reidentification , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Christopher O. Jaynes,et al.  Overconstrained Linear Estimation of Radial Distortion and Multi-view Geometry , 2006, ECCV.

[12]  Peter H. N. de With,et al.  Broadcast Court-Net Sports Video Analysis Using Fast 3-D Camera Modeling , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  Matthew A. Brown,et al.  Automatic Panoramic Image Stitching using Invariant Features , 2007, International Journal of Computer Vision.

[14]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[15]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[16]  Dongqing Zhang,et al.  Color filter for image search , 2012, ACM Multimedia.

[17]  Sridha Sridharan,et al.  Practical Improvements to Simultaneous Computation of Multi-view Geometry and Radial Lens Distortion , 2011, 2011 International Conference on Digital Image Computing: Techniques and Applications.

[18]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Vincent Lepetit,et al.  DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline Stereo , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.