Court Reconstruction for Camera Calibration in Broadcast Basketball Videos

We introduce a technique of calibrating camera motions in basketball videos. Our method particularly transforms player positions to standard basketball court coordinates and enables applications such as tactical analysis and semantic basketball video retrieval. To achieve a robust calibration, we reconstruct the panoramic basketball court from a video, followed by warping the panoramic court to a standard one. As opposed to previous approaches, which individually detect the court lines and corners of each video frame, our technique considers all video frames simultaneously to achieve calibration; hence, it is robust to illumination changes and player occlusions. To demonstrate the feasibility of our technique, we present a stroke-based system that allows users to retrieve basketball videos. Our system tracks player trajectories from broadcast basketball videos. It then rectifies the trajectories to a standard basketball court by using our camera calibration method. Consequently, users can apply stroke queries to indicate how the players move in gameplay during retrieval. The main advantage of this interface is an explicit query of basketball videos so that unwanted outcomes can be prevented. We show the results in Figs. 1, 7, 9, 10 and our accompanying video to exhibit the feasibility of our technique.

[1]  Alan Fern,et al.  Improved Video Registration using Non-Distinctive Local Image Features , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Marc Pollefeys,et al.  PTZ camera network calibration from moving people in sports broadcasts , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[3]  Christophe De Vleeschouwer,et al.  Graph-based filtering of ballistic trajectory , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[4]  James J. Little,et al.  AUTOMATIC RECTIFICATION OF LONG IMAGE SEQUENCES , 2003 .

[5]  Loong Fah Cheong,et al.  Automatic camera calibration of broadcast tennis video with applications to 3D virtual content insertion and ball detection and tracking , 2009, Comput. Vis. Image Underst..

[6]  Chong-Wah Ngo,et al.  Towards optimal bag-of-features for object categorization and semantic video retrieval , 2007, CIVR '07.

[7]  Peter H. N. de With,et al.  A real-time augmented-reality system for sports broadcast video enhancement , 2007, ACM Multimedia.

[8]  James J. Little,et al.  Using Line and Ellipse Features for Rectification of Broadcast Hockey Video , 2011, 2011 Canadian Conference on Computer and Robot Vision.

[9]  Margaret Varga,et al.  Practical Image Processing and Computer Vision , 2012 .

[10]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Christophe De Vleeschouwer,et al.  Automatic production of personalized basketball video summaries from multi-sensored data , 2010, 2010 IEEE International Conference on Image Processing.

[12]  Wolfgang Effelsberg,et al.  Robust camera calibration for sport videos using court models , 2003, IS&T/SPIE Electronic Imaging.

[13]  Min-Chun Hu,et al.  Robust Camera Calibration and Player Tracking in Broadcast Basketball Video , 2011, IEEE Transactions on Multimedia.

[14]  Chao Huang,et al.  A new Method for Shot Identification in Basketball Video , 2011, J. Softw..

[15]  Yaser Sheikh,et al.  Point-less calibration: Camera parameters from gradient-based alignment to edge images , 2012, 2012 IEEE Workshop on the Applications of Computer Vision (WACV).

[16]  Jonathon Shlens,et al.  A Tutorial on Principal Component Analysis , 2014, ArXiv.

[17]  Christophe De Vleeschouwer,et al.  Demo: Spatio-temporal template matching for ball detection , 2011, 2011 Fifth ACM/IEEE International Conference on Distributed Smart Cameras.

[18]  Hua-Tsung Chen,et al.  Physics-based ball tracking and 3D trajectory reconstruction with applications to shooting location estimation in basketball video , 2009, J. Vis. Commun. Image Represent..

[19]  Li Li,et al.  A Survey on Visual Content-Based Video Indexing and Retrieval , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[20]  Clement T. Yu,et al.  Techniques and Systems for Image and Video Retrieval , 1999, IEEE Trans. Knowl. Data Eng..

[21]  Rynson W. H. Lau,et al.  Visual Tracking via Locality Sensitive Histograms , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Christophe De Vleeschouwer,et al.  Recognition of sport players' numbers using fast-color segmentation , 2012, Other Conferences.

[23]  Peter H. N. de With,et al.  Fast camera calibration for the analysis of sport sequences , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[24]  Christophe De Vleeschouwer,et al.  Personalized production of basketball videos from multi-sensored data under limited display resolution , 2010, Comput. Vis. Image Underst..

[25]  James J. Little,et al.  Learning to Track and Identify Players from Broadcast Sports Videos , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Kaj Madsen,et al.  Methods for Non-Linear Least Squares Problems (2nd ed.) , 2004 .

[27]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Desmond Elliott,et al.  Supporting aspect-based video browsing: analysis of a user study , 2009, CIVR '09.

[29]  Kuo-Chin Fan,et al.  Motion Flow-Based Video Retrieval , 2007, IEEE Transactions on Multimedia.

[30]  Stefan Wrobel,et al.  Visual analytics tools for analysis of movement data , 2007, SKDD.

[31]  Alan Hanjalic,et al.  Shot-boundary detection: unraveled and resolved? , 2002, IEEE Trans. Circuits Syst. Video Technol..