Automatic camera selection for activity monitoring in a multi-camera system for tennis

In professional tennis training matches, the coach needs to be able to view play from the most appropriate angle in order to monitor players' activities. In this paper, we describe and evaluate a system for automatic camera selection from a network of synchronised cameras within a tennis sporting arena. This work combines synchronised video streams from multiple cameras into a single summary video suitable for critical review by both tennis players and coaches. Using an overhead camera view, our system automatically determines the 2D tennis-court calibration resulting in a mapping that relates a player's position in the overhead camera to their position and size in another camera view in the network. This allows the system to determine the appearance of a player in each of the other cameras and thereby choose the best view for each player via a novel technique. The video summaries are evaluated in end-user studies and shown to provide an efficient means of multi-stream visualisation for tennis player activity monitoring.

[1]  Nirupama Bulusu,et al.  Smart Camera Network Localization Using a 3 D Target , 2008 .

[2]  M. Kovacs,et al.  Applied physiology of tennis performance , 2006, British Journal of Sports Medicine.

[3]  Huang Lee,et al.  Sub-optimal Camera Selection in Practical Vision Networks through Shape Approximation , 2008, ACIVS.

[4]  Shih-Fu Chang,et al.  Real-time personalized sports video filtering and summarization , 2001, MULTIMEDIA '01.

[5]  Noel E. O'Connor,et al.  TennisSense: A platform for extracting semantic information from multi-camera tennis data , 2009, 2009 16th International Conference on Digital Signal Processing.

[6]  Qingming Huang,et al.  Highlight Summarization in Sports Video Based on Replay Detection , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[7]  Noel E. O'Connor,et al.  Event detection in field sports video using audio-visual features and a support vector Machine , 2005, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Sung-Bae Cho,et al.  A Fuzzy Rule-Based System with Ontology for Summarization of Multi-camera Event Sequences , 2008, ICAISC.

[9]  E. Paul Roetert,et al.  Fitness Comparisons Among Three Different Levels of Elite Tennis Players , 1996 .

[10]  Stanislav Sumec Multi Camera Automatic Video Editing , 2004, ICCVG.

[11]  Wu-chi Feng,et al.  3-D Target-Based Distributed Smart Camera Network Localization , 2010, IEEE Transactions on Image Processing.

[12]  Tomás Svoboda,et al.  A Convenient Multicamera Self-Calibration for Virtual Environments , 2005, Presence: Teleoperators & Virtual Environments.

[13]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[14]  Noel E. O'Connor,et al.  Exploiting contextual data for event retrieval in surveillance video , 2009, CIVR '09.

[15]  Noel E. O'Connor,et al.  Using the Discrete Hadamard Transform to Detect Moving Objects in Surveillance Video , 2009, VISAPP.