A Free-Viewpoint Video System for Visualization of Sport Scenes

This paper introduces a new approach to using multicamera images of an event to provide a free-viewpoint video visualization of sport scenes. This allows a virtual camera to be moved freely around, and to view the action from any angle. The system is based on 3-D reconstruction techniques previously developed for studio use. A number of different 3-D representations, including billboards, visual hulls, and view-dependent geometry are evaluated for the purpose. First results show the potential of the new approach for action replay and strategy analysis of sport scenes. Current limitations of the 3-D representations are discussed in the context of a practical use of the system.

[1]  Thomas Malzbender,et al.  A Survey of Methods for Volumetric Scene Reconstruction from Photographs , 2001, VG.

[2]  Adrian Hilton,et al.  Virtual view synthesis of people from multiple view video sequences , 2005, Graph. Model..

[3]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[4]  Oliver Grau,et al.  Use of 3D techniques for virtual production , 2000, IS&T/SPIE Electronic Imaging.

[5]  Adrian Hilton,et al.  Video-based character animation , 2005, SCA '05.

[6]  Miller,et al.  Interactive Free-Viewpoint Video , 2006 .

[7]  Yu Meng,et al.  Dmesh: Fast Depth-Image Meshing And Warping , 2004, Int. J. Image Graph..

[8]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[9]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[10]  Adrian Hilton,et al.  Model-based multiple view reconstruction of people , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[11]  S. B. Kang,et al.  Survey of image-based representations and compression techniques , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.