A Comparative Study of Free-Viewpoint Video Techniques For sports events

This paper presents a quantitative analysis of free-viewpoint video techniques applied to the problem of virtual view synthesis in sports events. A consideration of errors in the synthesis pipeline is presented along with a taxonomy of these errors and a framework for evaluating the quality of view synthesis when compared to ground truth. Three reconstruction techniques are evaluated, billboarding, shape from silhouette and view-dependent shape from silhouette. View-dependent rendering is used for virtual view synthesis. It is shown that currently the shape from silhouette technique provides the best completeness, while the view-dependent shape from silhouette technique provides the best appearance.

[1]  Adrian Hilton,et al.  Virtual view synthesis of people from multiple view video sequences , 2005, Graph. Model..

[2]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[3]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[4]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[5]  Hans-Peter Seidel,et al.  Free-viewpoint video of human actors , 2003, ACM Trans. Graph..

[6]  Yizhou Yu,et al.  Efficient View-Dependent Image-Based Rendering with Projective Texture-Mapping , 1998, Rendering Techniques.

[7]  David Salesin,et al.  A Bayesian approach to digital matting , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Takeo Kanade,et al.  Image-based spatio-temporal modeling and view interpolation of dynamic events , 2005, TOGS.

[9]  Edmond Boyer,et al.  Fusion of multiview silhouette cues using a space occupancy grid , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Adrian Hilton,et al.  Exact View-Dependent Visual Hulls , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Richard Szeliski,et al.  High-quality video view interpolation using a layered representation , 2004, SIGGRAPH 2004.

[13]  I. Kitahara,et al.  Live mixed-reality 3D video in soccer stadium , 2003, The Second IEEE and ACM International Symposium on Mixed and Augmented Reality, 2003. Proceedings..

[14]  Hideo Saito,et al.  Arbitrary viewpoint observation for soccer match video , 2004 .

[15]  Kiriakos N. Kutulakos.  Approximate N-View Stereo , 2000, ECCV.

[16]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[17]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[18]  Ian D. Reid,et al.  A Multiple View Layered Representation for Dynamic Novel View Synthesis , 2003, BMVC.

[19]  Saied Moezzi,et al.  Virtual View Generation for 3D Digital Video , 1997, IEEE Multim..

[20]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..