3D sequence generation from multiple cameras

An approach for the generation of 3D surface model sequences from a set of synchronised, calibrated cameras is presented. The method is based on the computation of the visual-hull. An analysis classifies typical error sources for artefacts in the reconstructed 3D models into occlusion, approximation and sampling errors. For the synthesis of new images for TV- and film-applications the roughness of the reconstructed 3D models has shown to be very disturbing. In order to reduce this roughness two methods are used sequentially: a new super-sampling approach that reduces the sampling error, and a Gaussian surface smoothing. The application of the modelling results from a 12 camera studio system is shown for the generation of virtual views of moving actors in standard post-production packages.

[1]  Xiaojun Wu,et al.  Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Oliver Grau.  Studio production system for dynamic 3D content , 2003, Visual Communications and Image Processing.

[3]  Richard Szeliski,et al.  Rapid octree construction from image sequences , 1993 .

[4]  Michael Potmesil.  Generating octree models of 3D objects from their silhouettes in a sequence of images , 1987, Comput. Vis. Graph. Image Process..

[5]  Takeo Kanade,et al.  Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Oliver Grau,et al.  A combined studio production system for 3-D capturing of live action and immersive actor feedback , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Oliver Grau,et al.  A FAST AND ACCURATE METHOD FOR 3D SURFACE RECONSTRUCTION FROM IMAGE SILHOUETTES , 2003 .

[8]  William E. Lorensen,et al.  Marching cubes: a high resolution 3D surface construction algorithm , 1996 .

[9]  Ramesh Raskar,et al.  Image-based visual hulls , 2000, SIGGRAPH.

[10]  William E. Lorensen,et al.  Marching cubes: A high resolution 3D surface construction algorithm , 1987, SIGGRAPH.

[11]  Michael Garland,et al.  Simplifying surfaces with color and texture using quadric error metrics , 1998, Proceedings Visualization '98 (Cat. No.98CB36276).

[12]  Wolfgang Niem,et al.  Robust and fast modeling of 3D natural objects from multiple views , 1994, Electronic Imaging.