Enforcing Consistency of 3D Scenes with Multiple Objects Using Shape-from-Contours

In this paper we present a new approach for modelling scenes with multiple 3D objects from images taken from various viewpoints. Such images are segmented using either supervised or unsupervised algorithms. We consider the mean-shift and support vector machines for image segmentation using the colour and texture as features. Back-projections of segmented contours are used to enforce the consistency of the segmented contours with initial estimates of the 3D scene. A study for detecting merged objects in 3D scenes is provided as well.

[1]  R. Cipolla,et al.  A probabilistic framework for space carving , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[2]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Chen Liang,et al.  Robust Recovery of Shapes with Unknown Topology from the Dual Space , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jean Ponce,et al.  Projective Visual Hulls , 2007, International Journal of Computer Vision.

[5]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[6]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Adrian G. Bors,et al.  Enforcing image consistency in multiple 3-D object modelling , 2008, 2008 19th International Conference on Pattern Recognition.

[8]  Greg Turk,et al.  Reconstructing Surfaces by Volumetric Regularization Using Radial Basis Functions , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Radu Horaud,et al.  Topology-Adaptive Mesh Deformation for Surface Evolution, Morphing, and Multiview Reconstruction , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Bernhard Schölkopf,et al.  Comparing support vector machines with Gaussian kernels to radial basis function classifiers , 1997, IEEE Trans. Signal Process..

[11]  George Drettakis,et al.  Silhouette-Aware Warping for Image-Based Rendering - Supplementary material , 2011 .