3 D Reconstruction through Segmentation of MultiView Image Sequences

We propose what we believe is a new approach to 3D reconstruction through the design of a 3D voxel volume, such that all the image information and camera geometry are embedded into one feature space. By customising the volume to be suitable for segmentation, the key idea that we propose is the recovery of a 3D scene through the use of globally optimal geodesic active contours. We also present an extension to this idea by proposing the novel design of a 4D voxel volume to analyse the stereo motion problem in multi-view image sequences.

[1]  Hugues Talbot,et al.  Globally Optimal Geodesic Active Contours , 2005, Journal of Mathematical Imaging and Vision.

[2]  Wolfgang Effelsberg,et al.  Fast Implicit Active Contour Models , 2002, DAGM-Symposium.

[3]  O. Faugeras,et al.  Variational principles, surface evolution, PDE's, level set methods and the stereo problem , 1998, 5th IEEE EMBS International Summer School on Biomedical Imaging, 2002..

[4]  Vladimir Kolmogorov,et al.  Multi-camera Scene Reconstruction via Graph Cuts , 2002, ECCV.

[5]  Changming Sun,et al.  Fast Stereo Matching Using Rectangular Subregioning and 3D Maximum-Surface Techniques , 2002, International Journal of Computer Vision.

[6]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Takeo Kanade,et al.  3D voxel construction based on epipolar geometry , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[8]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[9]  Davi Geiger,et al.  Occlusions, Discontinuities, and Epipolar Lines in Stereo , 1998, ECCV.

[10]  Max A. Viergever,et al.  Efficient and reliable schemes for nonlinear diffusion filtering , 1998, IEEE Trans. Image Process..

[11]  Ingemar J. Cox,et al.  A maximum-flow formulation of the N-camera stereo correspondence problem , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[12]  Pascal Fua,et al.  From Multiple Stereo Views to Multiple 3-D Surfaces , 1997, International Journal of Computer Vision.

[13]  Michael Buckley,et al.  Regularised shortest-path extraction , 1997, Pattern Recognit. Lett..

[14]  S. Seitz,et al.  Photorealistic Scene Reconstruction by Voxel Coloring , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[15]  Robert T. Collins,et al.  A space-sweep approach to true multi-image matching , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[16]  Ingemar J. Cox,et al.  A Maximum Likelihood Stereo Algorithm , 1996, Comput. Vis. Image Underst..

[17]  Reinhard Koch,et al.  3-D surface reconstruction from stereoscopic image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[18]  R. Kimmel,et al.  Geodesic Active Contours , 1995, Proceedings of IEEE International Conference on Computer Vision.

[19]  J. Sethian,et al.  A Fast Level Set Method for Propagating Interfaces , 1995 .

[20]  Zhengyou Zhang,et al.  Motion and structure of four points from one motion of a stereo rig with unknown extrinsic parameters , 1993, Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Alan L. Yuille,et al.  Occlusions and binocular stereo , 1992, International Journal of Computer Vision.

[22]  Takeo Kanade,et al.  A multiple-baseline stereo , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  Allen M. Waxman,et al.  Binocular Image Flows: Steps Toward Stereo-Motion Fusion , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  T. Poggio,et al.  A generalized ordering constraint for stereo correspondence , 1984 .

[25]  R. Weale.  Vision. A Computational Investigation Into the Human Representation and Processing of Visual Information. David Marr , 1983 .

[26]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[27]  Philippos Mordohai,et al.  Binocular and Multiple View Stereo using Tensor Voting , 2003 .

[28]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[29]  Paul W. Fieguth,et al.  Incremental shape reconstruction using stereo image sequences , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[30]  Gang Xu.  Unication of Stereo, Motion and Object Recognition via Epipolar Geometry , 1995 .

[31]  P. Fua.  From Multiple Stereo Views to Multiple 3-D Surfaces , 2022 .