Surface segmentation and modeling of 3D polygonal objects from stereoscopic image pairs

An approach to automatically generate 3D polygonal models from stereoscopic image pairs of piecewise planar objects is presented. Dense disparity maps are computed by constrained epipolar block matching. Local surface orientations are computed from the quantized disparity map using a spline approximation under explicit consideration of quantization noise. The local surface orientation is then clustered into regions of similar surface orientation to find the dominant object planes. A photo realistic 3D polygonal model of the object is constructed by fitting planar polygons to the surfaces and by mapping original image texture to the model.

[1]  H. Barlow.  Vision: A computational investigation into the human representation and processing of visual information: David Marr. San Francisco: W. H. Freeman, 1982. pp. xvi + 397 , 1983 .

[2]  Peter No,et al.  Digital Coding of Waveforms , 1986 .

[3]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[4]  Andrew Blake,et al.  Visual Reconstruction , 1987, Deep Learning for EEG-Based Brain–Computer Interfaces.

[5]  Roger Y. Tsai,et al.  A versatile camera calibration technique for high-accuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses , 1987, IEEE J. Robotics Autom..

[6]  Jerry D. Gibson,et al.  Digital coding of waveforms: Principles and applications to speech and video , 1985, Proceedings of the IEEE.

[7]  Demetri Terzopoulos,et al.  The Computation of Visible-Surface Representations , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  N. Jayant,et al.  Digital Coding of Waveforms: Principles and Applications to Speech and Video , 1990 .

[10]  Reinhard Koch,et al.  Automatic modelling of Natural Scenes for Generating Synthetic Movies , 1990, Eurographics.

[11]  Hiroshi Harashima,et al.  Intelligent Image Coding and Communications with Realistic Sensations --Recent Trends-- , 1991 .

[12]  P. Durisch.  Photogrammetry and Computer Graphics for Visual Impact Analysis in Architectur , 1992 .

[13]  Reinhard Koch,et al.  Automatic Reconstruction of Buildings from Stereoscopic Image Sequences , 1993, Comput. Graph. Forum.

[14]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[15]  Yakup Paker,et al.  Image Processing for Broadcast and Video Production , 1995, Workshops in Computing.

[16]  L. Falkenhagen.  Depth Estimation from Stereoscopic Image Pairs Assuming Piecewise Continuos Surfaces , 1995 .

[17]  Reinhard Koch,et al.  3-D surface reconstruction from stereoscopic image sequences , 1995, Proceedings of IEEE International Conference on Computer Vision.

[18]  Oliver Grau,et al.  Use of Explicit Knowledge for the Reconstruction of 3-D Object Geometry , 1995, CAIP.

[19]  Laurent Blonde.  The MONA LISA Project, General Presentation , 1995 .

[20]  W. Niem,et al.  Automatic Modelling of 3D Natural Objects from Multiple Views , 1995 .

[21]  Oliver Grau,et al.  A Knowledge Based Scene Analysis System for the Generation of 3-D Models , 1996 .