Model-based segmentation and estimation of 3D surfaces from two or more intensity images using Markov random fields

An approach and algorithm for 3D primitive model recognition, parameter estimation, and segmentation from a sequence of images taken by one or more calibrated cameras are presented. Though the approach and algorithm are applicable to more general models, the experiments described are for primitive objects that are 3D planes. Given two or more images taken by one or more calibrated cameras, the algorithm simultaneously segments the images and 3D space into regions, each region associated with a single planar patch, and estimates the parameters of the 3D plane associated with each segmented region. The algorithm is suitable for parallel processing and should function at close to the best possible accuracy. Markov random fields are used to provide very coarse prior knowledge of the regions occupied by the planar patches, resulting in markedly enhanced accuracy.<<ETX>>

[1]  David B. Cooper,et al.  On Optimally Combining Pieces of Information, with Application to Estimating 3-D Complex-Object Position from Range Data , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Ruud M. Bolle,et al.  Visual recognition using concurrent and layered parameter networks , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[3]  Charles W. Therrien,et al.  An estimation-theoretic approach to terrain image segmentation , 1983, Comput. Vis. Graph. Image Process..

[4]  David B. Cooper,et al.  Bayesian Clustering for Unsupervised Estimation of Surface and Texture Models , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  J. Besag.  Spatial Interaction and the Statistical Analysis of Lattice Systems , 1974 .

[6]  David B. Cooper,et al.  Toward a Model-Based Bayesian Theory for Estimating and Recognizing Parameterized 3-D Objects Using Two or More Images Taken from Different Positions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[8]  J. Besag.  On the Statistical Analysis of Dirty Pictures , 1986 .

[9]  F. Spitzer.  Markov Random Fields and Gibbs Ensembles , 1971 .

[10]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[11]  R. Szeliski,et al.  Incremental estimation of dense depth maps from image sequences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.