MRF Labeling for Multi-view Range Image Integration

Multi-view range image integration focuses on producing a single reasonable 3D point cloud from multiple 2.5D range images for the reconstruction of a watertight manifold surface. However, registration errors and scanning noise usually lead to a poor integration and, as a result, the reconstructed surface cannot have topology and geometry consistent with the data source. This paper proposes a novel method cast in the framework of Markov random fields (MRF) to address the problem. We define a probabilistic description of a MRF labeling based on all input range images and then employ loopy belief propagation to solve this MRF, leading to a globally optimised integration with accurate local details. Experiments show the advantages and superiority of our MRF-based approach over existing methods.

[1]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[2]  C. Lee,et al.  A new scheme for the generation of a graded quadrilateral mesh , 1994 .

[3]  Martin Rutishauser,et al.  Merging range images of arbitrarily shaped objects , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Luiz Velho,et al.  Smooth Surface Reconstruction from Noisy Clouds , 2004, J. Braz. Comput. Soc..

[5]  Gang Wang,et al.  Registration and Integration of Multiple Object Views for 3D Model Construction , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Adrian Hilton,et al.  Reliable Surface Reconstructiuon from Multiple Range Images , 1996, ECCV.

[7]  Vladimir Kolmogorov,et al.  What energy functions can be minimized via graph cuts? , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Rudi Deklerck,et al.  Markov random field-based clustering applied to the segmentation of masses in digital mammograms , 2008, Comput. Medical Imaging Graph..

[9]  Han Wang,et al.  Markov random field modeled range image segmentation , 2003, Fourth International Conference on Information, Communications and Signal Processing, 2003 and the Fourth Pacific Rim Conference on Multimedia. Proceedings of the 2003 Joint.

[10]  Marc Levoy,et al.  Real-time 3D model acquisition , 2002, ACM Trans. Graph..

[11]  Hong Zhou,et al.  Accurate integration of multi-view range images using k-means clustering , 2008, Pattern Recognit..

[12]  Pedro F. Felzenszwalb,et al.  Efficient belief propagation for early vision , 2004, CVPR 2004.

[13]  Katsushi Ikeuchi,et al.  Adaptively merging large-scale range data with reflectance properties , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Xiaokun Li,et al.  Range image fusion for object reconstruction and modeling , 2004, First Canadian Conference on Computer and Robot Vision, 2004. Proceedings..

[15]  Xiao Wang,et al.  Markov random field modeled range image segmentation , 2004, Pattern Recognit. Lett..

[16]  William T. Freeman,et al.  Understanding belief propagation and its generalizations , 2003 .

[17]  Kiriakos N. Kutulakos,et al.  A Theory of Shape by Space Carving , 2000, International Journal of Computer Vision.

[18]  Y. Liu,et al.  Incremental point-based integration of registered multiple range images , 2005, 31st Annual Conference of IEEE Industrial Electronics Society, 2005. IECON 2005..

[19]  Hong Zhou,et al.  A Clustering Approach to Free Form Surface Reconstruction from Multi-view Range Images , 2006, ROBIO.

[20]  Olga Veksler,et al.  Fast Approximate Energy Minimization via Graph Cuts , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Stan Z. Li,et al.  Markov Random Field Modeling in Computer Vision , 1995, Computer Science Workbench.

[22]  Yonghuai Liu,et al.  Automatic 3d free form shape matching using the graduated assignment algorithm , 2005, Pattern Recognit..

[23]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[24]  Joonki Paik,et al.  Surface modeling using multi-view range and color images , 2003, Integr. Comput. Aided Eng..

[25]  Gabriel Taubin,et al.  The ball-pivoting algorithm for surface reconstruction , 1999, IEEE Transactions on Visualization and Computer Graphics.

[26]  Richard Szeliski,et al.  A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Sebastian Thrun,et al.  An Application of Markov Random Fields to Range Sensing , 2005, NIPS.

[28]  Tamal K. Dey,et al.  Tight cocone: a water-tight surface reconstructor , 2003, SM '03.