Range image segmentation by an effective jump-diffusion method

This paper presents an effective jump-diffusion method for segmenting a range image and its associated reflectance image in the Bayesian framework. The algorithm works on complex real-world scenes (indoor and outdoor), which consist of an unknown number of objects (or surfaces) of various sizes and types, such as planes, conics, smooth surfaces, and cluttered objects (like trees and bushes). Formulated in the Bayesian framework, the posterior probability is distributed over a solution space with a countable number of subspaces of varying dimensions. The algorithm simulates Markov chains with both reversible jumps and stochastic diffusions to traverse the solution space. The reversible jumps realize the moves between subspaces of different dimensions, such as switching surface models and changing the number of objects. The stochastic Langevin equation realizes diffusions within each subspace. To achieve effective computation, the algorithm precomputes some importance proposal probabilities over multiple scales through Hough transforms, edge detection, and data clustering. The latter are used by the Markov chains for fast mixing. The algorithm is tested on 100 1D simulated data sets for performance analysis on both accuracy and speed. Then, the algorithm is applied to three data sets of range images under the same parameter setting. The results are satisfactory in comparison with manual segmentations.

[1]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[2]  N. Metropolis,et al.  Equation of State Calculations by Fast Computing Machines , 1953, Resonance.

[3]  Andrew W. Fitzgibbon,et al.  An Experimental Comparison of Range Image Segmentation Algorithms , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..

[5]  H. Akaike A Bayesian analysis of the minimum AIC procedure , 1978 .

[6]  L. Tierney Markov Chains for Exploring Posterior Distributions , 1994 .

[7]  Jeffrey H. Shapiro,et al.  Maximum-likelihood laser radar range profiling with the expectation-maximization algorithm , 1992 .

[8]  Raghu Krishnapuram,et al.  Morphological methods for detection and classification of edges in range images , 1992, Journal of Mathematical Imaging and Vision.

[9]  S. Geman,et al.  Diffusions for global optimizations , 1986 .

[10]  Walter R. Gilks,et al.  Bayesian model comparison via jump diffusions , 1995 .

[11]  Adrian Barbu,et al.  Graph partition by Swendsen-Wang cuts , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[12]  Yizong Cheng,et al.  Mean Shift, Mode Seeking, and Clustering , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  A. Wallace,et al.  Outlier removal and discontinuity preserving smoothing of range data , 1996 .

[14]  Martin A. Fischler,et al.  An optimization-based approach to the interpretation of single line drawings as 3D wire frames , 1992, International Journal of Computer Vision.

[15]  David Mumford,et al.  Filtering, Segmentation and Depth , 1993, Lecture Notes in Computer Science.

[16]  David Mumford,et al.  Statistics of range images , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[17]  P. Green Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[18]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Jake K. Aggarwal,et al.  Segmentation of 3D range images using pyramidal data structures , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[20]  Charles V. Stewart,et al.  Model Selection Techniques and Merging Rules for Range Data Segmentation Algorithms , 2000, Comput. Vis. Image Underst..

[21]  Song-Chun Zhu,et al.  How Do Heuristics Expedite Markov Chain Search? Hitting-time Analysis of the Independence Metropolis Sampler , 2003 .

[22]  Michael I. Miller,et al.  REPRESENTATIONS OF KNOWLEDGE IN COMPLEX SYSTEMS , 1994 .

[23]  J. Aggarwal,et al.  Segmentation of 3D range images using pyramidal data structures , 1993 .

[24]  Anil K. Jain,et al.  Surface classification: hypothesis testing and parameter estimation , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[25]  Harry Shum,et al.  Image segmentation by data driven Markov chain Monte Carlo , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[26]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[27]  Robert B. Fisher,et al.  Reconstruction of Planar Surfaces Behind Occlusions in Range Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Ingemar J. Cox,et al.  A Bayesian multiple-hypothesis approach to edge grouping and contour segmentation , 1993, International Journal of Computer Vision.

[29]  Anil K. Jain,et al.  Segmentation and Classification of Range Images , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Ruzena Bajcsy,et al.  Segmentation of range images as the search for geometric parametric models , 1995, International Journal of Computer Vision.

[31]  Ralph R. Martin,et al.  Robust Segmentation of Primitives from Range Data in the Presence of Geometric Degeneracy , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Zhengyou Zhang,et al.  Parameter estimation techniques: a tutorial with application to conic fitting , 1997, Image Vis. Comput..

[33]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[34]  Horst Bunke,et al.  Comparing Curved-Surface Range Image Segmenters , 1998, ICCV.

[35]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Michael J. Black,et al.  On the unification of line processes, outlier rejection, and robust statistics with applications in early vision , 1996, International Journal of Computer Vision.

[37]  Alan L. Yuille,et al.  Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Jeffrey H. Shapiro,et al.  Detecting objects in three-dimensional laser radar range images , 1994 .

[39]  Ioannis Stamos,et al.  Geometry and Texture Recovery of Scenes of Large Scale , 2002, Comput. Vis. Image Underst..