Feature extraction, image segmentation, and scene reconstruction

This paper presents a scene reconstruction system that takes a pair of register range and intensity images, extracts features from both images to create feature maps, fuses these feature maps, segments the fused image, and fits surfaces to the objects in the scenes. The feature extraction locates both step edges and crease edges from the data. Edges are extracted from the intensity image using the gradient magnitude and crease edges are extracted from the range image using the gradient of the surface normal Dempster-Shafer fusion is performed on the resulting feature maps. Image segmentation is performed using a morphological watershed algorithm. Finally three-dimensional planes, spheres, and cylinders are fit to regions in the segmented scene by a least-squares optimization process.