Edge detection and labeling by fusion of intensity and range images

We have developed an energy minimization approach for detection and labeling of edges by fusing information from registered intensity and range images. The chosen set of labels for the edges (jump, crease, intensity, no edge) is a classification based on the physical properties of the surfaces in the scene. Bayesian formulation is used to combine the different information sources and the a priori knowledge about the labels is modeled by a Markov random field. Results of applying the labeling algorithm on several real image pairs indicate that it is possible to detect as well as label the jump, crease, and intensity edges accurately using this approach.