Determining straight line correspondences from intensity images

Abstract This paper presents an algorithm for straight edge extraction from intensity images and an algorithm for straight line matching. In the first part of the paper, straight edge extraction is described. Image data are first processed by the operation of edge support focusing to remove unnecessary image details. An edge support is formed in this process. Then, straight edges are extracted from line support regions, which are segmented from the edge support. In the second part of this paper, we describe straight line matching using a matching function, which characterizes the similarity of edge lines of two images and is based on not only the geometrical relations of the lines but also the information from the intensity images. A technique of two-step matching is applied to reduce the cost of computation. The motivation behind this paper is our work on motion estimation from line correspondences of sequential images where straight edge extraction and matching is an essential first step. The output data of the algorithm can also be used for calibration of stereo camera setups. The results of experiments using indoor and outdoor scene images are shown.

[1]  D Marr,et al.  Theory of edge detection , 1979, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[2]  J. Aggarwal,et al.  LINE-BASED COMPUTATION OF STRUCTURE AND MOTION USING ANGULAR INVARIANCE. , 1986 .

[3]  Azriel Rosenfeld,et al.  An Application of Relaxation Labeling to Line and Curve Enhancement , 1977, IEEE Transactions on Computers.

[4]  K. Ramesh Babu,et al.  Linear Feature Extraction and Description , 1979, IJCAI.

[5]  David Malah,et al.  A study of edge detection algorithms , 1982, Comput. Graph. Image Process..

[6]  Allen R. Hanson,et al.  Extracting Straight Lines , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  R. Wong,et al.  Scene matching with invariant moments , 1978 .

[8]  Ugo Montanari,et al.  On the optimal detection of curves in noisy pictures , 1971, CACM.

[9]  Azriel Rosenfeld,et al.  Using pyramids to detect good continuation , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  J.K. Aggarwal,et al.  Correspondence processes in dynamic scene analysis , 1981, Proceedings of the IEEE.

[11]  Thomas S. Huang,et al.  A linear algorithm for motion estimation using straight line correspondences , 1988, Comput. Vis. Graph. Image Process..

[12]  Ramakant Nevatia,et al.  Matching Images Using Linear Features , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Yoram Yakimovsky,et al.  A system for extracting three-dimensional measurements from a stereo pair of TV cameras , 1976 .

[14]  James H. McIntosh,et al.  Matching straight lines , 1988, Comput. Vis. Graph. Image Process..

[15]  William B. Thompson,et al.  Disparity Analysis of Images , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Richard O. Duda,et al.  Pattern classification and scene analysis , 1974, A Wiley-Interscience publication.

[17]  Olivier D. Faugeras,et al.  Determination of camera location from 2D to 3D line and point correspondences , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[18]  Fredrik Bergholm,et al.  Edge Focusing , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  D Marr,et al.  Cooperative computation of stereo disparity. , 1976, Science.

[20]  Robert M. Haralick,et al.  Digital Step Edges from Zero Crossing of Second Directional Derivatives , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Thomas S. Huang,et al.  Estimation of rigid body motion using straight line correspondences , 1986, Comput. Vis. Graph. Image Process..

[23]  Larry S. Davis,et al.  A survey of edge detection techniques , 1975 .