MCMLSD: A Dynamic Programming Approach to Line Segment Detection

Prior approaches to line segment detection typically involve perceptual grouping in the image domain or global accumulation in the Hough domain. Here we propose a probabilistic algorithm that merges the advantages of both approaches. In a first stage lines are detected using a global probabilistic Hough approach. In the second stage each detected line is analyzed in the image domain to localize the line segments that generated the peak in the Hough map. By limiting search to a line, the distribution of segments over the sequence of points on the line can be modeled as a Markov chain, and a probabilistically optimal labelling can be computed exactly using a standard dynamic programming algorithm, in linear time. The Markov assumption also leads to an intuitive ranking method that uses the local marginal posterior probabilities to estimate the expected number of correctly labelled points on a segment. To assess the resulting Markov Chain Marginal Line Segment Detector (MCMLSD) we develop and apply a novel quantitative evaluation methodology that controls for under-and over-segmentation. Evaluation on the YorkUrbanDB dataset shows that the proposed MCMLSD method outperforms the state-of-the-art by a substantial margin.

[1]  Saeid Nahavandi,et al.  Intelligent Line Segment Perception With Cortex-Like Mechanisms , 2015, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  James M. Coughlan,et al.  Manhattan World: Orientation and Outlier Detection by Bayesian Inference , 2003, Neural Computation.

[3]  Horst Bischof,et al.  Efficient 3D scene abstraction using line segments , 2017, Comput. Vis. Image Underst..

[4]  Lionel Moisan,et al.  Meaningful Alignments , 2000, International Journal of Computer Vision.

[5]  Bok-Suk Shin,et al.  Accurate and Robust Line Segment Extraction Using Minimum Entropy With Hough Transform , 2015, IEEE Transactions on Image Processing.

[6]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..

[7]  James H. Elder,et al.  Efficient Edge-Based Methods for Estimating Manhattan Frames in Urban Imagery , 2008, ECCV.

[8]  Pietro Parodi,et al.  3D Shape Reconstruction by Using Vanishing Points , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Pushmeet Kohli,et al.  On Detection of Multiple Object Instances Using Hough Transforms , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jiri Matas,et al.  Robust Detection of Lines Using the Progressive Probabilistic Hough Transform , 2000, Comput. Vis. Image Underst..

[11]  Steven W. Zucker,et al.  Local Scale Control for Edge Detection and Blur Estimation , 1996, ECCV.

[12]  Yoshihisa Shinagawa,et al.  Accurate and robust line segment extraction by analyzing distribution around peaks in Hough space , 2003, Comput. Vis. Image Underst..

[13]  Narciso García,et al.  Line segment detection using weighted mean shift procedures on a 2D slice sampling strategy , 2011, Pattern Analysis and Applications.

[14]  Bok-Suk Shin,et al.  Closed form line-segment extraction using the Hough transform , 2015, Pattern Recognit..

[15]  Wei Zhang,et al.  Video Compass , 2002, ECCV.

[16]  David Windridge,et al.  A generalisable framework for saliency-based line segment detection , 2015, Pattern Recognit..

[17]  Dong Liu,et al.  A robust and fast line segment detector based on top-down smaller eigenvalue analysis , 2014, International Conference on Graphic and Image Processing.

[18]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Julio Villalba,et al.  A fast Hough transform for segment detection , 1995, IEEE Trans. Image Process..

[20]  H. Kuhn The Hungarian method for the assignment problem , 1955 .

[21]  Reinhard Koch,et al.  Structure and motion from line correspondences: Representation, projection, initialization and sparse bundle adjustment , 2014, J. Vis. Commun. Image Represent..

[22]  Cordelia Schmid,et al.  Automatic line matching across views , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[23]  James H. Elder,et al.  An Accurate Method for Line Detection and Manhattan Frame Estimation , 2012, ACCV Workshops.

[24]  P. Nagabhushan,et al.  A simple and robust line detection algorithm based on small eigenvalue analysis , 2004, Pattern Recognit. Lett..

[25]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[26]  Bok-Suk Shin,et al.  A statistical method for line segment detection , 2015, Comput. Vis. Image Underst..

[27]  Subramaniam Ganesan,et al.  Complete description of multiple line segments using the Hough transform , 1998, Image Vis. Comput..

[28]  Sukhan Lee,et al.  Extracting Major Lines by Recruiting Zero-Threshold Canny Edge Links along Sobel Highlights , 2015, IEEE Signal Processing Letters.

[29]  Li Li,et al.  CannyLines: A parameter-free line segment detector , 2015, 2015 IEEE International Conference on Image Processing (ICIP).