An Improvement of Line Segment Detection Algorithm Based on Convolutional Neural Network

In order to improve the accuracy and integrity of line segment detection, this paper presents an improved algorithm for line segment detection based on convolutional neural network. First, we use a full convolutional neural network to extract endpoints information from the image, the endpoint information includes the position of the endpoints and the direction of the line connected to the endpoints. Then, we use the stacked hourglass network to generate a line heat map of the image, the larger the value of each pixel in the line heat map, the more likely there is a line. Finally, in order to reduce false detection, a method of generating a straight line combining the endpoint information and the line heat map is proposed. Experimental results show that the algorithm effectively reduce line segment detection errors and improve integrity of line segment detection, and it can be applied to tasks such as 3D reconstruction and scene understanding.

[1]  Nuno Vasconcelos,et al.  Towards Universal Object Detection by Domain Attention , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[4]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[5]  Srikumar Ramalingam,et al.  Novel Single View Constraints for Manhattan 3D Line Reconstruction , 2018, 2018 International Conference on 3D Vision (3DV).

[6]  Jitendra Malik,et al.  Inferring spatial layout from a single image via depth-ordered grouping , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[7]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[8]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[9]  Hui Wei,et al.  Understanding of indoor scenes based on projection of spatial rectangles , 2018, Pattern Recognit..

[10]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  QingheZheng,et al.  A Full Stage Data Augmentation Method in Deep Convolutional Neural Network for Natural Image Classification , 2020 .

[12]  Nan Jiang,et al.  Layer-wise learning based stochastic gradient descent method for the optimization of deep convolutional neural network , 2019, J. Intell. Fuzzy Syst..

[13]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[14]  Hui Wei,et al.  Visual Navigation Using Projection of Spatial Right-Angle In Indoor Environment , 2018, IEEE Transactions on Image Processing.

[15]  Qinghe Zheng,et al.  Improvement of Generalization Ability of Deep CNN via Implicit Regularization in Two-Stage Training Process , 2018, IEEE Access.

[16]  D. Macii,et al.  A RANSAC-based fast road line detection algorithm for high-speed wheeled vehicles , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[17]  Qinghe Zheng,et al.  Fine-grained image classification based on the combination of artificial features and deep convolutional activation features , 2017, 2017 IEEE/CIC International Conference on Communications in China (ICCC).

[18]  Daeho Lee,et al.  Discrete Hough transform using line segment representation for line detection , 2011 .

[19]  Kun Huang,et al.  Learning to Parse Wireframes in Images of Man-Made Environments , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[20]  Changick Kim,et al.  Diversify and Match: A Domain Adaptive Representation Learning Paradigm for Object Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).