Harmonious Semantic Line Detection via Maximal Weight Clique Selection

A novel algorithm to detect an optimal set of semantic lines is proposed in this work. We develop two networks: selection network (S-Net) and harmonization network (H-Net). First, S-Net computes the probabilities and offsets of line candidates. Second, we filter out irrelevant lines through a selection-and-removal process. Third, we construct a complete graph, whose edge weights are computed by H-Net. Finally, we determine a maximal weight clique representing an optimal set of semantic lines. Moreover, to assess the overall harmony of detected lines, we propose a novel metric, called HIoU. Experimental results demonstrate that the proposed algorithm can detect harmonious semantic lines effectively and efficiently. Our codes are available at https://github.com/dongkwonjin/Semantic-Line-MWCS.

[1]  Mingyang Li,et al.  Sem-LSD: A Learning-based Semantic Line Segment Detector. , 2019 .

[2]  Silvia L. Pintea,et al.  Deep Hough-Transform Line Priors , 2020, ECCV.

[3]  Chunxiao Liu,et al.  Inter-Region Affinity Distillation for Road Marking Segmentation , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Michael Freeman,et al.  The Photographer's Eye: Composition and Design for Better Digital Photos , 2007 .

[5]  Bo Zhang,et al.  Color-based road detection in urban traffic scenes , 2004, IEEE Transactions on Intelligent Transportation Systems.

[6]  Chang-Su Kim,et al.  Semantic Line Detection Using Mirror Attention and Comparative Ranking and Matching , 2022, ECCV.

[7]  Gary Chartrand,et al.  Chromatic Graph Theory , 2008 .

[8]  Xiaogang Wang,et al.  Spatial As Deep: Spatial CNN for Traffic Scene Understanding , 2017, AAAI.

[9]  Gilbert Laporte,et al.  Generalized network design problems , 2003, Eur. J. Oper. Res..

[10]  Lionel Moisan,et al.  Meaningful Alignments , 2000, International Journal of Computer Vision.

[11]  Han-Ul Kim,et al.  Photographic composition classification and dominant geometric element detection for outdoor scenes , 2018, J. Vis. Commun. Image Represent..

[12]  Kun Huang,et al.  Learning to Parse Wireframes in Images of Man-Made Environments , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[13]  Yi Ma,et al.  End-to-End Wireframe Parsing , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[14]  Gui-Song Xia,et al.  Learning Attraction Field Representation for Robust Line Segment Detection , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Seiichi Mita,et al.  Robust road boundary estimation for intelligent vehicles in challenging scenarios based on a semantic graph , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[16]  Ronen Lerner,et al.  Recent progress in road and lane detection: a survey , 2012, Machine Vision and Applications.

[17]  Mohamed Aly,et al.  Real time detection of lane markers in urban streets , 2008, 2008 IEEE Intelligent Vehicles Symposium.

[18]  Cuneyt Akinlar,et al.  EDLines: A real-time line segment detector with a false detection control , 2011, Pattern Recognit. Lett..

[19]  Scott Workman,et al.  Horizon Lines in the Wild , 2016, BMVC.

[20]  Kai Zhao,et al.  Deep Hough Transform for Semantic Line Detection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Scott Workman,et al.  Detecting Vanishing Points Using Global Image Context in a Non-ManhattanWorld , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Han-Ul Kim,et al.  Semantic Line Detection and Its Applications , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[23]  Huanyu Wang,et al.  Ultra Fast Structure-aware Deep Lane Detection , 2020, ECCV.

[24]  Bolei Zhou,et al.  Scene Parsing through ADE20K Dataset , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  In So Kweon,et al.  VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[26]  Yichao Zhou,et al.  NeurVPS: Neural Vanishing Point Scanning via Conic Convolution , 2019, NeurIPS.

[27]  Jiri Matas,et al.  Robust Detection of Lines Using the Progressive Probabilistic Hough Transform , 2000, Comput. Vis. Image Underst..

[28]  Junqiang Xi,et al.  A novel lane detection based on geometrical model and Gabor filter , 2010, 2010 IEEE Intelligent Vehicles Symposium.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Guannan Gao,et al.  Probabilistic Hough Transform , 2011 .

[31]  Rafael Grompone von Gioi,et al.  LSD: A Fast Line Segment Detector with a False Detection Control , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Bernard Harris,et al.  Graph theory and its applications , 1970 .

[33]  Amit Marathe,et al.  Soft Labels for Ordinal Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Chen Change Loy,et al.  Learning Lightweight Lane Detection CNNs by Self Attention Distillation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).