FCL-Net: Towards accurate edge detection via Fine-scale Corrective Learning

Integrating multi-scale predictions has become a mainstream paradigm in edge detection. However, most existing methods mainly focus on effective feature extraction and multi-scale feature fusion while ignoring the low learning capacity in fine-level branches, limiting the overall fusion performance. In light of this, we propose a novel Fine-scale Corrective Learning Net (FCL-Net) that exploits semantic information from deep layers to facilitate fine-scale feature learning. FCL-Net mainly consists of a Top-down Attentional Guiding (TAG) and a Pixel-level Weighting (PW) module. TAG module adopts semantic attentional cues from coarse-scale prediction into guiding the fine-scale branches by learning a top-down LSTM. PW module treats the contribution of each spatial location independently and promote fine-level branches to detect detailed edges with high confidence. Experiments on three benchmark datasets, i.e., BSDS500, Multicue, and BIPED, show that our approach significantly outperforms the baseline and achieves a competitive ODS F-measure of 0.826 on the BSDS500 benchmark. The source code and models are publicly available at https://github.com/DREAMXFAR/FCL-Net.

[1]  Qing Zhang,et al.  Edge-aware salient object detection network via context guidance , 2021, Image Vis. Comput..

[2]  Heng Tao Shen,et al.  Cumulative Nets for Edge Detection , 2018, ACM Multimedia.

[3]  Udo Zölzer,et al.  Object Contour and Edge Detection with RefineContourNet , 2019, CAIP.

[4]  Rufeng Zhang,et al.  Fast contour detection with supervised attention learning , 2020, Journal of Real-Time Image Processing.

[5]  Yuting Zhang,et al.  Sketch-Based Image Retrieval by Salient Contour Reinforcement , 2016, IEEE Transactions on Multimedia.

[6]  Wenyu Liu,et al.  Boundary-preserving Mask R-CNN , 2020, ECCV.

[7]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Heng Tao Shen,et al.  Bottom-up and Top-down: Bidirectional Additive Net for Edge Detection , 2020, IJCAI.

[9]  Thomas Serre,et al.  A systematic comparison between visual cues for boundary detection , 2016, Vision Research.

[10]  Ming Yang,et al.  BDCN: Bi-Directional Cascade Network for Perceptual Edge Detection , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Shengjun Liu,et al.  Learning to predict crisp boundaries , 2018, ECCV.

[12]  Edward H. Adelson,et al.  Crisp Boundary Detection Using Pointwise Mutual Information , 2014, ECCV.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Victor S. Lempitsky,et al.  N4-Fields: Neural Network Nearest Neighbor Fields for Image Transforms , 2014, ArXiv.

[15]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Wei He,et al.  Unmixing Convolutional Features for Crisp Edge Detection , 2021, IEEE transactions on pattern analysis and machine intelligence.

[17]  Luc Van Gool,et al.  Convolutional Oriented Boundaries , 2016, ECCV.

[18]  Xiaofeng Ren,et al.  Discriminatively Trained Sparse Code Gradients for Contour Detection , 2012, NIPS.

[19]  Shengjun Liu,et al.  Deep Structural Contour Detection , 2020, ACM Multimedia.