A Pyramid CNN for Dense-Leaves Segmentation

Automatic detection and segmentation of overlapping leaves in dense foliage can be a difficult task, particularly for leaves with strong textures and high occlusions. We present Dense-Leaves, an image dataset with ground truth segmentation labels that can be used to train and quantify algorithms for leaf segmentation in the wild. We also propose a pyramid convolutional neural network with multi-scale predictions that detects and discriminates leaf boundaries from interior textures. Using these detected boundaries, closed-contour boundaries around individual leaves are estimated with a watershed-based algorithm. The result is an instance segmenter for dense leaves. Promising segmentation results for leaves in dense foliage are obtained.

[1]  Shubhra Aich,et al.  Leaf Counting with Deep Convolutional and Deconvolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[2]  Tony P. Pridmore,et al.  Deep Learning for Multi-task Plant Phenotyping , 2017, bioRxiv.

[3]  Yan Wang,et al.  DeepContour: A deep convolutional feature learned by positive-sharing loss for contour detection , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  W. John Kress,et al.  Leafsnap: A Computer Vision System for Automatic Plant Species Identification , 2012, ECCV.

[7]  Laure Tougne,et al.  A Parametric Active Polygon for Leaf Segmentation and Shape Estimation , 2011, ISVC.

[8]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[9]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yufei Chen,et al.  Contour-Based Plant Leaf Image Segmentation Using Visual Saliency , 2015, ICIG.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Laure Tougne,et al.  Understanding leaves in natural images - A model-based approach for tree species identification , 2013, Comput. Vis. Image Underst..

[13]  David A. Clausi,et al.  Decoupled Active Contour (DAC) for Boundary Detection , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Laure Tougne,et al.  Tree Leaves Extraction in Natural Images: Comparative Study of Preprocessing Tools and Segmentation Methods , 2015, IEEE Transactions on Image Processing.

[16]  Derek Hoiem,et al.  Indoor Segmentation and Support Inference from RGBD Images , 2012, ECCV.

[17]  Christian Klukas,et al.  3-D Histogram-Based Segmentation and Leaf Detection for Rosette Plants , 2014, ECCV Workshops.

[18]  C. Lawrence Zitnick,et al.  Fast Edge Detection Using Structured Forests , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Tao Yang,et al.  Crop Disease Leaf Image Segmentation Method Based on Color Features , 2007, CCTA.

[20]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[21]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[22]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[23]  Edward J. Delp,et al.  Locating Crop Plant Centers from UAV-Based RGB Imagery , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[24]  Marie-José Aldon,et al.  Skeleton-Based Shape Models with Pressure Forces: Application to Segmentation of Overlapping Leaves , 2001, IWVF.

[25]  Alan L. Yuille,et al.  Statistical Edge Detection: Learning and Evaluating Edge Cues , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Hong-e Ren,et al.  Research on Algorithm of Image Segmentation Based on Color Features , 2011, CSIE 2011.

[27]  Xiao-Feng Wang,et al.  An Efficient Two-Stage Level Set Segmentation Framework for Overlapping Plant Leaf Image , 2012, ICIC.

[28]  Hanno Scharr,et al.  Finely-grained annotated datasets for image-based plant phenotyping , 2016, Pattern Recognit. Lett..

[29]  Sotirios A. Tsaftaris,et al.  Leveraging multiple datasets for deep leaf counting , 2017, bioRxiv.

[30]  David W. Jacobs,et al.  Efficient segmentation of leaves in semi-controlled conditions , 2013, Machine Vision and Applications.

[31]  Stefano Soatto,et al.  Quick Shift and Kernel Methods for Mode Seeking , 2008, ECCV.