Learning to Count Leaves in Rosette Plants

Counting the number of leaves in plants is important for plant phenotyping, since it can be used to assess plant growth stages. We propose a learning-based approach for counting leaves in rosette (model) plants. We relate image-based descriptors learned in an unsupervised fashion to leaf counts using a supervised regression model. To take advantage of the circular and coplanar arrangement of leaves and also to introduce scale and rotation invariance, we learn features in a log-polar representation. Image patches extracted in this log-polar domain are provided to K-means, which builds a codebook in a unsupervised manner. Feature codes are obtained by projecting patches on the codebook using the triangle encoding, introducing both sparsity and specifically designed representation. A global, per-plant image descriptor is obtained by pooling local features in specific regions of the image. Finally, we provide the global descriptors to a support vector regression framework to estimate the number of leaves in a plant. We evaluate our method on datasets of the \textit{Leaf Counting Challenge} (LCC), containing images of Arabidopsis and tobacco plants. Experimental results show that on average we reduce absolute counting error by 40% w.r.t. the winner of the 2014 edition of the challenge -a counting via segmentation method. When compared to state-of-the-art density-based approaches to counting, on Arabidopsis image data ~75% less counting errors are observed. Our findings suggest that it is possible to treat leaf counting as a regression problem, requiring as input only the total leaf count per training image.

[1]  Maarten Koornneef,et al.  The effect of daylength on the transition to flowering in phytochrome‐deficient, late‐flowering and double mutants of Arabidopsis thaliana , 1995 .

[2]  R. Poethig,et al.  Phase change and the regulation of trichome distribution in Arabidopsis thaliana. , 1997, Development.

[3]  E. Coen,et al.  Inflorescence Commitment and Architecture in Arabidopsis , 1997, Science.

[4]  J. Dias,et al.  An Introduction to the Log-Polar Mapping , 1997 .

[5]  U. Schurr,et al.  The modular character of growth in Nicotiana tabacum plants under steady-state nutrition , 1999 .

[6]  Charles Elkan,et al.  Using the Triangle Inequality to Accelerate k-Means , 2003, ICML.

[7]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[8]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Nello Cristianini,et al.  Kernel Methods for Pattern Analysis , 2004 .

[11]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[12]  R. Ostrovsky,et al.  The Effectiveness of Lloyd-Type Methods for the k-Means Problem , 2006, 2006 47th Annual IEEE Symposium on Foundations of Computer Science (FOCS'06).

[13]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[14]  Falk Schreiber,et al.  HTPheno: An image analysis pipeline for high-throughput plant phenotyping , 2011, BMC Bioinformatics.

[15]  S. Omholt,et al.  Phenomics: the next challenge , 2010, Nature Reviews Genetics.

[16]  R. O’Malley,et al.  ARABIDOPSIS : A RICH HARVEST 10 YEARS AFTER COMPLETION OF THE GENOME SEQUENCE Linking genotype to phenotype using the Arabidopsis unimutant collection , 2011 .

[17]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[18]  Andrew Zisserman,et al.  Learning To Count Objects in Images , 2010, NIPS.

[19]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[20]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[21]  Luc Van Gool,et al.  Interactive object detection , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[22]  Ullrich Köthe,et al.  Learning to count with regression forest and structured labels , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[23]  Michael P. Pound,et al.  What lies beneath: underlying assumptions in bioimage analysis. , 2012, Trends in plant science.

[24]  Chulhee Lee,et al.  Fast object detection based on color histograms and local binary patterns , 2012, TENCON 2012 IEEE Region 10 Conference.

[25]  Trevor Darrell,et al.  Beyond spatial pyramids: Receptive field learning for pooled image features , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Steven Verstockt,et al.  Leaf segmentation and parallel phenotyping for the analysis of gene networks in plants , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[27]  D. Inzé,et al.  Cell to whole-plant phenotyping: the best is yet to come. , 2013, Trends in plant science.

[28]  Soo-Young Lee,et al.  Description of shape patterns using circular arcs for object detection , 2013, IET Comput. Vis..

[29]  Andrew Zisserman,et al.  Learning to Detect Partially Overlapping Instances , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Nathan D. Miller,et al.  Image analysis is driving a renaissance in growth measurement. , 2013, Current opinion in plant biology.

[31]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[32]  Hanno Scharr,et al.  Annotated Image Datasets of Rosette Plants , 2014 .

[33]  Jin Chen,et al.  Multi-leaf tracking from fluorescence plant videos , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[34]  Christian Klukas,et al.  3-D Histogram-Based Segmentation and Leaf Detection for Rosette Plants , 2014, ECCV Workshops.

[35]  Andrew Zisserman,et al.  Interactive Object Counting , 2014, ECCV.

[36]  Sotirios A. Tsaftaris,et al.  Image-based plant phenotyping with incremental learning and active contours , 2014, Ecol. Informatics.

[37]  Ouahiba Azouaoui,et al.  HOG based multi-object detection for urban navigation , 2014, 17th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[38]  Pei Chen,et al.  Counting people with support vector regression , 2014, 2014 10th International Conference on Natural Computation (ICNC).

[39]  Hanno Scharr,et al.  Image Analysis: The New Bottleneck in Plant Phenotyping [Applications Corner] , 2015, IEEE Signal Processing Magazine.

[40]  Sotirios A. Tsaftaris,et al.  Computationally Efficient Data and Application Driven Color Transforms for the Compression and Enhancement of Images and Video , 2015 .

[41]  Hanno Scharr,et al.  Modeling leaf growth of rosette plants using infrared stereo image sequences , 2015, Comput. Electron. Agric..

[42]  A. Walter,et al.  Plant phenotyping: from bean weighing to image analysis , 2015, Plant Methods.