Locating Crop Plant Centers from UAV-Based RGB Imagery

In this paper we propose a method to find the location of crop plants in Unmanned Aerial Vehicle (UAV) imagery. Finding the location of plants is a crucial step to derive and track phenotypic traits for each plant. We describe some initial work in estimating field crop plant locations. We approach the problem by classifying pixels as a plant center or a non plant center. We use Multiple Instance Learning (MIL) to handle the ambiguity of plant center labeling in training data. The classification results are then post-processed to estimate the exact location of the crop plant. Experimental evaluation is conducted to evaluate the method and the result achieved an overall precision and recall of 66% and 64%, respectively.

[1]  Edward J. Delp,et al.  Estimating Phenotypic Traits From UAV Based RGB Imagery , 2018, ArXiv.

[2]  D. Powers.  Evaluation: From Precision, Recall and F-Factor to ROC, Informedness, Markedness & Correlation , 2008 .

[3]  S. Sankaran,et al.  Low-altitude, high-resolution aerial imaging systems for row and field crop phenotyping: A review , 2015 .

[4]  E. R. Davies.  Binary Shape Analysis , 1990 .

[5]  Chengjun Liu,et al.  Gabor feature based classification using the enhanced fisher linear discriminant model for face recognition , 2002, IEEE Trans. Image Process..

[6]  Malia A. Gehan,et al.  A Versatile Phenotyping System and Analytics Platform Reveals Diverse Temporal Responses to Water Availability in Setaria. , 2015, Molecular plant.

[7]  M. Tester,et al.  Phenomics--technologies to relieve the phenotyping bottleneck. , 2011, Trends in plant science.

[8]  F. A. Vega,et al.  Multi-temporal imaging using an unmanned aerial vehicle for monitoring a sunflower crop , 2015 .

[9]  Yuhua Jiao,et al.  Functional approach to high-throughput plant growth analysis , 2013, BMC Systems Biology.

[10]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Kazunobu Ishii,et al.  Remote-sensing Technology for Vegetation Monitoring using an Unmanned Helicopter , 2005 .

[12]  Christoph H. Lampert,et al.  Seed, Expand and Constrain: Three Principles for Weakly-Supervised Image Segmentation , 2016, ECCV.

[13]  Ryan F. McCormick,et al.  3D Sorghum Reconstructions from Depth Images Identify QTL Regulating Shoot Architecture1[OPEN] , 2016, Plant Physiology.

[14]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[15]  LinLin Shen,et al.  A review on Gabor wavelets for face recognition , 2006, Pattern Analysis and Applications.

[16]  Zhuowen Tu,et al.  Multiple clustered instance learning for histopathology cancer image classification, segmentation and clustering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  J. Daugman.  Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[18]  S. Tsaftaris,et al.  Learning to Count Leaves in Rosette Plants , 2015 .

[19]  Ulrich Schurr,et al.  Future scenarios for plant phenotyping. , 2013, Annual review of plant biology.

[20]  Abhiram Das,et al.  Image-Based High-Throughput Field Phenotyping of Crop Roots1[W][OPEN] , 2014, Plant Physiology.

[21]  Andrew M Mutka,et al.  Image-based phenotyping of plant disease symptoms , 2015, Front. Plant Sci..

[22]  K. Chenu,et al.  PHENOPSIS, an automated platform for reproducible phenotyping of plant responses to soil water deficit in Arabidopsis thaliana permitted the identification of an accession with low sensitivity to soil water deficit. , 2006, The New phytologist.

[23]  G. Allan Johnson,et al.  An engineering approach to image-based phenotyping , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[24]  Paul A. Viola,et al.  Multiple Instance Boosting for Object Detection , 2005, NIPS.

[25]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[26]  Jeffrey W. White,et al.  Field-based phenomics for plant genetics research , 2012 .

[27]  Pietro Perona,et al.  Multiple Component Learning for Object Detection , 2008, ECCV.

[28]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Wen Gao,et al.  AdaBoost Gabor Fisher Classifier for Face Recognition , 2005, AMFG.

[30]  Horst Bischof,et al.  On-line semi-supervised multiple-instance boosting , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[31]  Jose A. Jiménez-Berni,et al.  Pheno-Copter: A Low-Altitude, Autonomous Remote-Sensing Robotic Helicopter for High-Throughput Field-Based Phenotyping , 2014 .

[32]  W. Philips,et al.  Rosette Tracker: An Open Source Image Analysis Tool for Automatic Quantification of Genotype Effects1[C][W] , 2012, Plant Physiology.

[33]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..