A Rapidly Deployable Classification System using Visual Data for the Application of Precision Weed Management

In this work we demonstrate a rapidly deployable weed classification system that uses visual data to enable autonomous precision weeding without making prior assumptions about which weed species are present in a given field. Previous work in this area relies on having prior knowledge of the weed species present in the field. This assumption cannot always hold true for every field, and thus limits the use of weed classification systems based on this assumption. In this work, we obviate this assumption and introduce a rapidly deployable approach able to operate on any field without any weed species assumptions prior to deployment. We present a three stage pipeline for the implementation of our weed classification system consisting of initial field surveillance, offline processing and selective labelling, and automated precision weeding. The key characteristic of our approach is the combination of plant clustering and selective labelling which is what enables our system to operate without prior weed species knowledge. Testing using field data we are able to label 12.3 times fewer images than traditional full labelling whilst reducing classification accuracy by only 14%.

[1]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[2]  Cyrill Stachniss,et al.  Effective Vision‐based Classification for Separating Sugar Beets and Weeds for Precision Farming , 2017, J. Field Robotics.

[3]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[4]  Joachim Hertzberg,et al.  Plant classification with In-Field-Labeling for crop/weed discrimination using spectral features and 3D surface features from a multi-wavelength laser line profile system , 2017, Comput. Electron. Agric..

[5]  R. Gerhards,et al.  Practical experiences with a system for site‐specific weed control in arable crops using real‐time image analysis and GPS‐controlled patch spraying , 2006 .

[6]  Ying Zhu,et al.  Review of Plant Identification Based on Image Processing , 2016, Archives of Computational Methods in Engineering.

[7]  Paolo Remagnino,et al.  How deep learning extracts and learns leaf features for plant classification , 2017, Pattern Recognit..

[8]  Yuxuan Wang,et al.  A Leaf Recognition Algorithm for Plant Classification Using Probabilistic Neural Network , 2007, 2007 IEEE International Symposium on Signal Processing and Information Technology.

[9]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[10]  Tristan Perez,et al.  A transplantable system for weed classification by agricultural robotics , 2017, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Sergei Vassilvitskii,et al.  k-means++: the advantages of careful seeding , 2007, SODA '07.

[12]  Brendan J. Frey,et al.  Mixture Modeling by Affinity Propagation , 2005, NIPS.

[13]  Jörn Ostermann,et al.  Plant classification system for crop /weed discrimination without segmentation , 2014, IEEE Winter Conference on Applications of Computer Vision.

[14]  David C. Slaughter,et al.  Autonomous robotic weed control systems: A review , 2008 .

[15]  M. A. Siegler,et al.  Automatic Segmentation, Classification and Clustering of Broadcast News Audio , 1997 .

[16]  N. Gilbert Case studies: A hard look at GM crops , 2013, Nature.

[17]  Pierre Bonnet,et al.  Plant Identification in an Open-world (LifeCLEF 2016) , 2016, CLEF.

[18]  Alexander Wendel,et al.  Self-supervised weed detection in vegetable crops using ground based hyperspectral imaging , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[19]  Xavier Maldague,et al.  Bayesian classification and unsupervised learning for isolating weeds in row crops , 2014, Pattern Analysis and Applications.

[20]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Niko Sünderhauf,et al.  Evaluation of Features for Leaf Classification in Challenging Conditions , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[22]  Chufan Lin,et al.  A support vector machine embedded weed identification system , 2010 .

[23]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[24]  Feras Dayoub,et al.  Towards unsupervised weed scouting for agricultural robotics , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Gonzalo Pajares,et al.  Integrating Sensory/Actuation Systems in Agricultural Vehicles , 2014, Sensors.

[26]  Tristan Perez,et al.  Robot for weed species plant‐specific management , 2017, J. Field Robotics.

[27]  José Blasco,et al.  AE—Automation and Emerging Technologies: Robotic Weed Control using Machine Vision , 2002 .

[28]  Albert-Jan Baerveldt,et al.  An Agricultural Mobile Robot with Vision-Based Perception for Mechanical Weed Control , 2002, Auton. Robots.