Semi-supervised online visual crop and weed classification in precision farming exploiting plant arrangement

Precision farming robots offer a great potential for reducing the amount of agro-chemicals that is required in the fields through a targeted, per-plant intervention. To achieve this, robots must be able to reliably distinguish crops from weeds on different fields and across growth stages. In this paper, we tackle the problem of separating crops from weeds reliably while requiring only a minimal amount of training data through a semi-supervised approach. We exploit the fact that most crops are planted in rows with a similar spacing along the row, which in turn can be used to initialize a vision-based classifier requiring only minimal user efforts to adapt it to a new field. We implemented our approach using C++ and ROS and thoroughly tested it on real farm robots operating in different countries. The experiments presented in this paper show that with around 1 min of labeling time, we can achieve classification results with an accuracy of more than 95% in real sugar beet fields in Germany and Switzerland.

[1]  Jörn Ostermann,et al.  Plant classification system for crop /weed discrimination without segmentation , 2014, IEEE Winter Conference on Applications of Computer Vision.

[2]  Anders Krogh Mortensen,et al.  Semantic Segmentation of Mixed Crops using Deep Convolutional Neural Network , 2016 .

[3]  J. Hemming,et al.  PA—Precision Agriculture: Computer-Vision-based Weed Identification under Field Conditions using Controlled Lighting , 2001 .

[4]  Ciro Potena,et al.  Automatic model based dataset generation for fast and accurate crop and weeds detection , 2016, 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[5]  Alexander Wendel,et al.  Self-supervised weed detection in vegetable crops using ground based hyperspectral imaging , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Cyrill Stachniss,et al.  An effective classification system for separating sugar beets and weeds for precision farming applications , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[7]  Cyrill Stachniss,et al.  UAV-based crop and weed classification for smart farming , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Cyrill Stachniss,et al.  Effective Vision‐based Classification for Separating Sugar Beets and Weeds for Precision Farming , 2017, J. Field Robotics.

[9]  Niko Sünderhauf,et al.  Evaluation of Features for Leaf Classification in Challenging Conditions , 2015, 2015 IEEE Winter Conference on Applications of Computer Vision.

[10]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[11]  A. T. Nieuwenhuizen,et al.  Automated detection and control of volunteer potato plants , 2009 .

[12]  Daniele Nardi,et al.  Fast and Accurate Crop and Weed Identification with Summarized Train Sets for Precision Agriculture , 2016, IAS.

[13]  Alberto Tellaeche,et al.  A vision-based method for weeds identification through the Bayesian decision theory , 2008, Pattern Recognit..

[14]  Joachim Hertzberg,et al.  Plant classification with In-Field-Labeling for crop/weed discrimination using spectral features and 3D surface features from a multi-wavelength laser line profile system , 2017, Comput. Electron. Agric..

[15]  David C. Slaughter,et al.  Autonomous robotic weed control systems: A review , 2008 .

[16]  Xavier Maldague,et al.  Bayesian classification and unsupervised learning for isolating weeds in row crops , 2014, Pattern Analysis and Applications.