Automatic Detection of Plant Rows for a Transplanter in Paddy Field Using Faster R-CNN

Uniform plant row spacing in a paddy field is a critical requirement for rice seedling transplanting, as it affects subsequent field management and the crop yield. However, current transplanters are not able to meet this requirement due to the lack of accurate navigation systems. In this study, a plant row detection algorithm was developed to serve as a navigation system of a rice transplanter. The algorithm was based on the convolutional neural network (CNN) to identify and locate rice seedlings from field images. The agglomerative hierarchical clustering (AHC) was used to group rice seedlings into seedling rows which were then used to determine the navigation parameters. The accuracies of the navigation parameters were evaluated using test images. Results showed that the CNN-based algorithm successfully detected rice seedlings from field images and generated a reference line which was used to determine navigation parameters (lateral distance and travel angle). Compared with mean absolute errors (MAE) test results, the CNN-based algorithm resulted in a deviation of 8.5 mm for the lateral distance and 0.50° for the travel angle, over the six intra-row seedling spacings tested. Relative to the test results, the CNN-based algorithm had 62% lower error for the lateral distance and 57% lower error for the travel angle when compared to a classical algorithm. These results demonstrated that the proposed algorithm had reasonably good accuracy and can be used for the rice transplanter navigation in real-time.

[1]  Roland Gerhards,et al.  Camera steered mechanical weed control in sugar beet, maize and soybean , 2017, Precision Agriculture.

[2]  Cyrill Stachniss,et al.  Real-Time Semantic Segmentation of Crop and Weed for Precision Agriculture Robots Leveraging Background Knowledge in CNNs , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[3]  James Patrick Underwood,et al.  Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry , 2016, Sensors.

[4]  David C. Slaughter,et al.  Review: Automatic GPS-based intra-row weed knife control system for transplanted row crops , 2012 .

[5]  Aibin Chen,et al.  Rapid Detection of Rice Disease Based on FCM-KM and Faster R-CNN Fusion , 2019, IEEE Access.

[6]  David Reiser,et al.  Iterative individual plant clustering in maize with assembled 2D LiDAR data , 2018, Comput. Ind..

[7]  罗锡文,et al.  Matching method of green crops based on SURF feature extraction , 2015 .

[8]  S. C. Johnson Hierarchical clustering schemes , 1967, Psychometrika.

[9]  WeissUlrich,et al.  Plant detection and mapping for agricultural robots using a 3D LIDAR sensor , 2011 .

[10]  Adel Hafiane,et al.  Deep Learning with Unsupervised Data Labeling for Weed Detection in Line Crops in UAV Images , 2018, Remote. Sens..

[11]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[12]  Gonzalo Pajares,et al.  Automatic detection of crop rows in maize fields with high weeds pressure , 2012, Expert Syst. Appl..

[13]  M. Nørremark,et al.  Seed Mapping of Sugar Beet , 2005, Precision Agriculture.

[14]  G. van Straten,et al.  A vision based row detection system for sugar beet , 2005 .

[15]  Gonzalo Pajares,et al.  A new Expert System for greenness identification in agricultural images , 2013, Expert Syst. Appl..

[16]  Ivan Vidovic,et al.  Crop row detection by global energy minimization , 2016, Pattern Recognit..

[17]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Hossein Mousazadeh,et al.  A technical review on navigation systems of agricultural autonomous off-road vehicles , 2013 .

[19]  Kyung-Soo Kim,et al.  Morphology-based guidance line extraction for an autonomous weeding robot in paddy fields , 2015, Comput. Electron. Agric..

[20]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[21]  Guoquan Jiang,et al.  Wheat rows detection at the early growth stage based on Hough transform and vanishing point , 2016, Comput. Electron. Agric..

[22]  Gonzalo Pajares,et al.  Support Vector Machines for crop/weeds identification in maize fields , 2012, Expert Syst. Appl..

[23]  Du Yuefeng,et al.  Method for detecting crop rows based on binocular vision with Census transformation , 2016 .

[24]  James Patrick Underwood,et al.  Deep fruit detection in orchards , 2016, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[25]  An Qiu Image Segmentation of Green Plants in Corn Field Based on Neighborhood Histogram , 2011 .