Improved crop row detection with deep neural network for early-season maize stand count in UAV imagery

Abstract Stand counts is one of the most common ways farmers assess plant growth conditions and management practices throughout the season. The conventional method for early-season stand count is through manual inspection, which is time-consuming, laborious, and spatially limited in scope. In recent years, Unmanned Aerial Vehicles (UAV) based remote sensing has been widely used in agriculture to provide low-altitude, high spatial resolution imagery to assist decision making. In this project, we designed a system that uses geometric descriptor information with deep neural networks to determine early-season maize stands from relatively low spatial resolution (10 to 25 mm) aerial data, which covers a relatively large area (10 to 25 hectares). Instead of detecting individual crops in a row, we process the entire row at one time, which significantly reduces the requirements for the clarity of the crops. Besides, our new MaxArea Mask Scoring RCNN algorithm could segment crop-rows out in each patch image, regardless of the terrain conditions. The robustness of our scheme was tested on data collected at two different fields in different years. The accuracy of the estimated emergence rate reached up to 95.8%. Due to the high processing speed of the system, it has the potential for real-time applications in the future.

[1]  Kaiming He,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  John F. Reid,et al.  Hough-transform-based vision algorithm for crop row detection of an automated agricultural vehicle , 2005 .

[3]  Lie Tang,et al.  Automatic inter-plant spacing sensing at early growth stages using a 3D vision sensor , 2012 .

[4]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[5]  Brian L. Steward,et al.  Using Aerial Hyperspectral Remote Sensing Imagery to Estimate Corn Plant Stand Density , 2006 .

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Xavier P. Burgos-Artizzu,et al.  utomatic segmentation of relevant textures in agricultural images , 2010 .

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Jing He,et al.  Research of UAV Flight Planning Parameters , 2012 .

[11]  F. Truchetet,et al.  Crop/weed discrimination in perspective agronomic images , 2008 .

[12]  Randal K. Taylor,et al.  Automatic corn plant location and spacing measurement using laser line-scan technique , 2013, Precision Agriculture.

[13]  Amar Raheja,et al.  Machine learning techniques for the assessment of citrus plant health using UAV-based digital images , 2018, Commercial + Scientific Sensing and Imaging.

[14]  Terry Griffin,et al.  Early-Season Stand Count Determination in Corn via Integration of Imagery from Unmanned Aerial Systems (UAS) and Supervised Learning Techniques , 2018, Remote. Sens..

[15]  Jin Soo Noh,et al.  Palmprint identification algorithm using Hu invariant moments and Otsu binarization , 2005, Fourth Annual ACIS International Conference on Computer and Information Science (ICIS'05).

[16]  Nithya Rajan,et al.  Unmanned Aerial Vehicles for High-Throughput Phenotyping and Agronomic Research , 2016, PloS one.

[17]  Pedro Antonio Gutiérrez,et al.  A semi-supervised system for weed mapping in sunflower crops using unmanned aerial vehicles and a crop row detection method , 2015, Appl. Soft Comput..

[18]  Seda Yilmaz,et al.  Evidence-based design heuristics for idea generation , 2016 .

[19]  Yongchao Gong,et al.  Mask Scoring R-CNN , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  G. Meyer,et al.  Color indices for weed identification under various soil, residue, and lighting conditions , 1994 .

[21]  B. Bhanu,et al.  Image understanding research for automatic target recognition , 1993, IEEE Aerospace and Electronic Systems Magazine.

[22]  Azriel Rosenfeld,et al.  Blob Detection by Relaxation , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  L. Biehl,et al.  Using Remote Sensing to Assess Stand Loss and Defoliation in Maize , 2004 .

[24]  Jefferson R. Souza,et al.  Corn Plant Counting Using Deep Learning and UAV Images , 2019, IEEE Geoscience and Remote Sensing Letters.

[25]  Lei Guo,et al.  Wheat yellow rust monitoring by learning from multispectral UAV aerial imagery , 2018, Comput. Electron. Agric..

[26]  Bizhi Wu,et al.  UAV-Based High-Throughput Approach for Fast Growing Cunninghamia lanceolata (Lamb.) Cultivar Screening by Machine Learning , 2019, Forests.