Improved U-Net for Growth Stage Recognition of In-Field Maize

Precise recognition of maize growth stages in the field is one of the critical steps in conducting precision irrigation and crop growth evaluation. However, due to the ever-changing environmental factors and maize growth characteristics, traditional recognition methods usually suffer from limitations in recognizing different growth stages. For the purpose of tackling these issues, this study proposed an improved U-net by first using a cascade convolution-based network as the encoder with a strategy for backbone network replacement to optimize feature extraction and reuse. Secondly, three attention mechanism modules have been introduced to upgrade the decoder part of the original U-net, which highlighted critical regions and extracted more discriminative features of maize. Subsequently, a dilation path of the improved U-net was constructed by integrating dilated convolution layers using a multi-scale feature fusion approach to preserve the detailed spatial information of in-field maize. Finally, the improved U-net has been applied to recognize different growth stages of maize in the field. The results clearly demonstrated the superior ability of the improved U-net to precisely segment and recognize maize growth stage from in-field images. Specifically, the semantic segmentation network achieved a mean intersection over union (mIoU) of 94.51% and a mean pixel accuracy (mPA) of 96.93% in recognizing the maize growth stage with only 39.08 MB of parameters. In conclusion, the good trade-offs made in terms of accuracy and parameter number demonstrated that this study could lay a good foundation for implementing accurate maize growth stage recognition and long-term automatic growth monitoring.

[1]  Jingwei Sun,et al.  RL-DeepLabv3+: A lightweight rice lodging semantic segmentation model for unmanned rice harvester , 2023, Comput. Electron. Agric..

[2]  Honglie Guo,et al.  An Information Entropy Masked Vision Transformer (IEM-ViT) Model for Recognition of Tea Diseases , 2023, Agronomy.

[3]  Wenjiang Huang,et al.  Identification of Soybean Planting Areas Combining Fused Gaofen-1 Image Data and U-Net Model , 2023, Agronomy.

[4]  Yaohua Hu,et al.  Research on Winter Jujube Object Detection Based on Optimized Yolov5s , 2023, Agronomy.

[5]  Jing Li,et al.  ResDense-focal-DeepLabV3+ enabled litchi branch semantic segmentation for robotic harvesting , 2023, Comput. Electron. Agric..

[6]  Yanbin Li,et al.  Converge of coordinate attention boosted YOLOv5 model and quantum dot labeled fluorescent biosensing for rapid detection of the poultry disease , 2023, Comput. Electron. Agric..

[7]  Zeming Fan,et al.  U2ESPNet - A lightweight and high-accuracy convolutional neural network for real-time semantic segmentation of visible branches , 2023, Comput. Electron. Agric..

[8]  Chuanlei Zhang,et al.  Modified U-Net for plant diseased leaf image segmentation , 2023, Comput. Electron. Agric..

[9]  Yuwei Wang,et al.  YOLOv5s-FP: A Novel Method for In-Field Pear Detection Using a Transformer Encoder and Multi-Scale Collaboration Perception , 2022, Sensors.

[10]  Chenwei Nie,et al.  Maize tassel area dynamic monitoring based on near-ground and UAV RGB images by U-Net model , 2022, Comput. Electron. Agric..

[11]  A. Zaji,et al.  Wheat spike localization and counting via hybrid UNet architectures , 2022, Comput. Electron. Agric..

[12]  Zhaoying Chen,et al.  Automatic Estimation of Apple Orchard Blooming Levels Using the Improved YOLOv5 , 2022, Agronomy.

[13]  Ce Yang,et al.  DS-DETR: A Model for Tomato Leaf Disease Segmentation and Damage Evaluation , 2022, Agronomy.

[14]  Shaowen Li,et al.  Practical cucumber leaf disease recognition using improved Swin Transformer and small sample size , 2022, Comput. Electron. Agric..

[15]  Ruicheng Qiu,et al.  Field estimation of maize plant height at jointing stage using an RGB-D camera , 2022, The Crop Journal.

[16]  Chaoqun Duan,et al.  A lightweight vehicles detection network model based on YOLOv5 , 2022, Eng. Appl. Artif. Intell..

[17]  J. Adamowski,et al.  A deep learning image segmentation model for agricultural irrigation system classification , 2022, Comput. Electron. Agric..

[18]  Yan Zhang,et al.  AFFU-Net: Attention feature fusion U-Net with hybrid loss for winter jujube crack detection , 2022, Comput. Electron. Agric..

[19]  Mahsa Vaghefi,et al.  A diverse ensemble classifier for tomato disease recognition , 2022, Comput. Electron. Agric..

[20]  Xiaoyu Li,et al.  Trailer hopper automatic detection method for silage harvesting based improved U-Net , 2022, Comput. Electron. Agric..

[21]  Gensheng Hu,et al.  Lightweight dense-scale network (LDSNet) for corn leaf disease identification , 2022, Comput. Electron. Agric..

[22]  C. Gée,et al.  Pixelwise instance segmentation of leaves in dense foliage , 2022, Comput. Electron. Agric..

[23]  Maximilian Jaderson de Melo,et al.  Automatic segmentation of cattle rib-eye area in ultrasound images using the UNet++ deep neural network , 2022, Comput. Electron. Agric..

[24]  Miguel G. San-Emeterio,et al.  Deep learning-based segmentation of multiple species of weeds and corn crop using synthetic and real image datasets , 2022, Comput. Electron. Agric..

[25]  M. Zhang,et al.  Ship Detection in SAR Images Based on Multi-Scale Feature Extraction and Adaptive Feature Fusion , 2022, Remote. Sens..

[26]  Fengqi Zhang,et al.  Multi-scale spatial-spectral fusion based on multi-input fusion calculation and coordinate attention for hyperspectral image classification , 2022, Pattern Recognit..

[27]  Anisha Roy,et al.  Real-time growth stage detection model for high degree of occultation using DenseNet-fused YOLOv4 , 2022, Comput. Electron. Agric..

[28]  Junsheng Zhou,et al.  E-Res U-Net: An improved U-Net model for segmentation of muscle images , 2021, Expert Syst. Appl..

[29]  Wenbin Qian,et al.  A Lightweight YOLOv4-Based Forestry Pest Detection Method Using Coordinate Attention and Feature Fusion , 2021, Entropy.

[30]  Limin Shao,et al.  Semantic segmentation model of cotton roots in-situ image based on attention mechanism , 2021, Comput. Electron. Agric..

[31]  Jiqing Chen,et al.  An improved Yolov3 based on dual path network for cherry tomatoes detection , 2021, Journal of Food Process Engineering.

[32]  Lingjuan Miao,et al.  Sparse Label Assignment for Oriented Object Detection in Aerial Images , 2021, Remote. Sens..

[33]  Rui Gao,et al.  An improved U-Net method for the semantic segmentation of remote sensing images , 2021, Applied Intelligence.

[34]  Anima Anandkumar,et al.  SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers , 2021, NeurIPS.

[35]  Jiashi Feng,et al.  Coordinate Attention for Efficient Mobile Network Design , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  O. Kherif,et al.  Agroecological modeling of nitrogen and carbon transfers between decomposer micro-organisms, plant symbionts, soil and atmosphere in an intercropping system , 2021 .

[37]  Arief Setyanto,et al.  Data augmentation for automated pest classification in Mango farms , 2020, Comput. Electron. Agric..

[38]  Patrick Wspanialy,et al.  A detection and severity estimation system for generic diseases of tomato greenhouse plants , 2020, Comput. Electron. Agric..

[39]  Lingxian Zhang,et al.  Improving segmentation accuracy for ears of winter wheat at flowering stage by semantic segmentation , 2020, Comput. Electron. Agric..

[40]  Jing Zhang,et al.  Multi-class object detection using faster R-CNN and estimation of shaking locations for automated shake-and-catch apple harvesting , 2020, Comput. Electron. Agric..

[41]  Chiman Kwan,et al.  Tree, Shrub, and Grass Classification Using Only RGB Images , 2020, Remote Sensing.

[42]  Liang Wan,et al.  Fine-tuning convolutional neural network with transfer learning for semantic segmentation of ground-level oilseed rape images in a field with high weed pressure , 2019, Comput. Electron. Agric..

[43]  A. Aouiche,et al.  Species Interactions Improve Above-Ground Biomass and Land Use Efficiency in Intercropped Wheat and Chickpea under Low Soil Inputs , 2019, Agronomy.

[44]  Tian Wang,et al.  Classification of tree species and stock volume estimation in ground forest images using Deep Learning , 2019, Comput. Electron. Agric..

[45]  Ling Shao,et al.  Towards Bridging Semantic Gap to Improve Semantic Segmentation , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[46]  Yong Xia,et al.  D-UNet: A Dimension-Fusion U Shape Network for Chronic Stroke Lesion Segmentation , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[47]  Zafer Cömert,et al.  Identification of haploid and diploid maize seeds using convolutional neural networks and a transfer learning approach , 2019, Comput. Electron. Agric..

[48]  Wang Qi,et al.  Maize seedling detection under different growth stages and complex field environments based on an improved Faster R–CNN , 2019, Biosystems Engineering.

[49]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[50]  Yizhou Yu,et al.  FastFCN: Rethinking Dilated Convolution in the Backbone for Semantic Segmentation , 2019, ArXiv.

[51]  T. Muhammad,et al.  Synergistic improvement in spring maize yield and quality with micro/nanobubbles water oxygation , 2019, Scientific Reports.

[52]  Yuning Jiang,et al.  Unified Perceptual Parsing for Scene Understanding , 2018, ECCV.

[53]  Ming Wu,et al.  D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[54]  George Papandreou,et al.  Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation , 2018, ECCV.

[55]  Y. Assefa,et al.  Maize Yield and Planting Date Relationship: A Synthesis-Analysis for US High-Yielding Contest-Winner and Field Research Data , 2017, Front. Plant Sci..

[56]  Raquel Urtasun,et al.  Understanding the Effective Receptive Field in Deep Convolutional Neural Networks , 2016, NIPS.

[57]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[60]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[61]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[62]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[63]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Zhenghong Yu,et al.  Automatic image-based detection technology for two critical growth stages of maize: Emergence and three-leaf stage , 2013 .

[65]  Mohammad Bannayan,et al.  Weather conditions associated with irrigated crops in an arid and semi arid environment , 2011 .

[66]  D. G. Westfall,et al.  Evaluation of two ground-based active crop canopy sensors in maize: growth stage, row spacing, and sensor movement speed. , 2010 .

[67]  Jiwang Zhang,et al.  Root growth, available soil water, and water-use efficiency of winter wheat under different irrigation regimes applied at different growth stages in North China , 2010 .

[68]  John B. Solie,et al.  Expression of Variability in Corn as Influenced by Growth Stage Using Optical Sensor Measurements , 2007 .

[69]  Kunlin Zou,et al.  A modified U-Net with a specific data argumentation method for semantic segmentation of weed images in the field , 2021, Comput. Electron. Agric..

[70]  Tingting Zhang,et al.  A non-destructive and highly efficient model for detecting the genuineness of maize variety 'JINGKE 968′ using machine vision combined with deep learning , 2021, Comput. Electron. Agric..

[71]  Renato A. Krohling,et al.  A deep learning approach combining instance and semantic segmentation to identify diseases and pests of coffee leaves from in-field images , 2021, Comput. Electron. Agric..

[72]  Wenping Jiang,et al.  Recognition of rice leaf diseases and wheat leaf diseases based on multi-task deep transfer learning , 2021, Comput. Electron. Agric..

[73]  Jinya Su,et al.  Segmentation of field grape bunches via an improved pyramid scene parsing network , 2021, International Journal of Agricultural and Biological Engineering.

[74]  Liang Gong,et al.  Pixel level segmentation of early-stage in-bag rice root for its architecture analysis , 2021, Comput. Electron. Agric..

[75]  Rahul Joshi,et al.  Digital image-based plant phenotyping: a review , 2020, Korean Journal of Agricultural Science.

[76]  Guijun Yang,et al.  Monitoring of maize lodging using multi-temporal Sentinel-1 SAR data , 2020 .

[77]  Р Ю Чуйков,et al.  Обнаружение транспортных средств на изображениях загородных шоссе на основе метода Single shot multibox Detector , 2017 .