Harvest Crate Detection for Grapes Harvesting Robot Based on YOLOv3 Model

Fast and accurate algorithms for object detection allow robotic systems to real-time process scene information identically to the human visual system. The robotic system of our interest is a grape harvesting robot. The robot will cut the grape bunches suitable for harvesting and collect them in harvest crates located in the vineyard corridors along its path. In this work, a state-of-the-art algorithm, the You-Only-LookOnce version 3 (YOLOv3), is employed to solve the in-field demanding object detection task, that of harvest crates. Complicated environment in-field conditions, such as illumination variations, branches and leaves occlusion, weed and object overlapping, make harvest crates detection challenging. The proposed algorithm is suitable to deal with these problems. Experimental results verify the effectiveness of the model under varying conditions, providing high recognition accuracy up to 99.74 % (mAP). Thus, the model is able to provide reliable information to the harvesting robot, which is the required preliminary step so that the robot could navigate to the harvest crate and place the grape bunches.

[1]  Vassilis G. Kaburlasos,et al.  Semantic Segmentation of Vineyard Images Using Convolutional Neural Networks , 2020, EANN.

[2]  Huang Rui,et al.  A Rapid Recognition Method for Electronic Components Based on the Improved YOLO-V3 Network , 2019, Electronics.

[3]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[4]  Rachel Huang,et al.  YOLO-LITE: A Real-Time Object Detection Algorithm Optimized for Non-GPU Computers , 2018, 2018 IEEE International Conference on Big Data (Big Data).

[5]  Xiren Miao,et al.  Distribution Line Pole Detection and Counting Based on YOLO Using UAV Inspection Line Video , 2019, Journal of Electrical Engineering & Technology.

[6]  Eleni Vrochidou,et al.  Grapes Visual Segmentation for Harvesting Robots Using Local Texture Descriptors , 2019, ICVS.

[7]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[8]  Alexander Wong,et al.  Fast YOLO: A Fast You Only Look Once System for Real-time Embedded Object Detection in Video , 2017, ArXiv.

[9]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ali Farhadi,et al.  YOLOv3: An Incremental Improvement , 2018, ArXiv.

[11]  A. Haslett.  Electronics , 1948 .

[12]  A. Kamilaris,et al.  A review of the use of convolutional neural networks in agriculture , 2018, The Journal of Agricultural Science.

[13]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Ana Maria Mendonça,et al.  A Pixel-Wise Distance Regression Approach for Joint Retinal Optical Disc and Fovea Detection , 2018, MICCAI.

[15]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[16]  Eleni Vrochidou,et al.  Machine Vision Systems in Precision Agriculture for Crop Farming , 2019, J. Imaging.

[17]  Guoxu Liu,et al.  YOLO-Tomato: A Robust Algorithm for Tomato Detection Based on YOLOv3 , 2020, Sensors.

[18]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[19]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Bowen Shi,et al.  Research on Recognition Method of Electrical Components Based on YOLO V3 , 2019, IEEE Access.

[21]  Horst-Michael Groß,et al.  Complex-YOLO: An Euler-Region-Proposal for Real-Time 3D Object Detection on Point Clouds , 2018, ECCV Workshops.