In-Field Estimation of Orange Number and Size by 3D Laser Scanning

The estimation of fruit load of an orchard prior to harvest is useful for planning harvest logistics and trading decisions. The manual fruit counting and the determination of the harvesting capacity of the field results are expensive and time-consuming. The automatic counting of fruits and their geometry characterization with 3D LiDAR models can be an interesting alternative. Field research has been conducted in the province of Cordoba (Southern Spain) on 24 ‘Salustiana’ variety orange trees—Citrus sinensis (L.) Osbeck—(12 were pruned and 12 unpruned). Harvest size and the number of each fruit were registered. Likewise, the unitary weight of the fruits and their diameter were determined (N = 160). The orange trees were also modelled with 3D LiDAR with colour capture for their subsequent segmentation and fruit detection by using a K-means algorithm. In the case of pruned trees, a significant regression was obtained between the real and modelled fruit number (R2 = 0.63, p = 0.01). The opposite case occurred in the unpruned ones (p = 0.18) due to a leaf occlusion problem. The mean diameters proportioned by the algorithm (72.15 ± 22.62 mm) did not present significant differences (p = 0.35) with the ones measured on fruits (72.68 ± 5.728 mm). Even though the use of 3D LiDAR scans is time-consuming, the harvest size estimation obtained in this research is very accurate.

[1]  Giorgio Grasso,et al.  Localization of spherical fruits for robotic harvesting , 2001, Machine Vision and Applications.

[2]  J. Revuelto,et al.  Utilización de técnicas de láser escáner terrestre en la monitorización de procesos geomorfológicos dinámicos: el manto de nieve y heleros en áreas de montaña , 2013 .

[3]  N. Pfeifer,et al.  AUTOMATIC RECONSTRUCTION OF SINGLE TREES FROM TERRESTRIAL LASER SCANNER DATA , 2004 .

[4]  A. Keyhani,et al.  Some physical properties of orange ( var , 2022 .

[5]  T. F. Burks,et al.  Current Developments in Automated Citrus Harvesting , 2004 .

[6]  Anne Verroust-Blondet,et al.  Extracting skeletal curves from 3D scattered data , 2000, The Visual Computer.

[7]  Bernard Gosselin,et al.  Thresholding-based segmentation and apple grading by machine vision , 2005, 2005 13th European Signal Processing Conference.

[8]  Xinxin Zhu,et al.  Experiments and Analysis of Close-Shot Identification of On-Branch Citrus Fruit with RealSense , 2018, Sensors.

[9]  S. P. Lloyd,et al.  Least squares quantization in PCM , 1982, IEEE Trans. Inf. Theory.

[10]  P. Gong,et al.  Automated methods for measuring DBH and tree heights with a commercial scanning lidar , 2011 .

[11]  A Rodríguez-Lizana,et al.  Assessing the optimal liquid volume to be sprayed on isolated olive trees according to their canopy volumes. , 2016, The Science of the total environment.

[12]  Dennis Jarvis,et al.  Estimation of mango crop yield using image analysis - Segmentation method , 2013 .

[13]  Victor Alchanatis,et al.  Study on Fruit Visibility for Robotic Harvesting , 2007 .

[14]  Rafael R. Sola-Guirado,et al.  Assessment of the Accuracy of a Multi-Beam LED Scanner Sensor for Measuring Olive Canopies , 2018, Sensors.

[15]  Brian N. Bailey,et al.  Semi-direct tree reconstruction using terrestrial LiDAR point cloud data , 2018 .

[16]  E. J. van Henten,et al.  Collision-free Motion Planning for a Cucumber Picking Robot , 2003 .

[17]  Matthew N. Dailey,et al.  Texture-based fruit detection , 2014, Precision Agriculture.

[18]  W. S. Qureshi,et al.  Machine vision for counting fruit on mango tree canopies , 2017, Precision Agriculture.

[19]  James Patrick Underwood,et al.  Image Segmentation for Fruit Detection and Yield Estimation in Apple Orchards , 2016, J. Field Robotics.

[20]  G. Shruthi Automatic Detection and Classification of Apple-A Survey , 2017 .

[21]  B. Iglewicz,et al.  Bivariate extensions of the boxplot , 1992 .

[22]  D. Petley,et al.  Erosional processes in the hard rock coastal cliffs at Staithes, North Yorkshire , 2010 .

[23]  Q. Zhang,et al.  Sensors and systems for fruit detection and localization: A review , 2015, Comput. Electron. Agric..

[24]  J. Phattaralerphong,et al.  A method for 3D reconstruction of tree crown volume from photographs: assessment with 3D-digitized plants. , 2005, Tree physiology.

[25]  A. Keyhani,et al.  Some physical properties of orange (var. Tompson) , 2007 .

[26]  Kuan Chong Ting,et al.  Visual feedback guided robotic cherry tomato harvesting , 1996 .

[27]  Ahmad Tabatabaeefar,et al.  Modeling of Orange Mass Based on Dimensions , 2000 .

[28]  Johnny Park,et al.  Segmentation of Apple Fruit from Video via Background Modeling , 2006 .

[29]  T. W. Ridler,et al.  Picture thresholding using an iterative selection method. , 1978 .

[30]  Shin'ichi Satoh,et al.  Dense segmentation of textured fruits in video sequences , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[31]  Filiberto Pla,et al.  Recognition of Partial Circular Shapes from Segmented Contours , 1996, Comput. Vis. Image Underst..

[32]  Nobuya Mizoue,et al.  Image analysis measure of crown condition, foliage biomass and stem growth relationships of Chamaecyparis obtusa , 2003 .

[33]  Salah Sukkarieh,et al.  Mapping almond orchard canopy volume, flowers, fruit and yield using lidar and vision sensors , 2016, Comput. Electron. Agric..

[34]  Tateshi Fujiura,et al.  Cherry-harvesting robot , 2008 .

[35]  Francisco Manzano-Agugliaro,et al.  An active contour computer algorithm for the classification of cucumbers , 2013 .

[36]  J. A. Alvarez-Bermejo,et al.  Development of a smartphone application for assessment of chilling injuries in zucchini , 2019 .

[37]  A. Miranda-Fuentes,et al.  Improving plant protection product applications in traditional and intensive olive orchards through the development of new prototype air-assisted sprayers , 2017 .

[38]  Hervé Sinoquet,et al.  Tree analyzer: a software to compute tree structure parameters from photographs , 2004 .

[39]  G. E. Miles,et al.  Fruit location in a partially occluded image , 1984 .

[40]  James Patrick Underwood,et al.  Image Based Mango Fruit Detection, Localisation and Yield Estimation Using Multiple View Geometry , 2016, Sensors.

[41]  Ismael García-Gómez,et al.  Láser escáner y nubes de puntos. Un horizonte aplicado al análisis arqueológico de edificios , 2011 .

[42]  Jose L Pons,et al.  A SURVEY OF COMPUTER VISION METHODS FOR LOCATING FRUIT ON TREES , 2000 .

[43]  R. C. Harrell,et al.  The Florida robotic grove-lab. , 1990 .

[44]  F. Manzano-Agugliaro,et al.  Controlled deficit irrigation for orange trees in Mediterranean countries , 2017 .

[45]  Thomas F. Burks,et al.  A Machine Vision Algorithm Combining Adaptive Segmentation and Shape Analysis for Orange Fruit Detection , 2010 .

[46]  Matthew N. Dailey,et al.  Towards Automated Crop Yield Estimation - Detection and 3D Reconstruction of Pineapples in Video Sequences , 2010, VISAPP.

[47]  Geoffrey H. Ball,et al.  ISODATA, A NOVEL METHOD OF DATA ANALYSIS AND PATTERN CLASSIFICATION , 1965 .

[48]  Yoav Sarig,et al.  Robotics of Fruit Harvesting: A State-of-the-art Review , 1993 .

[49]  Emilio Gil,et al.  Influence of liquid-volume and airflow rates on spray application quality and homogeneity in super-intensive olive tree canopies. , 2015, The Science of the total environment.

[50]  W. Cohen,et al.  Surface lidar remote sensing of basal area and biomass in deciduous forests of eastern Maryland, USA , 1999 .