Automatic estimation of trunk cross sectional area using deep learning

This paper presents an automated method for estimating the trunk cross sectional area of fruit trees. An Intel RealSense 435i was used to capture RGB images and point clouds of individual trunks. To segment the trunk in the image from the background, a Masked-attention Mask Transformer model was adopted. The segmentation results were integrated with the 3D point cloud to estimate trunk widths in 3D. The width estimation was evaluated on three diverse datasets collected from a commercial apple orchard using human measurements as ground truth. With a mean absolute error less than 5%, the method is sufficiently accurate to assist orchard operations.

[1]  A. Schwing,et al.  Masked-attention Mask Transformer for Universal Image Segmentation , 2021, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Dinesh Kumar,et al.  Correlation of trunk cross sectional area with fruit yield, quality and leaf nutrient status in plum under North West Himalayan region of India , 2019, Journal of Horticultural Sciences.

[3]  Pei Wang,et al.  Automated low-cost terrestrial laser scanner for measuring diameters at breast height and heights of plantation trees , 2019, PloS one.

[4]  Nagham Shalal,et al.  Orchard mapping and mobile robot localisation using on-board camera and laser scanner data fusion - Part B: Mapping and localisation , 2015, Comput. Electron. Agric..

[5]  Alexander Bucksch,et al.  Breast Height Diameter Estimation From High-Density Airborne LiDAR Data , 2014, IEEE Geoscience and Remote Sensing Letters.

[6]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[7]  Jiangming Kan,et al.  Automatic measurement of trunk and branch diameter of standing trees based on computer vision , 2008, 2008 3rd IEEE Conference on Industrial Electronics and Applications.

[8]  M. Blanke,et al.  THE TRUNK CROSS-SECTION AREA AS A BASIS FOR FRUIT YIELD MODELLING IN INTENSIVE APPLE ORCHARDS , 2006 .

[9]  Ching Y. Suen,et al.  A fast parallel algorithm for thinning digital patterns , 1984, CACM.

[10]  Salah Sukkarieh,et al.  A Pipeline for Trunk Localisation Using LiDAR in Trellis Structured Orchards , 2013, FSR.