A Novel Wood Log Measurement Combined Mask R-CNN and Stereo Vision Camera

Wood logs need to be measured for size when passing through customs to verify their quantity and volume. Due to the large number of wood logs needs through customs, a fast and accurate measurement method is required. The traditional log measurement methods are inefficient, have significant errors in determining the long and short diameters of the wood, and are difficult to achieve fast measurements in complex wood stacking environments. We use a Mask R-CNN instance segmentation model to detect the contour of the wood log and employ a binocular stereo camera to measure the log diameter. A rotation search algorithm centered on the wood contour is proposed to find long and short diameters and to optimal log size according to the Chinese standard. The experiments show that the Mask R-CNN we trained obtains 0.796 average precision and 0.943 IOUmask, and the recognition rate of wood log ends reaches 98.2%. The average error of the short diameter of the measurement results is 5.7 mm, the average error of the long diameter is 7.19 mm, and the average error of the diameter of the wood is 5.3 mm.

[1]  Qiao Dong,et al.  Automatic pixel-level detection of vertical cracks in asphalt pavement based on GPR investigation and improved mask R-CNN , 2023, Automation in Construction.

[2]  Zhen Liu,et al.  Automatic recognition of pavement cracks from combined GPR B-scan and C-scan images using multiscale feature fusion deep neural networks , 2023, Automation in Construction.

[3]  Huiqiang Wang,et al.  Individual Tree Detection in Coal Mine Afforestation Area Based on Improved Faster RCNN in UAV RGB Images , 2022, Remote. Sens..

[4]  L. Li,et al.  YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications , 2022, ArXiv.

[5]  Ling Jian,et al.  SS R-CNN: Self-Supervised Learning Improving Mask R-CNN for Ship Detection in Remote Sensing Images , 2022, Remote. Sens..

[6]  H. Liao,et al.  YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors , 2022, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  T. Bucha,et al.  Computed Tomography as a Tool for Quantification and Classification of Roundwood—Case Study , 2022, Forests.

[8]  M. Zhou,et al.  ARG-Mask RCNN: An Infrared Insulator Fault-Detection Network Based on Improved Mask RCNN , 2022, Sensors.

[9]  S. A. Borz,et al.  Application and accuracy of smart technologies for measurements of roundwood: Evaluation of time consumption and efficiency , 2022, Comput. Electron. Agric..

[10]  A. Mouhsen,et al.  A novel algorithm for distance measurement using stereo camera , 2022, CAAI Trans. Intell. Technol..

[11]  Shuying Cheng,et al.  A detection approach for bundled log ends using K-median clustering and improved YOLOv4-Tiny network , 2022, Comput. Electron. Agric..

[12]  Gensheng Hu,et al.  UAV remote sensing monitoring of pine forest diseases based on improved Mask R-CNN , 2022, International Journal of Remote Sensing.

[13]  Pei Wang,et al.  Multi-Species Individual Tree Segmentation and Identification Based on Improved Mask R-CNN and UAV Imagery in Mixed Forests , 2022, Remote. Sens..

[14]  Guiling Sun,et al.  Vegetable Size Measurement Based on Stereo Camera and Keypoints Detection , 2022, Sensors.

[15]  Christopher J. Post,et al.  Automated tree-crown and height detection in a young forest plantation using mask region-based convolutional neural network (Mask R-CNN) , 2021, ISPRS Journal of Photogrammetry and Remote Sensing.

[16]  Hongbo Mu,et al.  A Transfer Residual Neural Network Based on ResNet-34 for Detection of Wood Knot Defects , 2021, Forests.

[17]  Ji Xiang,et al.  Fish Keypoints Detection for Ecology Monitoring Based on Underwater Visual Intelligence , 2020, 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[18]  Dongyi Wang,et al.  Defect Detection of Industry Wood Veneer Based on NAS and Multi-Channel Mask R-CNN , 2020, Sensors.

[19]  Qi Cao,et al.  Obstacle distance measurement based on binocular vision for high-voltage transmission lines using a cable inspection robot , 2020, Science progress.

[20]  Hao Tang,et al.  Application of SSD framework model in detection of logs end , 2020, Journal of Physics: Conference Series.

[21]  Pratibha Rathi,et al.  YOLO v3-Tiny: Object Detection and Recognition using one stage improved model , 2020, 2020 6th International Conference on Advanced Computing and Communication Systems (ICACCS).

[22]  Ying Liu,et al.  Application of deep convolutional neural network on feature extraction and detection of wood defects , 2020 .

[23]  Wang Jiamin,et al.  Individual Rubber Tree Segmentation Based on Ground-Based LiDAR Data and Faster R-CNN of Deep Learning , 2019, Forests.

[24]  Jieping Ye,et al.  Object Detection in 20 Years: A Survey , 2019, Proceedings of the IEEE.

[25]  Bruna L. Longo,et al.  Validation of a CT knot detection algorithm on fresh Douglas-fir (Pseudotsuga menziesii (Mirb.) Franco) logs , 2019, Annals of Forest Science.

[26]  Suebskul Phiphobmongkol,et al.  Log-End Cut-Area Detection in Images Taken from Rear End of Eucalyptus Timber Trucks , 2018, 2018 15th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[27]  B. Heinzmann,et al.  Manual and Automatic Volume Measuring Methods for Industrial Timber , 2018, IOP Conference Series: Earth and Environmental Science.

[28]  Emine Dogru Bolat,et al.  A new hybrid stereovision-based distance-estimation approach for mobile robot platforms , 2017, Comput. Electr. Eng..

[29]  Artem Kruglov,et al.  Detection and dimension of moving objects using single camera applied to the round timber measurement , 2017, 2017 Federated Conference on Computer Science and Information Systems (FedCSIS).

[30]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[31]  Serge J. Belongie,et al.  Feature Pyramid Networks for Object Detection , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Artem V. Kruglov,et al.  The Algorithm of the Roundwood Volume Measurement via Photogrammetry , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[33]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[34]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[35]  Trevor Darrell,et al.  Fully convolutional networks for semantic segmentation , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Andreas Uhl,et al.  Similarity Based Cross-Section Segmentation in Rough Log End Images , 2014, AIAI.

[37]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[38]  Luigi Cambrini,et al.  Real-time 3D wood panel surface measurement using laser triangulation and low-cost hardware , 2006, Electronic Imaging.

[39]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[40]  H. Belshaw The Food and Agriculture Organization of the United Nations , 1947, International Organization.

[41]  J. Mund,et al.  Further application of using a personal laser scanner and simultaneous localization and mapping technology to estimate the log's volume and its comparison with traditional methods , 2022, Int. J. Appl. Earth Obs. Geoinformation.

[42]  Dongjie Li,et al.  Data Augmentation and Layered Deformable Mask R-CNN-Based Detection of Wood Defects , 2021, IEEE Access.

[43]  Yiming Fang,et al.  Accurate and automated detection of surface knots on sawn timbers using YOLO-V5 model , 2021 .

[44]  Franka Brüchert,et al.  Ring width detection for industrial purposes - use of CT and discrete scanning technology on fresh roundwood , 2008 .

[45]  Gu Jian-Gang The method of minimal square circularity and its application in log centering , 2002 .

[46]  Dana H. Ballard,et al.  Generalizing the Hough transform to detect arbitrary shapes , 1981, Pattern Recognit..