Defect Detection of Industry Wood Veneer Based on NAS and Multi-Channel Mask R-CNN

Wood veneer defect detection plays a vital role in the wood veneer production industry. Studies on wood veneer defect detection usually focused on detection accuracy for industrial applications but ignored algorithm execution speed; thus, their methods do not meet the required speed of online detection. In this paper, a new detection method is proposed that achieves high accuracy and a suitable speed for online production. Firstly, 2838 wood veneer images were collected using data collection equipment developed in the laboratory and labeled by experienced workers from a wood company. Then, an integrated model, glance multiple channel mask region convolution neural network (R-CNN), was constructed to detect wood veneer defects, which included a glance network and a multiple channel mask R-CNN. Neural network architect search technology was used to automatically construct the glance network with the lowest number of floating-point operations to pick out potential defect images out of numerous original wood veneer images. A genetic algorithm was used to merge the intermediate features extracted by the glance network. Multi-Channel Mask R-CNN was then used to classify and locate the defects. The experimental results show that the proposed method achieves a 98.70% overall classification accuracy and a 95.31% mean average precision, and only 2.5 s was needed to detect a batch of 50 standard images and 50 defective images. Compared with other wood veneer defect detection methods, the proposed method is more accurate and faster.

[1]  S. V. Shojaedini,et al.  A new method for defect detection in lumber images: Optimising the energy model by an irregular parametric genetic approach , 2017 .

[2]  Xin Li,et al.  A coupling model based on grey relational analysis and stepwise discriminant analysis for wood defect area identification by stress wave , 2020 .

[3]  Martin Wistuba,et al.  A Survey on Neural Architecture Search , 2019, ArXiv.

[4]  Wei Qi,et al.  Recognizing the Patterns of Wood Inner Defects Based on Wavelet Neural Networks , 2007, 2007 IEEE International Conference on Automation and Logistics.

[5]  Zhongyu Wei,et al.  A Novel Approach to Component Assembly Inspection Based on Mask R-CNN and Support Vector Machines , 2019, Inf..

[6]  Kaiming He,et al.  Exploring Randomly Wired Neural Networks for Image Recognition , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[7]  Xuelong Li,et al.  Convolution in Convolution for Network in Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[8]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Kalyanmoy Deb,et al.  NSGA-Net: neural architecture search using multi-objective genetic algorithm , 2018, GECCO.

[10]  Geoffrey G. Zhang,et al.  Detection and classification the breast tumors using mask R-CNN on sonograms , 2019, Medicine.

[11]  Hailin Feng,et al.  Image Reconstruction of Internal Defects in Wood Based on Segmented Propagation Rays of Stress Waves , 2018, Applied Sciences.

[12]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Ting He,et al.  A Fully Convolutional Neural Network for Wood Defect Location and Identification , 2019, IEEE Access.

[14]  Jianhua Lu,et al.  Dense Convolutional Networks for Semantic Segmentation , 2019, IEEE Access.

[15]  Quoc V. Le,et al.  Efficient Neural Architecture Search via Parameter Sharing , 2018, ICML.

[16]  Yong Yu,et al.  Efficient Architecture Search by Network Transformation , 2017, AAAI.

[17]  R. D. Seale,et al.  Nondestructive Evaluation of 2 by 8 and 2 by 10 Southern Pine Dimensional Lumber , 2020 .

[18]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[19]  Yang Yu,et al.  A technical view on neural architecture search , 2020, International Journal of Machine Learning and Cybernetics.

[20]  Hailin Feng,et al.  Review of the use of air-coupled ultrasonic technologies for nondestructive testing of wood and wood products , 2017, Comput. Electron. Agric..

[21]  Alan L. Yuille,et al.  Genetic CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[22]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Li Fei-Fei,et al.  Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Navid Razmjooy,et al.  A real-time mathematical computer method for potato inspection using machine vision , 2012, Comput. Math. Appl..

[25]  C. T. Sun,et al.  Defect Detection on Randomly Textured Surfaces by Convolutional Neural Networks , 2018, 2018 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[26]  Oriol Vinyals,et al.  Hierarchical Representations for Efficient Architecture Search , 2017, ICLR.

[27]  Tarek Zayed,et al.  Machine vision-based model for spalling detection and quantification in subway networks , 2017 .

[28]  Dong-Joong Kang,et al.  Machine learning-based imaging system for surface defect inspection , 2016, International Journal of Precision Engineering and Manufacturing-Green Technology.

[29]  J. Reeb,et al.  Evaluation of Laminated Veneer Lumber Tensile Strength Using Optical Scanning and Combined Optical-Ultrasonic Techniques , 2011 .

[30]  Frank Hutter,et al.  Simple And Efficient Architecture Search for Convolutional Neural Networks , 2017, ICLR.

[31]  Cai Yi,et al.  Defect identification method for poplar veneer based on progressive growing generated adversarial network and MASK R-CNN model , 2020, BioResources.

[32]  Chun-Hui Huang,et al.  Detection of wood surface defects based on particle swarm-genetic hybrid algorithm , 2016, 2016 International Conference on Audio, Language and Image Processing (ICALIP).

[33]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[34]  Shibing Wang,et al.  Wood Veneer Defect Detection System Based on Machine Vision , 2018 .

[35]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[36]  Rytis Maskeliūnas,et al.  Automated Identification of Wood Veneer Surface Defects Using Faster Region-Based Convolutional Neural Network with Data Augmentation and Transfer Learning , 2019, Applied Sciences.

[37]  Quoc V. Le,et al.  Neural Architecture Search with Reinforcement Learning , 2016, ICLR.

[38]  Xinge Liu,et al.  Predicting Density and Moisture Content of Populus xiangchengensis and Phyllostachys edulis using the X-Ray Computed Tomography Technique , 2020 .

[39]  Siti Zaiton Mohd Hashim,et al.  AUTOMATED VISION INSPECTION OF TIMBER SURFACE DEFECT: A REVIEW , 2015 .

[40]  Alejandro Ribeiro,et al.  Parsimonious Online Learning with Kernels via sparse projections in function space , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[41]  Li Yue,et al.  Simultaneous Wood Defect and Species Detection with 3D Laser Scanning Scheme , 2016 .

[42]  Naoshi Kondo,et al.  Machine vision based soybean quality evaluation , 2017, Comput. Electron. Agric..

[43]  Timo Aila,et al.  Pruning Convolutional Neural Networks for Resource Efficient Inference , 2016, ICLR.

[44]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Alok Aggarwal,et al.  Regularized Evolution for Image Classifier Architecture Search , 2018, AAAI.

[46]  Ziye Zhou,et al.  Literature Review and Comparison of Wood Testing Methods and Research on Application Technology of Computer 3D Scanning Detection , 2019 .

[47]  Xiangyu Zhang,et al.  DetNAS: Neural Architecture Search on Object Detection , 2019, ArXiv.

[48]  Wei Wu,et al.  PointCNN: Convolution On X-Transformed Points , 2018, NeurIPS.