Few-Shot Learning for Small Impurities in Tobacco Stems With Improved YOLOv7

With the increase of public concern about health and smoking, the authorities have gradually tightened the control of tar content in cigarettes, making reconstituted tobacco a growing concern for tobacco companies. Tobacco stems are used as the main raw material for reconstituted tobacco, but they contain a large number of small broken impurities mainly from cigarette butts, which are difficult to remove efficiently by air selection and manual methods. Detection schemes for cigarette butt impurities based on computer vision and deep learning are still difficult. The scarcity of images containing foreign impurities in cigarette butts and the small size of impurities limit the efficient application of deep learning algorithms. In view of the small impurities’ characteristics, this paper optimizes the model structure of the YOLOv7 algorithm, and only retains the two detection head structures with high feature resolution, which reduces the model parameters by 29.68%. Using online data augmentation and transfer learning, the difficulty of small sample datasets is overcome. After the CutMix, Mosaic, Affine transformation, Copy-paste data augmentation in this paper, the model precision is increased by 6.95%, and the recall rate is increased by 10.51%. Detection FPS has been increased from 99 FPS to 111 FPS. Precision and recall rate reached 97.21% and 92.11%. Compared with YOLOv4_csp, the precision is in-creased by 11.58%, and the recall rate is increased by 0.48%. It shows that the improved YOLOv7xs model has the potential for wide application in small target recognition. At the same time, it has shown the potential to avoid the harm of toxic substances produced by cigarette impurities in the combustion process and promotes the application of computer vision and deep learning in industrial production.

[1]  Jinpeng Wang,et al.  A Dragon Fruit Picking Detection Method Based on YOLOv7 and PSP-Ellipse , 2023, Sensors.

[2]  Marco F. Huber,et al.  Defect Transfer GAN: Diverse Defect Synthesis for Data Augmentation , 2023, BMVC.

[3]  Ying Jiang,et al.  YOLOv7-RAR for Urban Vehicle Detection , 2023, Sensors.

[4]  Zhibo Wan,et al.  Real-Time Foreign Object and Production Status Detection of Tobacco Cabinets Based on Deep Learning , 2022, Applied Sciences.

[5]  Kailin Jiang,et al.  An Attention Mechanism-Improved YOLOv7 Object Detection Algorithm for Hemp Duck Count Estimation , 2022, Agriculture.

[6]  H. Liao,et al.  YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors , 2022, 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Xuanyin Wang,et al.  Cascaded foreign object detection in manufacturing processes using convolutional neural networks and synthetic data generation methodology , 2022, Journal of Intelligent Manufacturing.

[8]  Junwu Zhu,et al.  Small target deep convolution recognition algorithm based on improved YOLOv4 , 2022, International Journal of Machine Learning and Cybernetics.

[9]  Zhifeng Xiao,et al.  Potato Surface Defect Detection Based on Deep Transfer Learning , 2021, Agriculture.

[10]  Qi Zhao,et al.  TPH-YOLOv5: Improved YOLOv5 Based on Transformer Prediction Head for Object Detection on Drone-captured Scenarios , 2021, 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW).

[11]  Limiao Deng,et al.  Online defect detection and automatic grading of carrots using computer vision combined with deep learning methods , 2021 .

[12]  Ningning Ma,et al.  RepVGG: Making VGG-style ConvNets Great Again , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Quoc V. Le,et al.  Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation , 2020, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Zhang Zhiwei,et al.  Research on tobacco foreign body detection device based on machine vision , 2020 .

[15]  Duy-Dinh Le,et al.  An Evaluation of Deep Learning Methods for Small Object Detection , 2020, J. Electr. Comput. Eng..

[16]  Hong-Yuan Mark Liao,et al.  YOLOv4: Optimal Speed and Accuracy of Object Detection , 2020, ArXiv.

[17]  L. Zhigang,et al.  Application of Hyperspectral Imaging Technology in Classification of Tobacco Leaves and Impurities , 2019, 2019 2nd International Conference on Safety Produce Informatization (IICSPI).

[18]  Xu Bo,et al.  A Machine Vision Algorithm for Foreign Bodies Detection in Tobacco Conveyor , 2019, 2019 International Conference on Sensing and Instrumentation in IoT Era (ISSI).

[19]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[20]  Seong Joon Oh,et al.  CutMix: Regularization Strategy to Train Strong Classifiers With Localizable Features , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[21]  Zhe Kun Li,et al.  Study and Application of Impurity Removal Methods in Tobacco Production , 2014 .

[22]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[23]  Yangbing Wen,et al.  Study on the Decrease of Harmful Substance in Paper-Process Reconstituted Tobacco Sheet , 2011 .

[24]  Baizhan Liu,et al.  Studies on thermal behavior of reconstituted tobacco sheet , 2005 .

[25]  Q. Shi,et al.  Effect of Enzyme on Harmful Components Reduction in Reconstituted Tobacco , 2018 .

[26]  Maoshen Chen,et al.  The influence of exogenous fiber on the generation of carbonyl compounds in reconstituted tobacco sheet , 2014 .