Character Recognition of Components Mounted on Printed Circuit Board Using Deep Learning

As the size of components mounted on printed circuit boards (PCBs) decreases, defect detection becomes more important. The first step in an inspection involves recognizing and inspecting characters printed on parts attached to the PCB. In addition, since industrial fields that produce PCBs can change very rapidly, the style of the collected data may vary between collection sites and collection periods. Therefore, flexible learning data that can respond to all fields and time periods are needed. In this paper, large amounts of character data on PCB components were obtained and analyzed in depth. In addition, we proposed a method of recognizing characters by constructing a dataset that was robust with various fonts and environmental changes using a large amount of data. Moreover, a coreset capable of evaluating an effective deep learning model and a base set using n-pick sampling capable of responding to a continuously increasing dataset were proposed. Existing original data and the EfficientNet B0 model showed an accuracy of 97.741%. However, the accuracy of our proposed model was increased to 98.274% for the coreset of 8000 images per class. In particular, the accuracy was 98.921% for the base set with only 1900 images per class.

[1]  Naif Alajlan,et al.  Simple Yet Effective Fine-Tuning of Deep CNNs Using an Auxiliary Classification Loss for Remote Sensing Scene Classification , 2019, Remote. Sens..

[2]  Ndayishimiye Fabrice,et al.  Coresets for PCB Character Recognition based on Deep Learning , 2020, 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC).

[3]  Bo Chen,et al.  MnasNet: Platform-Aware Neural Architecture Search for Mobile , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Jang-Sik Park,et al.  Improvement of Character Recognition for Parts Book Using Pre-processing of Deep Learning , 2019 .

[5]  Peng Wei,et al.  HRIPCB: a challenging dataset for PCB defects detection and classification , 2020 .

[6]  Jeff M. Phillips,et al.  Coresets and Sketches , 2016, ArXiv.

[7]  Md. Zakirul Alam Bhuiyan,et al.  A Survey on Deep Learning in Big Data , 2017, 22017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC).

[8]  Ke Gu,et al.  Learning a No-Reference Quality Assessment Model of Enhanced Images With Big Data , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[9]  Se-Hoon Lee,et al.  PCB Defect Inspection using Deep Learning , 2018 .

[10]  Zsolt Kira,et al.  Data-Efficient Graph Embedding Learning for PCB Component Detection , 2018, 2019 IEEE Winter Conference on Applications of Computer Vision (WACV).

[11]  Wei Li,et al.  Text recognition for information retrieval in images of printed circuit boards , 2014, IECON 2014 - 40th Annual Conference of the IEEE Industrial Electronics Society.

[12]  Bruno J. T. Fernandes,et al.  Automatic Optical Inspection for Defective PCB Detection Using Transfer Learning , 2019, 2019 IEEE Latin American Conference on Computational Intelligence (LA-CCI).

[13]  Liang Chen,et al.  GAN Augmentation: Augmenting Training Data using Generative Adversarial Networks , 2018, ArXiv.

[14]  Jiun-In Guo,et al.  Automatic Industry PCB Board DIP Process Defect Detection with Deep Ensemble Method , 2020, 2020 IEEE 29th International Symposium on Industrial Electronics (ISIE).

[15]  Andreas Krause,et al.  Practical Coreset Constructions for Machine Learning , 2017, 1703.06476.

[16]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[17]  Jianhui Wang,et al.  Detection of PCB Surface Defects With Improved Faster-RCNN and Feature Pyramid Network , 2020, IEEE Access.

[18]  Yu Ting Li,et al.  A VGG-16 Based Faster RCNN Model for PCB Error Inspection in Industrial AOI Applications , 2018, 2018 IEEE International Conference on Consumer Electronics-Taiwan (ICCE-TW).

[19]  Vishnu S. Pendyala,et al.  Machine Learning Algorithms , 2018, Optimization Techniques and Applications with Examples.

[20]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[21]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[22]  Tai-Hoon Cho.  Detection of PCB Components Using Deep Neural Nets , 2020 .

[23]  F. F. González-Navarro,et al.  OCR for Unreadable Damaged Characters on PCBs Using Principal Component Analysis and Bayesian Discriminant Functions , 2015, 2015 International Conference on Computational Science and Computational Intelligence (CSCI).

[24]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[25]  Jie Yang,et al.  Online PCB Defect Detector On A New PCB Defect Dataset , 2019, ArXiv.

[26]  Jung Jin-He,et al.  A PCB Character Recognition System Using Rotation-Invariant Features , 2006 .

[27]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Constantine Bekas,et al.  BAGAN: Data Augmentation with Balancing GAN , 2018, ArXiv.

[29]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.

[30]  Joon Jae Lee,et al.  Training Data Sets Construction from Large Data Set for PCB Character Recognition , 2019, J. Multim. Inf. Syst..

[31]  Lee Joon Jae,et al.  Coreset Construction for Character Recognition of PCB Components Based on Deep Learning , 2021 .