Defect Detection in Printed Circuit Boards Using You-Only-Look-Once Convolutional Neural Networks

In this study, a deep learning algorithm based on the you-only-look-once (YOLO) approach is proposed for the quality inspection of printed circuit boards (PCBs). The high accuracy and efficiency of deep learning algorithms has resulted in their increased adoption in every field. Similarly, accurate detection of defects in PCBs by using deep learning algorithms, such as convolutional neural networks (CNNs), has garnered considerable attention. In the proposed method, highly skilled quality inspection engineers first use an interface to record and label defective PCBs. The data are then used to train a YOLO/CNN model to detect defects in PCBs. In this study, 11,000 images and a network of 24 convolutional layers and 2 fully connected layers were used. The proposed model achieved a defect detection accuracy of 98.79% in PCBs with a batch size of 32.

[1]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Christian Viard-Gaudin,et al.  A Convolutional Neural Network Approach for Objective Video Quality Assessment , 2006, IEEE Transactions on Neural Networks.

[3]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Yohei Takada Tokiko Shiina Hiroyasu Usami Yuji Iwahori Defect Detection and Classification of Electronic Circuit Boards Using Keypoint Extraction and CNN Features , 2017 .

[5]  Zuwairie Ibrahim,et al.  An image processing approach towards classification of defects on printed circuit board , 2007 .

[6]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Phil Blunsom,et al.  A Convolutional Neural Network for Modelling Sentences , 2014, ACL.

[8]  Yu Cao,et al.  Throughput-Optimized OpenCL-based FPGA Accelerator for Large-Scale Convolutional Neural Networks , 2016, FPGA.

[9]  Mahesh Rao,et al.  A survey on defect detection in bare PCB and assembled PCB using image processing techniques , 2017, 2017 International Conference on Wireless Communications, Signal Processing and Networking (WiSPNET).

[10]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[11]  Radha Poovendran,et al.  On the Limitation of Convolutional Neural Networks in Recognizing Negative Images , 2017, 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA).

[12]  Hüseyin Gürüler,et al.  Rapid Automated Classification of Anesthetic Depth Levels using GPU Based Parallelization of Neural Networks , 2015, Journal of medical systems.

[13]  Michael Garland,et al.  AdaBatch: Adaptive Batch Sizes for Training Deep Neural Networks , 2017, ArXiv.

[14]  Alan Crispin,et al.  Automated inspection of PCB components using a genetic algorithm template-matching approach , 2007 .

[15]  De Xu,et al.  Wire Defect Recognition of Spring-Wire Socket Using Multitask Convolutional Neural Networks , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[16]  Sharat Chandra Bhardwaj,et al.  Detection of Bare PCB Defects by Image Subtraction Method using Machine Vision , 2011 .

[17]  C. Eswaran,et al.  Automated Detection of Anesthetic Depth Levels Using Chaotic Features with Artificial Neural Networks , 2007, Journal of Medical Systems.

[18]  Fa'Iq Raihan,et al.  PCB defect detection USING OPENCV with image subtraction method , 2017, 2017 International Conference on Information Management and Technology (ICIMTech).

[19]  Dong Wang,et al.  PipeCNN: An OpenCL-Based FPGA Accelerator for Large-Scale Convolution Neuron Networks , 2016, ArXiv.

[20]  Jing Li,et al.  Improving the Performance of OpenCL-based FPGA Accelerator for Convolutional Neural Network , 2017, FPGA.

[21]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[22]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[25]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[26]  Jason Cong,et al.  Minimizing Computation in Convolutional Neural Networks , 2014, ICANN.

[27]  Mark D. Pritt,et al.  Satellite Image Classification with Deep Learning , 2017, 2017 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[28]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[29]  Erik W. Jensen,et al.  EEG complexity as a measure of depth of anesthesia for patients , 2001, IEEE Trans. Biomed. Eng..

[30]  P S Malge,et al.  PCB Defect Detection, Classification and Localization using Mathematical Morphology and Image Processing Tools , 2014 .

[31]  Luca Maria Gambardella,et al.  Convolutional Neural Network Committees for Handwritten Character Classification , 2011, 2011 International Conference on Document Analysis and Recognition.