Deep Learning Based Defect Detection for Solder Joints on Industrial X-Ray Circuit Board Images

Quality control is of vital importance during electronics production. As the methods of producing electronic circuits improve, there is an increasing chance of solder defects during assembling the printed circuit board (PCB). Many technologies have been incorporated for inspecting failed soldering, such as X-ray imaging, optical imaging, and thermal imaging. With some advanced algorithms, the new technologies are expected to control the production quality based on the digital images. However, current algorithms sometimes are not accurate enough to meet the quality control. Specialists are needed to do a follow-up checking. For automated X-ray inspection, joint of interest on the X-ray image is located by region of interest (ROI) and inspected by some algorithms. Some incorrect ROIs deteriorate the inspection algorithm. The high dimension of X-ray images and the varying sizes of image dimensions also challenge the inspection algorithms. On the other hand, recent advances on deep learning shed light on image-based tasks and are competitive to human levels. In this paper, deep learning is incorporated in X-ray imaging based quality control during PCB quality inspection. Two artificial intelligence (AI) based models are proposed and compared for joint defect detection. The noised ROI problem and the varying sizes of imaging dimension problem are addressed. The efficacy of the proposed methods are verified through experimenting on a real-world 3D X-ray dataset. By incorporating the proposed methods, specialist inspection workload is largely saved.

[1]  Stig Oresjo,et al.  The Why , Where , What , How , and When of Automated X-ray Inspection By , 2001 .

[2]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[3]  Huijun Gao,et al.  Reference-Free Path-Walking Method for Ball Grid Array Inspection in Surface Mounting Machines , 2017, IEEE Transactions on Industrial Electronics.

[4]  Huijun Gao,et al.  A Line-Based-Clustering Approach for Ball Grid Array Component Inspection in Surface-Mount Technology , 2017, IEEE Transactions on Industrial Electronics.

[5]  Han Wang,et al.  SMT Solder Joint Inspection via a Novel Cascaded Convolutional Neural Network , 2018, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[6]  Lai Chin Yung Investigation of the solder void defect in IC semiconductor packaging by 3D computed tomography analysis , 2018, 2018 IEEE 20th Electronics Packaging Technology Conference (EPTC).

[7]  Tielin Shi,et al.  Detection of Micro Solder Balls Using Active Thermography Technology and K-Means Algorithm , 2018, IEEE Transactions on Industrial Informatics.

[8]  Eric Huang,et al.  Developing a Machine Vision Inspection System for Electronics Failure Analysis , 2019, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[9]  Kunihito Kato,et al.  Anomaly detection of solder joint on print circuit board by using Adversarial Autoencoder , 2019, International Conference on Quality Control by Artificial Vision.

[10]  Meng Zhang,et al.  Recent Advances in Convolutional Neural Network Acceleration , 2018, Neurocomputing.

[11]  Scott J. Jewler High Resolution Automatic X-Ray Inspection for Continuous Monitoring of Advanced Package Assembly , 2019, 2019 International Wafer Level Packaging Conference (IWLPC).

[12]  Hao Wu,et al.  Solder Joint Recognition Using Mask R-CNN Method , 2020, IEEE Transactions on Components, Packaging and Manufacturing Technology.