A real-time approach for automatic defect detection from PCBs based on SURF features and morphological operations

This paper presents an automatic inspection approach for Printed Circuit Boards (PCBs) with accurate determination of the fault location and identification of the fault type. This approach depends on several digital image processing techniques including registration, filtering, foreground segmentation, mathematical morphological operations, subtraction, feature extraction, and component matching. The Speeded Up Robust Feature extraction (SURF) technique is used for two purposes: registration of the PCB to be checked to a reference PCB and detection of feature points of each missing component on the PCB that is localized from the subtraction process from the reference PCB. Operation is performed on the hue component of the color PCB images. A dictionary is first built for all possible components on the available PCBs with SURF feature descriptors, and hence if a missing item is detected on a PCB during the inspection process, the SURF feature descriptors for features extracted from the difference between the tested and reference PCBs at the position of the lost component are matched with those in the built dictionary or database. A distance metric is used in the matching process. The importance of the proposed approach lies in its ability to build a dictionary of feature descriptors for all possible components in a diversity of PCBs and its ability to localize and identify the missing components regardless of the PCB position, rotation, or type. All operations are formulated in a Graphical User Interface (GUI) using MATLAB environment.

[1]  Peng Wei,et al.  A PCB Dataset for Defects Detection and Classification , 2019, ArXiv.

[2]  S. Padmavathi,et al.  Feature detection for color images using SURF , 2017, 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS).

[3]  Farhang Yazdani,et al.  Fault detection using thermal image based on soft computing methods: Comparative study , 2017, Microelectron. Reliab..

[4]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[5]  Jianfeng Li,et al.  A PCB photoelectric image edge information detection method , 2017 .

[6]  Z. Ibrahim,et al.  Printed circuit board defect detection using mathematical morphology and MATLAB image processing tools , 2010, 2010 2nd International Conference on Education Technology and Computer.

[7]  Mohamed Amin,et al.  Double random phase encoding for cancelable face and iris recognition. , 2018, Applied optics.

[8]  Liqiang Nie,et al.  Surface defect classification in large-scale strip steel image collection via hybrid chromosome genetic algorithm , 2016, Neurocomputing.

[9]  Vedang Chauhan,et al.  A Comparative Study of Machine Vision Based Methods for Fault Detection in an Automated Assembly Machine , 2015 .

[10]  Jacob Toft Pedersen Study group SURF : Feature detection & description , 2011 .

[11]  Rajashekarappa,et al.  Identification of PCB faults using image processing , 2017, 2017 International Conference on Electrical, Electronics, Communication, Computer, and Optimization Techniques (ICEECCOT).

[12]  Baharum Baharudin,et al.  Analysis of distance metrics in content-based image retrieval using statistical quantized histogram texture features in the DCT domain , 2013, J. King Saud Univ. Comput. Inf. Sci..

[13]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[14]  Kontorn Chamniprasart,et al.  Using Machine Vision for Flexible Automatic Assembly System , 2016, KES.

[15]  Yogesh Kumar Automatic Misalignment Defects Detection & Correction in PCB using SURF (Speed up Robust Features) Technique , 2017 .

[16]  Henri Maitre Image Processing , 2008 .

[17]  Reshma Raj,et al.  Keypoint Extraction Using SURF Algorithm for CMFD , 2016 .

[18]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Sehat Ullah,et al.  Medical image registration in image guided surgery: Issues, challenges and research opportunities , 2017 .

[20]  Luming Zhang,et al.  Recognizing semantic correlation in image-text weibo via feature space mapping , 2017, Comput. Vis. Image Underst..

[21]  Maziah Mohamad,et al.  MATLAB based defect detection and classification of printed circuit board , 2012, 2012 Second International Conference on Digital Information and Communication Technology and it's Applications (DICTAP).