Reference-Free Path-Walking Method for Ball Grid Array Inspection in Surface Mounting Machines

In production processes that use surface mounting machines for assembly of printed circuit boards (PCBs), visual inspection is usually employed to recognize component locations and diagnose their faults. However, commonly used inspection algorithms fail to achieve both reliability and computational efficiency, especially when applied to components with high-density and large-scale packaging, such as ball grid array (BGA). In this paper, a scheme for BGA inspection is presented to address the challenges. First, we introduce an adaptive thresholding and a median-based Otsu method to separately determine the optimal threshold for segmenting each ball. Then, a reference-free path-walking mechanism is proposed to recognize locations of the balls in the grid. BGA position and orientation are computed based on the recognition. Finally, feature extraction and defect detection are performed by using the path-walking method. The proposed technique was implemented in the host computer of Samsung SMT482 machine, and comparisons were made with the Samsung's algorithm as well as with HALCON Software. Results indicate that our approach exhibits flexibility and robustness in a wide range of BGAs with different ball grids. Compared with the Samsung's algorithm, the proposed method demonstrates higher computational efficiency and promising inspection accuracy, even under unsatisfying illumination conditions.

[1]  In-So Kweon,et al.  Ambiguous Surface Defect Image Classification of AMOLED Displays in Smartphones , 2016, IEEE Transactions on Industrial Informatics.

[2]  Bok-Suk Shin,et al.  Accurate and Robust Line Segment Extraction Using Minimum Entropy With Hough Transform , 2015, IEEE Transactions on Image Processing.

[3]  Matthew N. Dailey,et al.  A Bayesian Approach to Automated Optical Inspection for Solder Jet Ball Joint Defects in the Head Gimbal Assembly Process , 2014, IEEE Transactions on Automation Science and Engineering.

[4]  Zeungnam Bien,et al.  A vision system for an automatic assembly machine of electronic components , 1990 .

[5]  Gary R. Bradski,et al.  Learning OpenCV - computer vision with the OpenCV library: software that sees , 2008 .

[6]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[7]  Giuseppe Acciani,et al.  A Fuzzy Method for Global Quality Index Evaluation of Solder Joints in Surface Mount Technology , 2011, IEEE Transactions on Industrial Informatics.

[8]  Ching-Long Shih,et al.  Locating and checking of BGA pins’ position using gray level , 2005 .

[9]  Yoshiharu Azuma,et al.  Detection of defects at BGA solder joints by using X-ray imaging , 2002, 2002 IEEE International Conference on Industrial Technology, 2002. IEEE ICIT '02..

[10]  Wen-Yen Wu,et al.  A system for automated BGA inspection , 2004, IEEE Conference on Cybernetics and Intelligent Systems, 2004..

[11]  P. Swaminathan,et al.  Hough Transform Method for Determining the Fuel Sub-Assembly's In-Situ ‘Bow’ in Breeder Reactor Using Its Sparsely Scanned Ultrasonic Image , 2013, IEEE Transactions on Nuclear Science.

[12]  Lina J. Karam,et al.  Automated Detection and Classification of Non-Wet Solder Joints , 2011, IEEE Transactions on Automation Science and Engineering.

[13]  H. Fujita,et al.  Automated Solder Inspection Technique for BGA-Mounted Substrates by Means of Oblique Computed Tomography , 2007, IEEE Transactions on Electronics Packaging Manufacturing.

[14]  D. M. Titterington,et al.  Median-based image thresholding , 2011, Image Vis. Comput..

[15]  Fumio Harashima,et al.  Development of an Automatic Stencil Inspection System Using Modified Hough Transform and Fuzzy Logic , 2007, IEEE Transactions on Industrial Electronics.

[16]  Du-Ming Tsai,et al.  Defect Inspection in Low-Contrast LCD Images Using Hough Transform-Based Nonstationary Line Detection , 2011, IEEE Transactions on Industrial Informatics.

[17]  Ari Ide-Ektessabi,et al.  A Contrast Adjustment Thresholding Method for Surface Defect Detection Based on Mesoscopy , 2015, IEEE Transactions on Industrial Informatics.

[18]  Huijun Gao,et al.  Automated Inspection of E-Shaped Magnetic Core Elements Using K-tSL-Center Clustering and Active Shape Models , 2013, IEEE Transactions on Industrial Informatics.

[19]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[20]  Takashi Suzuki,et al.  An efficient method of occluded solder ball segmentation for automated BGA void defect inspection using X-ray images , 2015, IECON 2015 - 41st Annual Conference of the IEEE Industrial Electronics Society.

[21]  Giuseppe Acciani,et al.  Application of neural networks in optical inspection and classification of solder joints in surface mount technology , 2006, IEEE Transactions on Industrial Informatics.