Solder Paste Scooping Detection by Multilevel Visual Inspection of Printed Circuit Boards

In this paper, we introduce an automated Bayesian visual inspection framework for printed circuit board (PCB) assemblies, which is able to simultaneously deal with various shaped circuit elements (CEs) on multiple scales. We propose a novel hierarchical multi-marked point process model for this purpose and demonstrate its efficiency on the task of solder paste scooping detection and scoop area estimation, which are important factors regarding the strength of the joints. A global optimization process attempts to find the optimal configuration of circuit entities, considering the observed image data, prior knowledge, and interactions between the neighboring CEs. The computational requirements are kept tractable by a data-driven stochastic entity generation scheme. The proposed method is evaluated on real PCB data sets containing 125 images with more than 10 000 splice entities.

[1]  Nduka Nnamdi (Ndy) Ekere,et al.  The behavior of solder pastes in stencil printing with vibrating squeegee , 1998, IEEE Transactions on Components, Packaging, and Manufacturing Technology: Part C.

[2]  R. Storer,et al.  Critical variables of solder paste stencil printing for micro-BGA and fine-pitch QFP , 2004, IEEE Transactions on Electronics Packaging Manufacturing.

[3]  Josiane Zerubia,et al.  Detection of Object Motion Regions in Aerial Image Pairs With a Multilayer Markovian Model , 2009, IEEE Transactions on Image Processing.

[4]  Martin Litzenberger,et al.  High-Speed Embedded-Object Analysis Using a Dual-Line Timed-Address-Event Temporal-Contrast Vision Sensor , 2011, IEEE Transactions on Industrial Electronics.

[5]  Cihan H. Dagli,et al.  Automatic PCB Inspection Algorithms: A Survey , 1996, Comput. Vis. Image Underst..

[6]  Csaba Benedek.  Detection of soldering defects in Printed Circuit Boards with Hierarchical Marked Point Processes , 2011, Pattern Recognit. Lett..

[7]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Csaba Benedek.  Analysis of Solder Paste scooping with hierarchical point processes , 2011, 2011 18th IEEE International Conference on Image Processing.

[9]  Zsolt Illyefalvi-Vitez,et al.  Investigating the self-alignment of chip components during reflow soldering , 2008 .

[10]  Matti Pietikäinen,et al.  Adaptive document image binarization , 2000, Pattern Recognit..

[11]  Q. Han,et al.  Design and optimization of thermo-mechanical reliability in wafer level packaging , 2010, Microelectron. Reliab..

[12]  Harry Shum,et al.  Image segmentation by data driven Markov chain Monte Carlo , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[13]  Che-Seung Cho,et al.  Development of real-time vision-based fabric inspection system , 2005, IEEE Transactions on Industrial Electronics.

[14]  Pierre Soille,et al.  Morphological segmentation of binary patterns , 2009, Pattern Recognit. Lett..

[15]  Cristina P. Santos,et al.  Cork Parquet Quality Control Vision System Based on Texture Segmentation and Fuzzy Grammar , 2009, IEEE Transactions on Industrial Electronics.

[16]  Ndy Ekere,et al.  Predicting Scooping and Skipping in Solder Paste Printing for Reflow Soldering of SMT Devices , 1993 .

[17]  Seth Hutchinson,et al.  Image fusion and subpixel parameter estimation for automated optical inspection of electronic components , 1996, IEEE Trans. Ind. Electron..

[18]  Ian J Murray,et al.  Higher-order aberrations produce orientation-specific notches in the defocused contrast sensitivity function. , 2009, Journal of vision.

[19]  Hollis G. Potter,et al.  Author Manuscript , 2013 .

[20]  TsunekawaShou,et al.  Automatic PCB Inspection Algorithms , 1996 .

[21]  Xiaoli Li,et al.  The Specular Exponent as a Criterion for Appearance Quality Assessment of Pearllike Objects by Artificial Vision , 2012, IEEE Transactions on Industrial Electronics.

[22]  Xavier Descombes,et al.  Author manuscript, published in "Journal of Mathematical Imaging and Vision (2009)" Object , 2008 .

[23]  조지승,et al.  Development of Real-Time Vision-Based Fabric Inspection System , 2003 .

[24]  Shou C. Chen,et al.  Optimality Aspects of Greedy Schemes in Parallel Processing of Random Graph-Structured Jobs , 1994 .

[25]  H. T. Nagle,et al.  The VLSI circuit test problem-a tutorial , 1989 .

[26]  Olivér Krammer,et al.  Improved method for determining the shear strength of chip component solder joints , 2010, Microelectron. Reliab..

[27]  Michael S. Brown,et al.  Single image defocus map estimation using local contrast prior , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[28]  Josiane Zerubia,et al.  A Marked Point Process of Rectangles and Segments for Automatic Analysis of Digital Elevation Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Chin-Sheng Chen,et al.  A novel Fourier descriptor based image alignment algorithm for automatic optical inspection , 2009, J. Vis. Commun. Image Represent..

[30]  Wesley E. Snyder,et al.  Circuit board inspection using a range camera , 1991 .

[31]  Ajay Kumar,et al.  Computer-Vision-Based Fabric Defect Detection: A Survey , 2008, IEEE Transactions on Industrial Electronics.

[32]  Harold Szu,et al.  Automatic fault recognition by image correlation neural network techniques , 1993, IEEE Trans. Ind. Electron..

[33]  Josiane Zerubia,et al.  Parameter Estimation for Marked Point Processes. Application to Object Extraction from Remote Sensing Images , 2009, EMMCVPR.

[34]  Hongbo Xu,et al.  Local melting and shape controlling of solder joint via induction heating , 2009 .

[35]  Seiji Hata,et al.  Visual inspection machine for solder joints using tiered illumination , 1991, Other Conferences.

[36]  Anil K. Jain,et al.  Machine-vision techniques for inspection of printed wiring boards and thick-film circuits , 1986 .

[37]  O. Nousiainen,et al.  Thermal fatigue endurance of collapsible 95.5Sn4Ag0.5Cu spheres in LTCC/PWB assemblies , 2008, Microelectron. Reliab..

[38]  Tsung-Nan Tsai,et al.  Modeling and optimization of stencil printing operations: A comparison study , 2008, Comput. Ind. Eng..

[39]  Li-zong Lin,et al.  Study of PCB Automatic Optical Inspection System Based on Mathematical Morphology , 2009, 2009 International Conference on Computer Technology and Development.

[40]  Long Wang,et al.  Vision-Based Target Tracking and Collision Avoidance for Two Autonomous Robotic Fish , 2009, IEEE Transactions on Industrial Electronics.

[41]  Florent Lafarge,et al.  Geometric Feature Extraction by a Multimarked Point Process , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Mario Ignacio Chacon Murguia,et al.  An Adaptive Neural-Fuzzy Approach for Object Detection in Dynamic Backgrounds for Surveillance Systems , 2012, IEEE Transactions on Industrial Electronics.

[43]  Fikret Erçal,et al.  Segmentation of Printed Circuit Board Images into Basic Patterns , 1998, Comput. Vis. Image Underst..

[44]  Ákos Utasi,et al.  A 3-D marked point process model for multi-view people detection , 2011, CVPR 2011.

[45]  Russell P. Kraft,et al.  Designed experiments to investigate the solder joint quality output of a prototype automated surface mount replacement system , 1998 .

[46]  Josiane Zerubia,et al.  Marked point process in image analysis , 2002, IEEE Signal Process. Mag..

[47]  Donald Geman,et al.  Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images , 1984 .

[48]  Josiane Zerubia,et al.  Building Development Monitoring in Multitemporal Remotely Sensed Image Pairs with Stochastic Birth-Death Dynamics , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Fumio Harashima,et al.  Development of an Automatic Stencil Inspection System Using Modified Hough Transform and Fuzzy Logic , 2007, IEEE Transactions on Industrial Electronics.

[50]  Pepe Siy,et al.  A real-time industrial pattern classification system , 1989 .

[51]  Arturo A. Rodriguez,et al.  Image registration for automated inspection of printed circuit patterns using CAD reference data , 1993, Machine Vision and Applications.

[52]  Luc Vincent,et al.  Morphological grayscale reconstruction in image analysis: applications and efficient algorithms , 1993, IEEE Trans. Image Process..

[53]  Shang-Hong Lai,et al.  Optical PCB inspection system based on Hausdorff distance , 2005, IS&T/SPIE Electronic Imaging.