Color Biological Features-Based Solder Paste Defects Detection and Classification on Printed Circuit Boards

Deposited solder paste inspection plays a critical role in surface mounting processes. When detecting solder pastes defects on a printed circuit board, profile measurement-based methods suffer from large system size, high cost, and low speed for inspection, although they provide 3-D information of solder pastes. In contrast, image analysis-based methods facilitate the defect detection process of solder pastes by treating them as a pattern recognition problem. However, existing image analysis methods do not perform well because low-level visual features cannot catch sufficient information for defect detection. This paper proposes a new defect detection scheme for solder pastes based on learning the color biological feature sub-manifold. In particular, we apply the biologically inspired color feature (BICF) to represent the solder paste images, and introduce a new sub-manifold learning method to extract the intrinsic low-dimensional BICF manifold embedded in an extrinsic high-dimensional ambient space. This scheme mimics the function of human visual cortex in recognition tasks, and can separate poor quality solder pastes from good quality ones. We apply the new scheme to our automated optical inspection system, and thorough empirical studies indicate the effectiveness of the new scheme for practical utilization.

[1]  R. Pastore In the Eye’s Mind: Vision and the Helmholtz-Hering Controversy , 1999 .

[2]  Laurent Itti,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 Rapid Biologically-inspired Scene Classification Using Features Shared with Visual Attention , 2022 .

[3]  Jun Cheng,et al.  Clustering-driven residue filter for profile measurement system. , 2011, Journal of the Optical Society of America. A, Optics, image science, and vision.

[4]  Dacheng Tao,et al.  Biologically Inspired Feature Manifold for Scene Classification , 2010, IEEE Transactions on Image Processing.

[5]  Zhigang Luo,et al.  NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization , 2012, IEEE Transactions on Signal Processing.

[6]  Tien Yin Wong,et al.  Focal Biologically Inspired Feature for Glaucoma Type Classification , 2011, MICCAI.

[7]  Hongyuan Zha,et al.  Principal Manifolds and Nonlinear Dimension Reduction via Local Tangent Space Alignment , 2002, ArXiv.

[8]  Mel Siegel,et al.  Remote Inspection Technologies for Aircraft Skin Inspection , 1997 .

[9]  Jr. R.R. Lathrop Solder paste print qualification using laser triangulation , 1997 .

[10]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[11]  R. Fisher THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[12]  Thong Ngee Goh,et al.  Neural network modeling with confidence bounds: a case study on the solder paste deposition process , 2001 .

[13]  K. Ko,et al.  Solder Joints Inspection Using a Neural Network and Fuzzy Rule-Based Classification Method , 2000 .

[14]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[15]  Russell A. Epstein,et al.  The Parahippocampal Place Area Recognition, Navigation, or Encoding? , 1999, Neuron.

[16]  Jingqi Yuan,et al.  Statistical monitoring of fed-batch process using dynamic multiway neighborhood preserving embedding , 2008 .

[17]  Sheng Liu,et al.  A novel approach for flip chip solder joint quality inspection: laser ultrasound and interferometric system , 2001 .

[18]  Horng-Hai Loh,et al.  Printed circuit board inspection using image analysis , 1995, Proceedings IEEE Conference on Industrial Automation and Control Emerging Technology Applications.

[19]  Ming-Hwei Perng,et al.  Reflection-area-based feature descriptor for solder joint inspection , 2007, Machine Vision and Applications.

[20]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[21]  Xuelong Li,et al.  Patch Alignment for Dimensionality Reduction , 2009, IEEE Transactions on Knowledge and Data Engineering.

[22]  Dacheng Tao,et al.  Sparse transfer learning for interactive video search reranking , 2012, TOMCCAP.

[23]  Dacheng Tao,et al.  Biologically inspired model for crater detection , 2011, The 2011 International Joint Conference on Neural Networks.

[24]  Xiaofei He,et al.  Locality Preserving Projections , 2003, NIPS.

[25]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[26]  Xuelong Li,et al.  Direct kernel biased discriminant analysis: a new content-based image retrieval relevance feedback algorithm , 2006, IEEE Transactions on Multimedia.

[27]  Giuseppe Acciani,et al.  Application of neural networks in optical inspection and classification of solder joints in surface mount technology , 2006, IEEE Transactions on Industrial Informatics.

[28]  H. Hotelling Analysis of a complex of statistical variables into principal components. , 1933 .

[29]  Jun Cheng,et al.  Structured-Light Based Sensing Using a Single Fixed Fringe Grating: Fringe Boundary Detection and 3-D Reconstruction , 2008, IEEE Transactions on Electronics Packaging Manufacturing.

[30]  Shuicheng Yan,et al.  Neighborhood preserving embedding , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[31]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[32]  Jun Jiang,et al.  Multiresolution Analysis Driven Corrosion Detection on Metal Surface , 2011, 2011 International Conference on Multimedia and Signal Processing.

[33]  Ramesh C. Jain,et al.  Automatic Solder Joint Inspection , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[36]  H. Zha,et al.  Principal manifolds and nonlinear dimensionality reduction via tangent space alignment , 2004, SIAM J. Sci. Comput..

[37]  Yangsheng Xu,et al.  A Parallel-Structure Solder Paste Inspection System , 2009, IEEE/ASME Transactions on Mechatronics.

[38]  Hsu-Nan Yen,et al.  Full-field 3-D measurement of solder pastes using LCD-based phase shifting techniques , 2006, IEEE Transactions on Electronics Packaging Manufacturing.

[39]  Fuqin Deng,et al.  Regularized multiframe phase-shifting algorithm for three-dimensional profilometry. , 2012, Applied optics.

[40]  Grantham K. H. Pang,et al.  Solder paste inspection using region-based defect detection , 2008 .

[41]  Tak-Wai Hui,et al.  Solder paste inspection using region-based defect detection , 2009 .