Quality safety monitoring of LED chips using deep learning-based vision inspection methods

Abstract The surface quality safety inspection of a light-emitting diodes (LED) chip is an indispensable step in the LED production process. The traditional vision inspection algorithm extracts defect features by artificial feature extraction. This method has become increasingly difficult as chips have become more miniaturized, and it is difficult to meet the quality safety requirements. Recently, machine learning-based vision detection methods, especially the models of deep convolution neural network (CNN), have made significant breakthroughs in this field, and their performances greatly exceed the traditional model based on manual features. In this paper, a parallel deep convolution model parallel spatial pyramid pooling network (PSPP-net) for LED chip surface quality detection is proposed. Specifically, this model aims at utilizing the advantages of the spatial pyramid pooling (SPP-net) model to online and offline extract two groups of depth-based CNN features through offline training and online recognition of two depth-based CNN data conversion streams. Then, the features are mixed and intersected in the GPU to form 1024-dimensional image feature vectors. Finally, softmax regression is adopted for defect classification and recognition. The problem of off-line feature training extraction and on-line defect recognition in surface quality safety inspection of LED chips is solved.

[1]  P. Avitabile,et al.  Non-Model Based Expansion from Limited Points to an Augmented Set of Points Using Chebyshev Polynomials , 2019, Experimental Techniques.

[2]  Chenggen Quan,et al.  3D digital image correlation using a single 3CCD colour camera and dichroic filter , 2018 .

[3]  Chuan-Zhi Dong,et al.  A computer vision approach for the load time history estimation of lively individuals and crowds , 2018 .

[4]  Jin H. Huang,et al.  Detection of cracks using neural networks and computational mechanics , 2002 .

[5]  Hua Yang,et al.  A Region-Based Normalized Cross Correlation Algorithm for the Vision-Based Positioning of Elongated IC Chips , 2015, IEEE Transactions on Semiconductor Manufacturing.

[6]  Hamit Köksel,et al.  Use of statistical filters in the classification of wheats by image analysis , 1998 .

[7]  Fuqiang Zhong,et al.  RGB laser speckles based 3D profilometry , 2019 .

[8]  Chuan-Zhi Dong,et al.  Long-term Structural Displacement Monitoring using Image Sequences and Spatio-Temporal Context Learning , 2017 .

[9]  C. Quan,et al.  Optical voice information hiding using enhanced iterative algorithm and computational ghost imaging , 2019, Journal of Optics.

[10]  Adrian E. Raftery,et al.  Linear flaw detection in woven textiles using model-based clustering , 1997, Pattern Recognit. Lett..

[11]  Xinxing Shao,et al.  A comparative study of 3D reconstruction methods in stereo digital image correlation , 2019 .

[12]  Hua Yang,et al.  A Spatial-Constraint-Based Feature Point Matching Algorithm for the Positioning of Multiple IC Instances , 2016, IEEE Transactions on Semiconductor Manufacturing.

[13]  Fuqiang Zhong,et al.  A Cost-Effective Single-Shot Structured Light System for 3D Shape Measurement , 2019, IEEE Sensors Journal.

[14]  Jürgen Beyerer,et al.  Detection of defects in groove textures of honed surfaces , 1997 .

[15]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2015, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Chuan-Zhi Dong,et al.  Marker-free monitoring of the grandstand structures and modal identification using computer vision methods , 2018, Structural Health Monitoring.

[17]  Fu Q. Zhong,et al.  Three-dimensional digital image correlation with improved efficiency and accuracy , 2018, Measurement.

[18]  P. Avitabile,et al.  Underwater Dynamic Response at Limited Points Expanded to Full-Field Strain Response , 2018 .

[19]  Fuqiang Zhong,et al.  Blob analyzation-based template matching algorithm for LED chip localization , 2017 .

[20]  Denys Breysse,et al.  Image analysis for the automated study of microcracks in concrete , 2001 .

[21]  Alan Crispin,et al.  Automated inspection of PCB components using a genetic algorithm template-matching approach , 2007 .

[22]  Chenggen Quan,et al.  Efficient digital image correlation using gradient orientation , 2018, Optics & Laser Technology.