Locally Adaptive Statistical Background Modeling With Deep Learning-Based False Positive Rejection for Defect Detection in Semiconductor Units

In this paper, we present a system for the detection and classification of defects in semiconductor units. The proposed system consists of three stages: proposal generation stage, defect detection stage and refinement stage. In the proposal generation stage, changes on the target unit are detected using a novel change detection approach. In the second stage, a deep neural network is used to classify detected regions into either defective or non-defective regions. Non-defective regions are regions exhibiting allowable changes due to factors such as lighting conditions and subtle differences in manufacturing. The defect detection stage achieves up to 94.3% accuracy. In practice, defects that are smaller than a specified tolerance size are ignored by manufacturers. The tolerance size depends on the defect types and is determined based on risk factors. In order to ignore such defects, our approach includes a final refinement stage wherein the detected defects are categorized by a stacking-based ensemble classifier into different classes. The refined system achieves up to 97.88% overall detection accuracy. The presented system is immediately applicable to different types of defects on die, epoxy and substrate. Inputs of the system can be either color or grayscale images.

[1]  Luc Van Gool,et al.  The Pascal Visual Object Classes Challenge: A Retrospective , 2014, International Journal of Computer Vision.

[2]  Mohammed Ismail,et al.  Randomized General Regression Network for Identification of Defect Patterns in Semiconductor Wafer Maps , 2015, IEEE Transactions on Semiconductor Manufacturing.

[3]  Matthew D. Zeiler ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[4]  Rajneesh Talwar,et al.  Review on different change vector analysis algorithms based change detection techniques , 2013, 2013 IEEE Second International Conference on Image Information Processing (ICIIP-2013).

[5]  Jürgen Schmidhuber,et al.  Multi-column deep neural networks for image classification , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[7]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[8]  Maoguo Gong,et al.  Change Detection in Synthetic Aperture Radar Images based on Image Fusion and Fuzzy Clustering , 2012, IEEE Transactions on Image Processing.

[9]  Georgios D. Evangelidis,et al.  Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[11]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[13]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[14]  Lorenzo Bruzzone,et al.  Automatic analysis of the difference image for unsupervised change detection , 2000, IEEE Trans. Geosci. Remote. Sens..

[15]  Alex Pentland,et al.  Pfinder: Real-Time Tracking of the Human Body , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Lina J. Karam,et al.  Change detection on SAR images using divisive normalization-based image representation , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Jieping Ye,et al.  Multifeature, Sparse-Based Approach for Defects Detection and Classification in Semiconductor Units , 2018, IEEE Transactions on Automation Science and Engineering.

[18]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[19]  Turgay Çelik,et al.  Change Detection in Satellite Images Using a Genetic Algorithm Approach , 2010, IEEE Geoscience and Remote Sensing Letters.

[20]  Moongu Jeon,et al.  A New Framework for Background Subtraction Using Multiple Cues , 2012, ACCV.

[21]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[22]  Jorng-Tzong Horng,et al.  Development Pattern Recognition Model for the Classification of Circuit Probe Wafer Maps on Semiconductors , 2012, IEEE Transactions on Components, Packaging and Manufacturing Technology.

[23]  Guillaume-Alexandre Bilodeau,et al.  Flexible Background Subtraction with Self-Balanced Local Sensitivity , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[24]  Jianbo Yu,et al.  Wafer Map Defect Detection and Recognition Using Joint Local and Nonlocal Linear Discriminant Analysis , 2016, IEEE Transactions on Semiconductor Manufacturing.

[25]  Badrinath Roysam,et al.  Image change detection algorithms: a systematic survey , 2005, IEEE Transactions on Image Processing.

[26]  Jean-Marc Odobez,et al.  Multi-Layer Background Subtraction Based on Color and Texture , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[27]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Jakob J. van Zyl,et al.  Change detection techniques for ERS-1 SAR data , 1993, IEEE Trans. Geosci. Remote. Sens..

[29]  Marc Van Droogenbroeck,et al.  Deep background subtraction with scene-specific convolutional neural networks , 2016, 2016 International Conference on Systems, Signals and Image Processing (IWSSIP).

[30]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Ying Sun,et al.  A novel fuzzy entropy approach to image enhancement and thresholding , 1999, Signal Process..

[32]  Antoine Vacavant,et al.  A comprehensive review of background subtraction algorithms evaluated with synthetic and real videos , 2014, Comput. Vis. Image Underst..

[33]  John Salvatier,et al.  Theano: A Python framework for fast computation of mathematical expressions , 2016, ArXiv.

[34]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[35]  Yifang Ban,et al.  Improving Urban Change Detection From Multitemporal SAR Images Using PCA-NLM , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[36]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[38]  Wenfeng Wu,et al.  Survey on unsupervised change detection techniques in SAR images1 , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[39]  Chen-Fu Chien,et al.  Data Mining for Optimizing IC Feature Designs to Enhance Overall Wafer Effectiveness , 2014, IEEE Transactions on Semiconductor Manufacturing.

[40]  Turgay Çelik,et al.  Unsupervised Change Detection in Satellite Images Using Principal Component Analysis and $k$-Means Clustering , 2009, IEEE Geoscience and Remote Sensing Letters.

[41]  H. Hajj,et al.  Wafer Classification Using Support Vector Machines , 2012, IEEE Transactions on Semiconductor Manufacturing.

[42]  Lina J. Karam,et al.  Change detection on SAR images by a parametric estimation of the KL-divergence between Gaussian Mixture Models , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[43]  Csaba Kertész,et al.  Texture-Based Foreground Detection , 2011 .

[44]  Guillaume-Alexandre Bilodeau,et al.  Improving background subtraction using Local Binary Similarity Patterns , 2014, IEEE Winter Conference on Applications of Computer Vision.

[45]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.