SEM image denoising with unsupervised machine learning for better defect inspection and metrology

CD-SEM images inherently contain a significant level of noise. This is because a limited number of frames are used for averaging, which is critical to ensure throughput and minimize resist shrinkage. This noise level of SEM images may lead to false defect detections and erroneous metrology. Therefore, reducing noise in SEM images is of utmost importance. Both conventional noise filtering techniques and recent most discriminative deep-learning based denoising algorithms are restricted with certain limitations. The first enables the risk of loss of information content and the later mostly requires clean ground-truth or synthetic images to train with. In this paper, we have proposed an U-Net architecture based unsupervised machine learning approach for denoising CD-SEM images without the requirement of any such ground-truth or synthetic images in true sense. Also, we have analysed and validated our result using MetroLER, v2.2.5.0. library. We have compared the power spectral density (PSD) of both the original noisy and denoised images. The high frequency component related to noise is clearly affected, as expected, while the low frequency component, related to the actual morphology of the feature, is unaltered. This indicate that the information content of the denoised images was not degraded by the proposed denoising approach in comparison to other existing approaches.

[1]  Kasem Khalil,et al.  Intelligent Fault-Prediction Assisted Self-Healing for Embryonic Hardware , 2020, IEEE Transactions on Biomedical Circuits and Systems.

[2]  Sounkalo Dembélé,et al.  Scanning electron microscope image signal-to-noise ratio monitoring for micro-nanomanipulation. , 2014, Scanning.

[3]  Magdy Bayoumi,et al.  Architecture of A Novel Low-Cost Hardware Neural Network , 2020, 2020 IEEE 63rd International Midwest Symposium on Circuits and Systems (MWSCAS).

[4]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Magdy A. Bayoumi,et al.  A Novel Reconfigurable Hardware Architecture of Neural Network , 2019, 2019 IEEE 62nd International Midwest Symposium on Circuits and Systems (MWSCAS).

[6]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  S. V. Sreenivasan,et al.  Metrology, Inspection, and Process Control for Microlithography XXVI , 2013 .

[8]  Miin-Shen Yang,et al.  Unsupervised K-Means Clustering Algorithm , 2020, IEEE Access.

[9]  M. Lüthje,et al.  Gaussian Mixture Models For Robust Unsupervised Scanning-Electron Microscopy Image Segmentation Of North Sea Chalk , 2018, First EAGE/PESGB Workshop Machine Learning.

[10]  B. Lindsay Mixture models : theory, geometry, and applications , 1995 .

[11]  Wei Fang,et al.  SEM image quality enhancement: an unsupervised deep learning approach , 2020, Advanced Lithography.

[12]  Magdy Bayoumi,et al.  Machine Learning-Based Approach for Hardware Faults Prediction , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[13]  Chris A. Mack,et al.  Analytical linescan model for SEM metrology , 2015, Advanced Lithography.

[14]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[15]  Sandip Halder,et al.  Unsupervised machine learning based CD-SEM image segregator for OPC and process window estimation , 2020 .

[16]  Masafumi Hagiwara,et al.  A natural language processing neural network comprehending English , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[17]  Massimiliano Pontil,et al.  Support Vector Machines: Theory and Applications , 2001, Machine Learning and Its Applications.

[18]  Magdy Bayoumi,et al.  Economic LSTM Approach for Recurrent Neural Networks , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[19]  Sandip Halder,et al.  Deep-learning-based SEM image denoiser (Conference Presentation) , 2019 .

[20]  Che-Wei Huang,et al.  Deep convolutional recurrent neural network with attention mechanism for robust speech emotion recognition , 2017, 2017 IEEE International Conference on Multimedia and Expo (ICME).

[21]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[22]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[23]  Narendra Chaudhary,et al.  Line roughness estimation and Poisson denoising in scanning electron microscope images using deep learning , 2019, Journal of Micro/Nanolithography, MEMS, and MOEMS.

[24]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[25]  Yoshihiro Midoh,et al.  Image quality enhancement of a CD-SEM image using conditional generative adversarial networks , 2019, Advanced Lithography.