Unsupervised machine learning based SEM image denoising for robust contour detection

Contour detection of an object is a fundamental computer vision problem in image processing domain. The goal is to find a concrete boundary for pixel ownership between an OOI (object-of-interest) and its corresponding background. However, contour extraction from low SN SEM images is a very challenging problem as different sources of noise shadow the estimation of underlying structural geometries. As device scaling continues to 3nm node and below, the extraction of accurate CD contour geometries from SEM images especially ADI (after developed inspection) is of utmost importance for a qualitative lithographic process as well as to verify device characterization in aggressive pitches. In this paper, we have applied a U-Net architecture based unsupervised machine learning approach for de-noising CD-SEM images. Unlike other discriminative deep-learning based de-noising approaches, the proposed method does not require any ground-truth as clean/noiseless images or synthetic noiseless images for training. Simultaneously, we have also attempted to demonstrate how de-noising is helping to improve the contour detection accuracy. We have analyzed and validated our result by using a programmable tool (SEMSuiteTM) for contour extraction. We have de-noised SEM images with categorically different geometrical patterns such as L/S (line-space), T2T (tip-to-tip), pillars with different scan types etc. and extracted the contours in both noisy and de-noised images. The comparative analysis demonstrates that de-noised images have higher confidence contour metric than their noisy twins while keeping the same parameter settings for both data input. When the ML algorithm is applied, the contour extraction results would have higher confidence numbers comparing with the ones only applied the conventional Gaussian or Median blur de-noise method. The final goal of this work is to establish a robust de-noising method to reduce the dependency of SEM image acquisition settings and provide more accurate metrology data for OPC calibration.

[1]  Florian Jug,et al.  Noise2Void - Learning Denoising From Single Noisy Images , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Kevin W Eliceiri,et al.  NIH Image to ImageJ: 25 years of image analysis , 2012, Nature Methods.

[3]  Magdy Bayoumi,et al.  Machine Learning-Based Approach for Hardware Faults Prediction , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[4]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[5]  Chris A. Mack,et al.  Analytical linescan model for SEM metrology , 2015, Advanced Lithography.

[6]  Takumichi Sutani,et al.  LER and LWR measurements used for monitoring wiggling and stochastic-failure (Conference Presentation) , 2019, Metrology, Inspection, and Process Control for Microlithography XXXIII.

[7]  Hiroyuki Shindo,et al.  A CD-gap-free contour extraction technique for OPC model calibration , 2011, Advanced Lithography.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Patrick Schiavone,et al.  Investigating SEM-contour to CD-SEM matching , 2021, Advanced Lithography.

[10]  V. Farys,et al.  Framework for SEM contour analysis , 2017, Advanced Lithography.

[11]  Sandip Halder,et al.  Unsupervised machine learning based CD-SEM image segregator for OPC and process window estimation , 2020 .

[12]  Khaled Shaalan,et al.  Speech Recognition Using Deep Neural Networks: A Systematic Review , 2019, IEEE Access.

[13]  Miin-Shen Yang,et al.  Unsupervised K-Means Clustering Algorithm , 2020, IEEE Access.

[14]  Kasem Khalil,et al.  Intelligent Fault-Prediction Assisted Self-Healing for Embryonic Hardware , 2020, IEEE Transactions on Biomedical Circuits and Systems.

[15]  William Stafford Noble,et al.  Support vector machine , 2013 .

[16]  Magdy A. Bayoumi,et al.  A Novel Reconfigurable Hardware Architecture of Neural Network , 2019, 2019 IEEE 62nd International Midwest Symposium on Circuits and Systems (MWSCAS).

[17]  Matthijs Douze,et al.  Deep Clustering for Unsupervised Learning of Visual Features , 2018, ECCV.

[18]  Magdy A. Bayoumi,et al.  SEM image denoising with unsupervised machine learning for better defect inspection and metrology , 2021, Advanced Lithography.

[19]  Martha I. Sanchez,et al.  Metrology, Inspection, and Process Control for Microlithography XXXI , 2017 .

[20]  Magdy Bayoumi,et al.  Economic LSTM Approach for Recurrent Neural Networks , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[21]  Shrikanth S. Narayanan,et al.  Machine learning and natural language processing in psychotherapy research: Alliance as example use case. , 2020, Journal of counseling psychology.

[23]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[24]  S. V. Sreenivasan,et al.  Metrology, Inspection, and Process Control for Microlithography XXIX , 2015 .