A Deep Learning framework for simulation and defect prediction applied in microelectronics

Abstract The prediction of upcoming events in industrial processes has been a long-standing research goal since it enables optimization of manufacturing parameters, planning of equipment maintenance and more importantly prediction and eventually prevention of defects. While existing approaches have accomplished substantial progress, they are mostly limited to processing of one dimensional signals or require parameter tuning to model environmental parameters. In this paper, we propose an alternative approach based on deep neural networks that simulates changes in the 3D structure of a monitored object in a batch based on previous 3D measurements. In particular, we propose an architecture based on 3D Convolutional Neural Networks (3DCNN) in order to model the geometric variations in manufacturing parameters and predict upcoming events related to sub-optimal performance. We validate our framework on a microelectronics use-case using the recently published “PCB scans” dataset where we simulate changes on the shape and volume of glue deposited on an Liquid Crystal Polymer (LCP) substrate before the attachment of integrated circuits (IC). Experimental evaluation examines the impact of different choices in the cost function during training and shows that the proposed method can be efficiently used for defect prediction.

[1]  Phani Chavali,et al.  Distributed Power System State Estimation Using Factor Graphs , 2015, IEEE Transactions on Signal Processing.

[2]  Zachary Chase Lipton A Critical Review of Recurrent Neural Networks for Sequence Learning , 2015, ArXiv.

[3]  Hongwen He,et al.  A Double-Scale, Particle-Filtering, Energy State Prediction Algorithm for Lithium-Ion Batteries , 2018, IEEE Transactions on Industrial Electronics.

[4]  Alexander Hauptmann,et al.  Simultaneous Bearing Fault Recognition and Remaining Useful Life Prediction Using Joint-Loss Convolutional Neural Network , 2020, IEEE Transactions on Industrial Informatics.

[5]  Ghalia Tello,et al.  Deep-Structured Machine Learning Model for the Recognition of Mixed-Defect Patterns in Semiconductor Fabrication Processes , 2018, IEEE Transactions on Semiconductor Manufacturing.

[6]  Tawfik Masrour,et al.  Prediction of Industrial Process Parameters using Artificial Intelligence Algorithms , 2018, ArXiv.

[8]  Muhammad Saqlain,et al.  A Voting Ensemble Classifier for Wafer Map Defect Patterns Identification in Semiconductor Manufacturing , 2019, IEEE Transactions on Semiconductor Manufacturing.

[9]  Yiran Chen,et al.  RouteNet: Routability prediction for Mixed-Size Designs Using Convolutional Neural Network , 2018, 2018 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[10]  Wei Qiao,et al.  Enhanced Particle Filtering for Bearing Remaining Useful Life Prediction of Wind Turbine Drivetrain Gearboxes , 2019, IEEE Transactions on Industrial Electronics.

[11]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[12]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  Guangzhong Dong,et al.  Remaining Useful Life Prediction and State of Health Diagnosis for Lithium-Ion Batteries Using Particle Filter and Support Vector Regression , 2018, IEEE Transactions on Industrial Electronics.

[15]  Ke Zhang,et al.  A Robust Prognostic Indicator for Renewable Energy Technologies: A Novel Error Correction Grey Prediction Model , 2019, IEEE Transactions on Industrial Electronics.

[16]  Dimitrios Tzovaras,et al.  A 3D-CNN Approach for the Spatio-Temporal Modeling of Surface Deterioration Phenomena , 2018, 2018 IEEE 13th Image, Video, and Multidimensional Signal Processing Workshop (IVMSP).

[17]  Song Han,et al.  Industrial Internet of Things: Challenges, Opportunities, and Directions , 2018, IEEE Transactions on Industrial Informatics.

[18]  Qiang Ling,et al.  Battery Health Prognosis Using Brownian Motion Modeling and Particle Filtering , 2018, IEEE Transactions on Industrial Electronics.

[19]  Dimitrios Tzovaras,et al.  Managing Spatial Graph Dependencies in Large Volumes of Traffic Data for Travel-Time Prediction , 2016, IEEE Transactions on Intelligent Transportation Systems.

[20]  Dimitrios Tzovaras,et al.  Fault Diagnosis in Microelectronics Attachment Via Deep Learning Analysis of 3-D Laser Scans , 2020, IEEE Transactions on Industrial Electronics.

[21]  Brigitte Chebel-Morello,et al.  Direct Remaining Useful Life Estimation Based on Support Vector Regression , 2017, IEEE Transactions on Industrial Electronics.

[22]  Ruqiang Yan,et al.  Convolutional Discriminative Feature Learning for Induction Motor Fault Diagnosis , 2017, IEEE Transactions on Industrial Informatics.

[23]  Xudong Wu,et al.  Vibroacoustic Prediction and Mechanism Analysis of Claw Pole Alternators , 2017, IEEE Transactions on Industrial Electronics.

[24]  Klaus Dietmayer,et al.  Dynamic Occupancy Grid Prediction for Urban Autonomous Driving: A Deep Learning Approach with Fully Automatic Labeling , 2017, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Liang Gao,et al.  A New Convolutional Neural Network-Based Data-Driven Fault Diagnosis Method , 2018, IEEE Transactions on Industrial Electronics.

[26]  Bogi Bech Jensen,et al.  Incorporation of Finite-Element Analysis Into Annual Energy Loss Estimation for Permanent-Magnet Wind Turbine Generators , 2013, IEEE Transactions on Industry Applications.

[27]  Yuan Zhang,et al.  Short-Term Residential Load Forecasting Based on LSTM Recurrent Neural Network , 2019, IEEE Transactions on Smart Grid.

[28]  Bernd Scholz-Reiter,et al.  Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection , 2016 .

[29]  Fei Shen,et al.  Machine Health Monitoring Using Local Feature-Based Gated Recurrent Unit Networks , 2018, IEEE Transactions on Industrial Electronics.

[30]  Ruqiang Yan,et al.  Highly Accurate Machine Fault Diagnosis Using Deep Transfer Learning , 2019, IEEE Transactions on Industrial Informatics.

[31]  Dawei Li,et al.  Automatic Detection and Classification of Sewer Defects via Hierarchical Deep Learning , 2019, IEEE Transactions on Automation Science and Engineering.

[32]  Liang Gao,et al.  A New Two-Level Hierarchical Diagnosis Network Based on Convolutional Neural Network , 2020, IEEE Transactions on Instrumentation and Measurement.

[33]  Xiang Cheng,et al.  Mobile Demand Forecasting via Deep Graph-Sequence Spatiotemporal Modeling in Cellular Networks , 2018, IEEE Internet of Things Journal.

[34]  Guanrong Chen,et al.  A Novel Deep Learning Framework for Industrial Multiphase Flow Characterization , 2019, IEEE Transactions on Industrial Informatics.

[35]  Sherali Zeadally,et al.  Deploying Fog Computing in Industrial Internet of Things and Industry 4.0 , 2018, IEEE Transactions on Industrial Informatics.