An Uncertainty-Aware Deep Learning Framework for Defect Detection in Casting Products

Defects are unavoidable in casting production owing to the complexity of the casting process. While conventional human-visual inspection of casting products is slow and unproductive in mass productions, an automatic and reliable defect detection not just enhances the quality control process but positively improves productivity. However, casting defect detection is a challenging task due to diversity and variation in defects’ appearance. Convolutional neural networks (CNNs) have been widely applied in both image classification and defect detection tasks. Howbeit, CNNs with frequentist inference require a massive amount of data to train on and still fall short in reporting beneficial estimates of their predictive uncertainty. Accordingly, leveraging the transfer learning paradigm, we first apply four powerful CNN-based models (VGG16, ResNet50, DenseNet121, and InceptionResNetV2) on a small dataset to extract meaningful features. Extracted features are then processed by various machine learning algorithms to perform the classification task. Simulation results demonstrate that linear support vector machine (SVM) and multi-layer perceptron (MLP) show the finest performance in defect detection of casting images. Secondly, to achieve a reliable classification and to measure epistemic uncertainty, we employ an uncertainty quantification (UQ) technique (ensemble of MLP models) using features extracted from four pre-trained CNNs. UQ confusion matrix and uncertainty accuracy metric are also utilized to evaluate the predictive uncertainty estimates. Comprehensive comparisons reveal that UQ method based on VGG16 outperforms others to fetch uncertainty. We believe an uncertainty-aware automatic defect detection solution will reinforce casting productions quality assurance.

[1]  Yufeng Wang,et al.  Ice Detection Model of Wind Turbine Blades Based on Random Forest Classifier , 2018, Energies.

[2]  Saruar Alam,et al.  Automatic Polyp Segmentation Using U-Net-ResNet50 , 2020, MediaEval.

[3]  S. Satapathy,et al.  COVID-19 Diagnosis via DenseNet and Optimization of Transfer Learning Setting , 2021, Cognitive computation.

[4]  Abdulhamit Subasi,et al.  Sensor Based Human Activity Recognition Using Adaboost Ensemble Classifier , 2018 .

[5]  Shri Sant,et al.  Defects, Causes and Their Remedies in Casting Process: A Review , 2014 .

[6]  Abbas Khosravi,et al.  A Survey of Computational Intelligence Techniques for Wind Power Uncertainty Quantification in Smart Grids , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[7]  Dominik Mittel,et al.  Vision-Based Crack Detection using Transfer Learning in Metal Forming Processes , 2019, 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA).

[8]  Wenhui Zhou,et al.  Defect Detection of Emulsion Pump Body Based on Improved Convolutional Neural Network , 2019, 2019 International Conference on Advanced Mechatronic Systems (ICAMechS).

[9]  Jason Yosinski,et al.  Deep neural networks are easily fooled: High confidence predictions for unrecognizable images , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Hua Yang,et al.  Transfer-Learning-Based Online Mura Defect Classification , 2018, IEEE Transactions on Semiconductor Manufacturing.

[11]  Yang Wang,et al.  Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. , 2018, Cancer genomics & proteomics.

[12]  Fabio A. González,et al.  Automated Diabetic Macular Edema (DME) Analysis using Fine Tuning with Inception-Resnet-v2 on OCT Images , 2018, 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES).

[13]  Fei Wang,et al.  Comparative Study on KNN and SVM Based Weather Classification Models for Day Ahead Short Term Solar PV Power Forecasting , 2017 .

[14]  Jing Wang,et al.  CAPTCHA recognition based on deep convolutional neural network. , 2019, Mathematical biosciences and engineering : MBE.

[15]  Ajmal Mian,et al.  Threat of Adversarial Attacks on Deep Learning in Computer Vision: A Survey , 2018, IEEE Access.

[16]  J. Morris Chang,et al.  Locally Differentially Private Naive Bayes Classification , 2019, ArXiv.

[17]  Sebastian Nowozin,et al.  Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shift , 2019, NeurIPS.

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Hyun Joon Shin,et al.  One-class support vector machines - an application in machine fault detection and classification , 2005, Comput. Ind. Eng..

[20]  Aravind Krishnaswamy Rangarajan,et al.  Disease Classification in Eggplant Using Pre-trained VGG16 and MSVM , 2020, Scientific Reports.

[21]  Daniel Hernández-Lobato,et al.  Scalable Gaussian Process Classification via Expectation Propagation , 2015, AISTATS.

[22]  Saeid Nahavandi,et al.  Confidence Aware Neural Networks for Skin Cancer Detection , 2021, ArXiv.

[23]  R. R. Sedamkar,et al.  Detecting Affect States Using VGG16, ResNet50 and SE-ResNet50 Networks , 2020, SN Computer Science.

[24]  Saeid Nahavandi,et al.  Objective evaluation of deep uncertainty predictions for COVID-19 detection , 2020, Scientific Reports.

[25]  Yongsheng Gao,et al.  Recognition of driving postures by multiwavelet transform and multilayer perceptron classifier , 2012, Eng. Appl. Artif. Intell..

[26]  Fabio Ramos,et al.  Malicious Software Classification Using VGG16 Deep Neural Network’s Bottleneck Features , 2018 .

[27]  Stefan Depeweg,et al.  Modeling Epistemic and Aleatoric Uncertainty with Bayesian Neural Networks and Latent Variables , 2019 .

[28]  Carl E. Rasmussen,et al.  Assessing Approximate Inference for Binary Gaussian Process Classification , 2005, J. Mach. Learn. Res..

[29]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.