Eigenfeatures: Discrimination of X-ray images of epoxy resins using singular value decomposition of deep learning features

Although the process variables of epoxy resins alter their mechanical properties, the visual identification of the characteristic features of X-ray images of samples of these materials is challenging. To facilitate the identification, we approximate the magnitude of the gradient of the intensity field of the X-ray images of different kinds of epoxy resins and then we use deep learning to discover the most representative features of the transformed images. In this solution of the inverse problem to finding characteristic features to discriminate samples of heterogeneous materials, we use the eigenvectors obtained from the singular value decomposition of all the channels of the feature maps of the early layers in a convolutional neural network. While the strongest activated channel gives a visual representation of the characteristic features, often these are not robust enough in some practical settings. On the other hand, the left singular vectors of the matrix decomposition of the feature maps, barely change when variables such as the capacity of the network or network architecture change. High classification accuracy and robustness of characteristic features are presented in this work.

[1]  Robert Tibshirani,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2001, Springer Series in Statistics.

[2]  P. Withers,et al.  X-ray computed tomography of polymer composites , 2017 .

[3]  Jiwon Oh,et al.  Synergistic approach to quantifying information on a crack-based network in loess/water material composites using deep learning and network science , 2019, Computational Materials Science.

[4]  G. M. Swallowe Mechanical Properties and Testing of Polymers , 1999 .

[5]  Y. Nishiura,et al.  Bridging a mesoscopic inhomogeneity to macroscopic performance of amorphous materials in the framework of the phase field modeling , 2020, Physica D: Nonlinear Phenomena.

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[8]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[9]  Hamid Laga,et al.  Automatic detection and classification of manufacturing defects in metal boxes using deep neural networks , 2018, PloS one.

[10]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[11]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[12]  Hideo Yokota,et al.  Comparison of Machine-Learning Classification Models for Glaucoma Management , 2018, Journal of healthcare engineering.

[13]  Luca Maria Gambardella,et al.  Max-pooling convolutional neural networks for vision-based hand gesture recognition , 2011, 2011 IEEE International Conference on Signal and Image Processing Applications (ICSIPA).

[14]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[15]  Nikhil Ketkar,et al.  Deep Learning with Python , 2017 .

[16]  Carlo Luschi,et al.  Revisiting Small Batch Training for Deep Neural Networks , 2018, ArXiv.

[17]  Jake Bouvrie,et al.  Notes on Convolutional Neural Networks , 2006 .

[18]  Nicholette D. Palmer,et al.  Novel genetic associations for blood pressure identified via gene-alcohol interaction in up to 570K individuals across multiple ancestries , 2018, PloS one.

[19]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[20]  S. Torquato,et al.  Random Heterogeneous Materials: Microstructure and Macroscopic Properties , 2005 .

[21]  Duen Horng Chau,et al.  Summit: Scaling Deep Learning Interpretability by Visualizing Activation and Attribution Summarizations , 2019, IEEE Transactions on Visualization and Computer Graphics.

[22]  Francesco Fioranelli,et al.  Classification of Unarmed/Armed Personnel Using the NetRAD Multistatic Radar for Micro-Doppler and Singular Value Decomposition Features , 2015, IEEE Geoscience and Remote Sensing Letters.

[23]  Shizuo Kaji,et al.  Overview of image-to-image translation by use of deep neural networks: denoising, super-resolution, modality conversion, and reconstruction in medical imaging , 2019, Radiological Physics and Technology.

[24]  Aleksander Madry,et al.  How Does Batch Normalization Help Optimization? (No, It Is Not About Internal Covariate Shift) , 2018, NeurIPS.

[25]  D. Botstein,et al.  Singular value decomposition for genome-wide expression data processing and modeling. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[26]  Jian Sun,et al.  Accelerating Very Deep Convolutional Networks for Classification and Detection , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  M. Marques,et al.  Recent advances and applications of machine learning in solid-state materials science , 2019, npj Computational Materials.

[28]  Yann LeCun,et al.  Generalization and network design strategies , 1989 .

[29]  Simon Haykin,et al.  Neural Networks and Learning Machines , 2010 .

[30]  Qianni Zhang,et al.  Three-Class Mammogram Classification Based on Descriptive CNN Features , 2017, BioMed research international.

[31]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[32]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[33]  Hari S. Viswanathan,et al.  Learning to fail: Predicting fracture evolution in brittle materials using recurrent graph convolutional neural networks , 2018, Computational Materials Science.

[34]  Jie Kong,et al.  Self-toughening of epoxy resin through controlling topology of cross-linked networks , 2016 .

[35]  Rafael C. González,et al.  Digital image processing, 3rd Edition , 2008 .

[36]  R. Jones,et al.  Predicting the mechanical response of oligocrystals with deep learning , 2019, Computational Materials Science.

[37]  Jong-Myon Kim,et al.  Singular value decomposition based feature extraction approaches for classifying faults of induction motors , 2013 .

[38]  Jinquan Jiang,et al.  Breaking and Instability Movement Characteristics of High-Position Double-Layer Hard Thick Strata due to Longwall Mining , 2020, Shock and Vibration.

[39]  Srete Nikolovski,et al.  Deep Learning Method and Infrared Imaging as a Tool for Transformer Faults Detection , 2018 .

[40]  Seung-Ik Lee,et al.  Deep Compression of Convolutional Neural Networks with Low-rank Approximation , 2018 .

[41]  Dongpu Cao,et al.  Driver Activity Recognition for Intelligent Vehicles: A Deep Learning Approach , 2019, IEEE Transactions on Vehicular Technology.

[42]  Katta Rama Linga Reddy,et al.  Face recognition based on eigen features of multi scaled face components and an artificial neural network , 2010, Biometrics Technology.

[43]  F. Bates,et al.  Block Copolymer Toughened Epoxy: Role of Cross-Link Density , 2009 .

[44]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[45]  Audra E. Kosh,et al.  Linear Algebra and its Applications , 1992 .

[46]  Lin Gao,et al.  Automated Pavement Crack Damage Detection Using Deep Multiscale Convolutional Features , 2020, Journal of Advanced Transportation.

[47]  Sylvie Thiria,et al.  Automata networks and artificial intelligence , 1987 .

[48]  Yann LeCun,et al.  What is the best multi-stage architecture for object recognition? , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[49]  Julian Feinauer,et al.  Crack detection in lithium-ion cells using machine learning , 2017 .

[50]  M. Scheffler,et al.  Insightful classification of crystal structures using deep learning , 2017, Nature Communications.

[51]  Ah Chung Tsoi,et al.  Face recognition: a convolutional neural-network approach , 1997, IEEE Trans. Neural Networks.

[52]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[53]  Christopher M. Bishop,et al.  Neural networks for pattern recognition , 1995 .

[54]  J. Nathan Kutz,et al.  Data-Driven Modeling & Scientific Computation: Methods for Complex Systems & Big Data , 2013 .

[55]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.