Perspectives on the Impact of Machine Learning, Deep Learning, and Artificial Intelligence on Materials, Processes, and Structures Engineering

The fields of machining learning and artificial intelligence are rapidly expanding, impacting nearly every technological aspect of society. Many thousands of published manuscripts report advances over the last 5 years or less. Yet materials and structures engineering practitioners are slow to engage with these advancements. Perhaps the recent advances that are driving other technical fields are not sufficiently distinguished from long-known informatics methods for materials, thereby masking their likely impact to the materials, processes, and structures engineering (MPSE). Alternatively, the diverse nature and limited availability of relevant materials data pose obstacles to machine-learning implementation. The glimpse captured in this overview is intended to draw focus to selected distinguishing advances, and to show that there are opportunities for these new technologies to have transformational impacts on MPSE. Further, there are opportunities for the MPSE fields to contribute understanding to the emerging machine-learning tools from a physics basis. We suggest that there is an immediate need to expand the use of these new tools throughout MPSE, and to begin the transformation of engineering education that is necessary for ongoing adoption of the methods.

[1]  Kathleen Martin,et al.  The Learning Machines. , 1981 .

[2]  James H. Garrett,et al.  Knowledge-Based Modeling of Material Behavior with Neural Networks , 1992 .

[3]  Jamshid Ghaboussi,et al.  Active Control of Structures Using Neural Networks , 1995 .

[4]  Genki Yagawa,et al.  Quantitative nondestructive evaluation with ultrasonic method using neural networks and computational mechanics , 1995 .

[5]  Khaldoon A. Bani-Hani,et al.  NONLINEAR STRUCTURAL CONTROL USING NEURAL NETWORKS , 1998 .

[6]  Philippa A.S. Reed,et al.  An example of the use of neural computing techniques in materials science : the modelling of fatigue thresholds in Ni-base superalloys , 1999 .

[7]  George Z. Voyiadjis,et al.  SIMULATED MICROMECHANICAL MODELS USING ARTIFICIAL NEURAL NETWORKS , 2001 .

[8]  David J. C. MacKay,et al.  Information Theory, Inference, and Learning Algorithms , 2004, IEEE Transactions on Information Theory.

[9]  M. Glicksman,et al.  Property predictions using microstructural modeling , 2005 .

[10]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[11]  Andrew W. Smyth,et al.  New Approach to Designing Multilayer Feedforward Neural Network Architecture for Modeling Nonlinear Restoring Forces. I: Formulation , 2006 .

[12]  A. Elnashai,et al.  Self-learning simulation method for inverse nonlinear modeling of cyclic behavior of connections , 2008 .

[13]  Amr S. Elnashai,et al.  A new neural network‐based model for hysteretic behavior of materials , 2008 .

[14]  Emily A. Carter,et al.  Challenges in Modeling Materials Properties Without Experimental Input , 2008, Science.

[15]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[16]  Ken E. Whelan,et al.  The Automation of Science , 2009, Science.

[17]  Pierre Collet,et al.  Examination of genetic programming paradigm for high-throughput experimentation and heterogeneous catalysis , 2009 .

[18]  Bernhard A. Schrefler,et al.  Artificial Neural Networks in numerical modelling of composites , 2009 .

[19]  Maria Liakata,et al.  Towards Robot Scientists for autonomous scientific discovery , 2010, Automated experimentation.

[20]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[21]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[22]  Atef F. Saleeb,et al.  Improved SelfSim for Inverse Extraction of Nonuniform, Nonlinear, and Inelastic Material Behavior under Cyclic Loadings , 2012 .

[23]  Ronald F. Boisvert,et al.  Building the Materials Innovation Infrastructure: Data and Standards , 2012 .

[24]  Charles H. Ward Materials Genome Initiative for Global Competitiveness , 2012 .

[25]  David T. Fullwood,et al.  Microstructure Sensitive Design for Performance Optimization , 2012 .

[26]  Vasant Dhar,et al.  Data science and prediction , 2012, CACM.

[27]  Marco Buongiorno Nardelli,et al.  The high-throughput highway to computational materials design. , 2013, Nature materials.

[28]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[29]  S. Kalidindi,et al.  Novel microstructure quantification framework for databasing, visualization, and analysis of microstructure data , 2013, Integrating Materials and Manufacturing Innovation.

[30]  Daniel P. W. Ellis,et al.  Applying Machine Learning and Audio Analysis Techniques to Insect Recognition in Intelligent Traps , 2013, 2013 12th International Conference on Machine Learning and Applications.

[31]  Nicola Jones,et al.  Computer science: The learning machines , 2014, Nature.

[32]  Maureen Mellody,et al.  Big Data in Materials Research and Development: Summary of a Workshop , 2014 .

[33]  M. Terrones,et al.  Discovery of wall-selective carbon nanotube growth conditions via automated experimentation. , 2014, ACS nano.

[34]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[35]  Dimitri Gagliardi,et al.  Technological Forecasting & Social Change Material data matter — Standard data format for engineering materials , 2015 .

[36]  Elizabeth A. Holm,et al.  A computer vision approach for automated analysis and classification of microstructural image data , 2015 .

[37]  Alok Choudhary,et al.  A predictive machine learning approach for microstructure optimization and materials design , 2015, Scientific Reports.

[38]  Bryce Meredig,et al.  A recommendation engine for suggesting unexpected thermoelectric chemistries , 2015, 1502.07635.

[39]  N. S. Reddy,et al.  Design of medium carbon steels by computational intelligence techniques , 2015 .

[40]  Kenta Oono,et al.  Chainer : a Next-Generation Open Source Framework for Deep Learning , 2015 .

[41]  Krishna Rajan,et al.  Materials Informatics: The Materials ``Gene'' and Big Data , 2015 .

[42]  Paul J. McGinn,et al.  Combinatorial electrochemistry – Processing and characterization for materials discovery , 2015 .

[43]  Cormac Toher,et al.  Charting the complete elastic properties of inorganic crystalline compounds , 2015, Scientific Data.

[44]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[45]  Wei Chen,et al.  A Machine Learning-Based Design Representation Method for Designing Heterogeneous Microstructures , 2014, DAC 2014.

[46]  Michael I. Jordan,et al.  Machine learning: Trends, perspectives, and prospects , 2015, Science.

[47]  Abdolreza Joghataie,et al.  Modeling Hysteretic Deteriorating Behavior Using Generalized Prandtl Neural Network , 2015 .

[48]  A. Choudhary,et al.  Perspective: Materials informatics and big data: Realization of the “fourth paradigm” of science in materials science , 2016 .

[49]  James J. Harynuk,et al.  Classifying Crystal Structures of Binary Compounds AB through Cluster Resolution Feature Selection and Support Vector Machine Analysis , 2016 .

[50]  Julien Yvonnet,et al.  Multiscale modeling of microstructure–property relations , 2016 .

[51]  I. Foster,et al.  The Materials Data Facility: Data Services to Advance Materials Science Research , 2016, JOM.

[52]  Surya R. Kalidindi,et al.  Role of materials data science and informatics in accelerated materials innovation , 2016 .

[53]  Vladimir Shakirov,et al.  Review of state-of-the-arts in artificial intelligence with application to AI safety problem , 2016, ArXiv.

[54]  H. V. Jagadish,et al.  The Materials Commons: A Collaboration Platform and Information Repository for the Global Materials Community , 2016 .

[55]  Rahul Rao,et al.  Autonomy in materials research: a case study in carbon nanotube growth , 2016 .

[56]  Taylor D. Sparks,et al.  High-Throughput Machine-Learning-Driven Synthesis of Full-Heusler Compounds , 2016 .

[57]  Tal Hassner,et al.  Do We Really Need to Collect Millions of Faces for Effective Face Recognition? , 2016, ECCV.

[58]  F. Hild,et al.  Crystal plasticity parameter identification with 3D measurements and Integrated Digital Image Correlation , 2016 .

[59]  Kurt Kremer,et al.  Research Update: Computational materials discovery in soft matter , 2016 .

[60]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[61]  S. Ong,et al.  New opportunities for materials informatics: Resources and data mining techniques for uncovering hidden relationships , 2016 .

[62]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[63]  Marco Buongiorno Nardelli,et al.  AFLUX: The LUX materials search API for the AFLOW data repositories , 2016, 1612.05130.

[64]  Zane BICEVSKA,et al.  NoSQL-based Data Warehouse Solutions : Sense , Benefits and Prerequisites , 2016 .

[65]  Zhao Weigang,et al.  Prediction of fatigue stress concentration factor using extreme learning machine , 2016 .

[66]  James R. Fourman,et al.  Creating an integrated collaborative environment for materials research , 2016, Integrating Materials and Manufacturing Innovation.

[67]  David L. McDowell,et al.  The need for microstructure informatics in process–structure–property relations , 2016 .

[68]  Paul Raccuglia,et al.  Machine-learning-assisted materials discovery using failed experiments , 2016, Nature.

[69]  Alán Aspuru-Guzik,et al.  Neural Networks for the Prediction of Organic Chemistry Reactions , 2016, ACS central science.

[70]  Chiho Kim,et al.  From Organized High-Throughput Data to Phenomenological Theory using Machine Learning: The Example of Dielectric Breakdown , 2016 .

[71]  Bryce Meredig,et al.  Data mining our way to the next generation of thermoelectrics , 2016 .

[72]  Demis Hassabis,et al.  Mastering the game of Go with deep neural networks and tree search , 2016, Nature.

[73]  Taylor D. Sparks,et al.  Perspective: Web-based machine learning models for real-time screening of thermoelectric materials properties , 2016 .

[74]  Anubhav Jain,et al.  Research Update: The materials genome initiative: Data sharing and the impact of collaborative ab initio databases , 2016 .

[75]  Arun Mannodi-Kanakkithodi,et al.  Critical assessment of regression-based machine learning methods for polymer dielectrics , 2016 .

[76]  Ram Seshadri,et al.  Perspective: Interactive material property databases through aggregation of literature data , 2016 .

[77]  Sean Paradiso,et al.  Perspective: Materials informatics across the product lifecycle: Selection, manufacturing, and certification , 2016 .

[78]  Yuzuru Tanaka,et al.  Materials informatics: a journey towards material design and synthesis. , 2016, Dalton transactions.

[79]  Bülent Yener,et al.  Image driven machine learning methods for microstructure recognition , 2016 .

[80]  Olga Wodo,et al.  Microstructural informatics for accelerating the discovery of processing–microstructure–property relationships , 2016 .

[81]  Charles A. Bouman,et al.  A Supervised Learning Approach for Dynamic Sampling , 2016, Computational Imaging.

[82]  Euan A. Ashley,et al.  Deep Learning Automates the Quantitative Analysis of Individual Cells in Live-Cell Imaging Experiments , 2016, PLoS Comput. Biol..

[83]  Bryce Meredig,et al.  Materials Data Infrastructure: A Case Study of the Citrination Platform to Examine Data Import, Storage, and Access , 2016 .

[84]  Nicola Nosengo,et al.  Can artificial intelligence create the next wonder material? , 2016, Nature.

[85]  Yoshitaka Adachi,et al.  Microstructure Recognition by Deep Learning , 2016 .

[86]  Denis Fourches,et al.  Characterizing the Chemical Space of ERK2 Kinase Inhibitors Using Descriptors Computed from Molecular Dynamics Trajectories , 2017, J. Chem. Inf. Model..

[87]  Brian L. DeCost,et al.  Exploring the microstructure manifold: Image texture representations applied to ultrahigh carbon steel microstructures , 2017, 1702.01117.

[88]  Jakoah Brgoch,et al.  Disentangling Structural Confusion through Machine Learning: Structure Prediction and Polymorphism of Equiatomic Ternary Phases ABC. , 2017, Journal of the American Chemical Society.

[89]  Steven L. Brunton,et al.  Data-driven discovery of partial differential equations , 2016, Science Advances.

[90]  Yolanda T. Chong,et al.  Automated analysis of high‐content microscopy data with deep learning , 2017, Molecular systems biology.

[91]  Kevin Waugh,et al.  DeepStack: Expert-Level Artificial Intelligence in No-Limit Poker , 2017, ArXiv.

[92]  Andrew C. E. Reid,et al.  Learning crystal plasticity using digital image correlation: Examples from discrete dislocation dynamics , 2017, ArXiv.

[93]  Georg J. Schmitz,et al.  Proceedings of the 4th World Congress on Integrated Computational Materials Engineering (ICME 2017) , 2017 .

[94]  Chiho Kim,et al.  Machine learning in materials informatics: recent applications and prospects , 2017, npj Computational Materials.

[95]  Turab Lookman,et al.  Learning from data to design functional materials without inversion symmetry , 2017, Nature Communications.

[96]  Z. Chen,et al.  Active Slip System Identification in Polycrystalline Metals by Digital Image Correlation (DIC) , 2017 .

[97]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[98]  Brian David Johnson Brave New Road , 2017 .

[99]  Paul Voosen,et al.  The AI detectives. , 2017, Science.

[100]  Kan Li,et al.  Automatic insect recognition using optical flight dynamics modeled by kernel adaptive ARMA network , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[101]  Gun Jin Yun,et al.  Integration of Experiments and Simulations to Build Material Big-Data , 2017 .

[102]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[103]  Genki Yagawa,et al.  Computational mechanics enhanced by deep learning , 2017 .

[104]  Matthew Hutson,et al.  AI Glossary: Artificial intelligence, in so many words. , 2017, Science.

[105]  Esben Jannik Bjerrum,et al.  Molecular Generation with Recurrent Neural Networks (RNNs) , 2017, ArXiv.

[106]  Brian L. DeCost,et al.  UHCSDB: UltraHigh Carbon Steel Micrograph DataBase , 2017, Integrating Materials and Manufacturing Innovation.

[107]  Wei Chen,et al.  A framework for data-driven analysis of materials under uncertainty: Countering the curse of dimensionality , 2017 .

[108]  Klaus-Robert Müller,et al.  SchNet: A continuous-filter convolutional neural network for modeling quantum interactions , 2017, NIPS.

[109]  Been Kim,et al.  Towards A Rigorous Science of Interpretable Machine Learning , 2017, 1702.08608.

[110]  Gabor Csanyi,et al.  Achieving DFT accuracy with a machine-learning interatomic potential: thermomechanics and defects in bcc ferromagnetic iron , 2017, 1706.10229.

[111]  Mike Preuss,et al.  Learning to Plan Chemical Syntheses , 2017, ArXiv.

[112]  Tomas Pfister,et al.  Learning from Simulated and Unsupervised Images through Adversarial Training , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[113]  Bolei Zhou,et al.  Network Dissection: Quantifying Interpretability of Deep Visual Representations , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[114]  Samuel S. Schoenholz,et al.  Fast machine learning models of electronic and energetic properties consistently reach approximation errors better than DFT accuracy , 2017 .

[115]  Marc G. D. Geers,et al.  A review of predictive nonlinear theories for multiscale modeling of heterogeneous materials , 2017, J. Comput. Phys..

[116]  Elizabeth A. Holm,et al.  Characterizing powder materials using keypoint-based computer vision methods , 2017 .

[117]  Karen Willcox,et al.  Methodology for Path Planning with Dynamic Data-Driven Flight Capability Estimation , 2017 .

[118]  Elizabeth A. Holm,et al.  Computer Vision and Machine Learning for Autonomous Characterization of AM Powder Feedstocks , 2016, JOM.

[119]  Michael R. Hush,et al.  Machine learning for quantum physics , 2017, Science.

[120]  Mostapha Benhenda,et al.  ChemGAN challenge for drug discovery: can AI reproduce natural chemical diversity? , 2017, ArXiv.

[121]  Marc De Graef,et al.  Dictionary Indexing of Electron Channeling Patterns , 2017, Microscopy and Microanalysis.

[122]  Alberto Tonda,et al.  Data driven modeling of plastic deformation , 2017 .

[123]  Yuxi Li,et al.  Deep Reinforcement Learning: An Overview , 2017, ArXiv.

[124]  Kevin Waugh,et al.  DeepStack: Expert-level artificial intelligence in heads-up no-limit poker , 2017, Science.

[125]  A Method for Separating Crystallograpically Similar Phases in Steels using EBSD and Machine Learning , 2017, Microscopy and Microanalysis.

[126]  Francisco Chinesta,et al.  Model order reduction for real-time data assimilation through Extended Kalman Filters , 2017 .

[127]  Demis Hassabis,et al.  Mastering the game of Go without human knowledge , 2017, Nature.

[128]  Julia Ling,et al.  High-Dimensional Materials and Process Optimization Using Data-Driven Experimental Design with Well-Calibrated Uncertainty Estimates , 2017, Integrating Materials and Manufacturing Innovation.

[129]  Bryce Meredig,et al.  Robust FCC solute diffusion predictions from ab-initio machine learning methods , 2017, 1705.08798.

[130]  Abhinav Vishnu,et al.  Deep learning for computational chemistry , 2017, J. Comput. Chem..

[131]  Peter Henderson,et al.  Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control , 2017, ArXiv.

[132]  David B. Brough,et al.  Materials Knowledge Systems in Python—a Data Science Framework for Accelerated Development of Hierarchical Materials , 2017, Integrating Materials and Manufacturing Innovation.

[133]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[134]  Matthias Troyer,et al.  Solving the quantum many-body problem with artificial neural networks , 2016, Science.

[135]  Ahmed H. Elsheikh,et al.  DR-RNN: A deep residual recurrent neural network for model reduction , 2017, ArXiv.

[136]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[137]  Quoc V. Le,et al.  Large-Scale Evolution of Image Classifiers , 2017, ICML.

[138]  Alexie M. Kolpak,et al.  Discovering charge density functionals and structure-property relationships with PROPhet: A general framework for coupling machine learning and first-principles methods , 2017, Scientific Reports.

[139]  Wojciech Matusik,et al.  Crowd-Guided Ensembles: How Can We Choreograph Crowd Workers for Video Segmentation? , 2018, CHI.

[140]  Anton O Oliynyk,et al.  Discovery of Intermetallic Compounds from Traditional to Machine-Learning Approaches. , 2018, Accounts of chemical research.

[141]  Shih-Fu Chang,et al.  Exploiting Feature and Class Relationships in Video Categorization with Regularized Deep Neural Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[142]  Thierry Kogej,et al.  Generating Focused Molecule Libraries for Drug Discovery with Recurrent Neural Networks , 2017, ACS central science.

[143]  Jakoah Brgoch,et al.  Predicting the Band Gaps of Inorganic Solids by Machine Learning. , 2018, The journal of physical chemistry letters.

[144]  Philip Bachman,et al.  Deep Reinforcement Learning that Matters , 2017, AAAI.

[145]  Sriram Subramanian,et al.  Interpretability and Reproducability in Production Machine Learning Applications , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[146]  Elizabeth A. Holm,et al.  A Comparative Study of Feature Selection Methods for Stress Hotspot Classification in Materials , 2018, Integrating Materials and Manufacturing Innovation.

[147]  Charles A. Bouman,et al.  A Framework for Dynamic Image Sampling Based on Supervised Learning , 2017, IEEE Transactions on Computational Imaging.

[148]  Kevin M. Ryan,et al.  Crystal Structure Prediction via Deep Learning. , 2018, Journal of the American Chemical Society.

[149]  Daniel Gillblad,et al.  Learning Machines , 2020, AAAI Spring Symposia.

[150]  Rajkumar Kannan,et al.  Capitalizing The Collective Knowledge for Video Annotation Refinement using Dynamic Weighted Voting , 2018 .

[151]  Mostapha Benhenda Can AI reproduce observed chemical diversity? , 2018, bioRxiv.

[152]  John Salvatier,et al.  When Will AI Exceed Human Performance? Evidence from AI Experts , 2017, ArXiv.

[153]  Joelle Pineau,et al.  RE-EVALUATE: Reproducibility in Evaluating Reinforcement Learning Algorithms , 2018 .

[154]  S. Curtarolo,et al.  Autonomous data-driven design of inorganic materials with AFLOW. , 2018, 1803.05035.

[155]  A. J. Morris,et al.  Searching for Missing Binary Equiatomic Phases: Complex Crystal Chemistry in the Hf-In System. , 2018, Inorganic chemistry.

[156]  Alok N. Choudhary,et al.  Prediction of seebeck coefficient for compounds without restriction to fixed stoichiometry: A machine learning approach , 2018, J. Comput. Chem..

[157]  Yan Zhang,et al.  SLADS-Net: Supervised Learning Approach for Dynamic Sampling using Deep Neural Networks , 2018, Computational Imaging.

[158]  Mianxiong Dong,et al.  Humanlike Driving: Empirical Decision-Making System for Autonomous Vehicles , 2018, IEEE Transactions on Vehicular Technology.

[159]  Xuan Liu,et al.  Vision 2040: A Roadmap for Integrated, Multiscale Modeling and Simulation of Materials and Systems , 2018 .

[160]  Jake Graser,et al.  Machine Learning and Energy Minimization Approaches for Crystal Structure Predictions: A Review and New Horizons , 2018 .

[161]  Eneko Agirre,et al.  Unsupervised Neural Machine Translation , 2017, ICLR.

[162]  Vijay Vasudevan,et al.  Learning Transferable Architectures for Scalable Image Recognition , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[163]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[164]  Zachary Chase Lipton The mythos of model interpretability , 2016, ACM Queue.

[165]  Steven K. Kauwe,et al.  Machine Learning Prediction of Heat Capacity for Solid Inorganics , 2018, Integrating Materials and Manufacturing Innovation.

[166]  Guillaume Lample,et al.  Unsupervised Machine Translation Using Monolingual Corpora Only , 2017, ICLR.

[167]  Sriram Subramanian,et al.  A Systems Perspective to Reproducibility in Production Machine Learning Domain , 2018 .

[168]  Noam Brown,et al.  Superhuman AI for heads-up no-limit poker: Libratus beats top professionals , 2018, Science.

[169]  Mike Preuss,et al.  Planning chemical syntheses with deep neural networks and symbolic AI , 2017, Nature.

[170]  Elizabeth A. Holm,et al.  High Throughput Quantitative Metallography for Complex Microstructures Using Deep Learning: A Case Study in Ultrahigh Carbon Steel , 2018, Microscopy and Microanalysis.

[171]  Louis-Philippe Morency,et al.  Multimodal Machine Learning: A Survey and Taxonomy , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.