Machine learning materials physics: Surrogate optimization and multi-fidelity algorithms predict precipitate morphology in an alternative to phase field dynamics

Abstract Machine learning has been effective at detecting patterns and predicting the response of systems that behave free of natural laws. Examples include learning crowd dynamics, recommender systems and autonomous mobility. There also have been applications to the search for new materials that draw upon big-data classification problems. However, when it comes to physical systems governed by conservation laws, the role of machine learning has been more limited. Here, we present our recent work in exploring the role of machine learning methods in discovering, or aiding, the search for physics. Specifically, we focus on using machine learning algorithms to represent high-dimensional free energy surfaces with the goal of identifying precipitate morphologies in alloy systems . Traditionally, this problem has been approached by combining phase field models, which impose first-order dynamics, with elasticity , to traverse a free energy landscape in search of minima. Equilibrium precipitate morphologies occur at these minima. Here, we exploit the machine learning methods to represent high-dimensional data , combined with surrogate optimization, sensitivity analysis and multifidelity modeling as an alternate framework to explore phenomena controlled by energy extremization . This combination of data-driven methods offers an alternative to the imposition of first-order dynamics via phase field methods, and represents one aspect of applying machine learning to materials physics.

[1]  Alok Choudhary,et al.  Combinatorial screening for new materials in unconstrained composition space with machine learning , 2014 .

[2]  K. Willcox,et al.  Constrained multifidelity optimization using model calibration , 2012, Structural and Multidisciplinary Optimization.

[3]  J. Cahn,et al.  A microscopic theory for antiphase boundary motion and its application to antiphase domain coasening , 1979 .

[4]  Lin-wang Wang,et al.  Prediction of alloy precipitate shapes from first principles , 2001 .

[5]  I. Sobol On the distribution of points in a cube and the approximate evaluation of integrals , 1967 .

[6]  Sanguthevar Rajasekaran,et al.  Accelerating materials property predictions using machine learning , 2013, Scientific Reports.

[7]  W. Ding,et al.  A simulation study of the distribution of β′ precipitates in a crept Mg-Gd-Zr alloy , 2017 .

[8]  Gerbrand Ceder,et al.  Predicting crystal structure by merging data mining with quantum mechanics , 2006, Nature materials.

[9]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[10]  Paul Bratley,et al.  Algorithm 659: Implementing Sobol's quasirandom sequence generator , 1988, TOMS.

[11]  Brian Puchala,et al.  On the early stages of precipitation in dilute Mg–Nd alloys , 2016 .

[12]  Paola Annoni,et al.  Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index , 2010, Comput. Phys. Commun..

[13]  Yunzhi Wang,et al.  A simulation study of the shape of β′ precipitates in Mg–Y and Mg–Gd alloys , 2013 .

[14]  Alexander I. J. Forrester,et al.  Multi-fidelity optimization via surrogate modelling , 2007, Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[15]  Anubhav Jain,et al.  Finding Nature’s Missing Ternary Oxide Compounds Using Machine Learning and Density Functional Theory , 2010 .

[16]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..

[17]  Christopher M Wolverton,et al.  Predicting β′ precipitate morphology and evolution in Mg–RE alloys using a combination of first-principles calculations and phase-field modeling , 2014 .

[18]  Shenyang Y. Hu,et al.  A phase-field model for evolving microstructures with strong elastic inhomogeneity , 2001 .

[19]  Paul Raccuglia,et al.  Machine-learning-assisted materials discovery using failed experiments , 2016, Nature.

[20]  John Lowengrub,et al.  Microstructural Evolution in Inhomogeneous Elastic Media , 1997 .

[21]  Ky Khac Vu,et al.  Surrogate-based methods for black-box optimization , 2017, Int. Trans. Oper. Res..

[22]  Peter W Voorhees,et al.  Equilibrium particle morphologies in elastically stressed coherent solids , 1999 .

[23]  Johannes Hötzer,et al.  Analytics for microstructure datasets produced by phase-field simulations , 2016 .

[24]  C. Wolverton,et al.  Multiscale modeling of precipitate microstructure evolution. , 2002, Physical review letters.

[25]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[26]  Andy J. Keane,et al.  A Knowledge-Based Approach To Response Surface Modelling in Multifidelity Optimization , 2003, J. Glob. Optim..

[27]  I. Sobol Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[28]  Toshio Suzuki,et al.  Phase-field model for binary alloys. , 1999, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[29]  Yunzhi Wang,et al.  Simulation study of precipitation in an Mg–Y–Nd alloy , 2012 .

[30]  Christopher M Wolverton,et al.  Multiscale modeling of θ′ precipitation in Al–Cu binary alloys , 2004 .

[31]  Anton Van der Ven,et al.  A unified description of ordering in HCP Mg-RE alloys , 2017 .

[32]  Nancy Wilkins-Diehr,et al.  XSEDE: Accelerating Scientific Discovery , 2014, Computing in Science & Engineering.

[33]  Alberto Tonda,et al.  Data driven modeling of plastic deformation , 2017 .

[34]  Anton Van der Ven,et al.  First-principles investigation of phase stability in the Mg-Sc binary alloy , 2017 .

[35]  Peter W Voorhees,et al.  The dynamics of precipitate evolution in elastically stressed solids—I. Inverse coarsening , 1996 .

[36]  I. Sobola,et al.  Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates , 2001 .

[37]  Wei Chen,et al.  A framework for data-driven analysis of materials under uncertainty: Countering the curse of dimensionality , 2017 .

[38]  J. E. Hilliard,et al.  Free Energy of a Nonuniform System. I. Interfacial Free Energy , 1958 .

[39]  Jun Ni,et al.  A hybrid multi-fidelity approach to the optimal design of warm forming processes using a knowledge-based artificial neural network , 2007 .

[40]  Surya R. Kalidindi,et al.  A data-driven approach to establishing microstructure–property relationships in porous transport layers of polymer electrolyte fuel cells , 2014 .

[41]  Perry H Leo,et al.  A diffuse interface model for microstructural evolution in elastically stressed solids , 1998 .

[42]  George Em Karniadakis,et al.  Multi-fidelity optimization of super-cavitating hydrofoils , 2018 .

[43]  Zi-kui Liu,et al.  Linking phase-field model to CALPHAD: application to precipitate shape evolution in Ni-base alloys , 2002 .

[44]  David Wells,et al.  The deal.II Library, Version 8.4 , 2016, J. Num. Math..

[45]  Changrong Li,et al.  A thermodynamic description of the Gd–Mg–Y system , 2007 .