Prediction and optimization of epoxy adhesive strength from a small dataset through active learning

ABSTRACT Machine learning is emerging as a powerful tool for the discovery of novel high-performance functional materials. However, experimental datasets in the polymer-science field are typically limited and they are expensive to build. Their size (< 100 samples) limits the development of chemical intuition from experimentalists, as it constrains the use of machine-learning algorithms for extracting relevant information. We tackle this issue to predict and optimize adhesive materials by combining laboratory experimental design, an active learning pipeline and Bayesian optimization. We start from an initial dataset of 32 adhesive samples that were prepared from various molecular-weight bisphenol A-based epoxy resins and polyetheramine curing agents, mixing ratios and curing temperatures, and our data-driven method allows us to propose an optimal preparation of an adhesive material with a very high adhesive joint strength measured at 35.8 ± 1.1 MPa after three active learning cycles (five proposed preparations per cycle). A Gradient boosting machine learning model was used for the successive prediction of the adhesive joint strength in the active learning pipeline, and the model achieved a respectable accuracy with a coefficient of determination, root mean square error and mean absolute error of 0.85, 4.0 MPa and 3.0 MPa, respectively. This study demonstrates the important impact of active learning to accelerate the design and development of tailored highly functional materials from very small datasets. Graphical abstract

[1]  Bin Yu,et al.  Boosting with early stopping: Convergence and consistency , 2005, math/0508276.

[2]  Luqi Liu,et al.  Rubbery and glassy epoxy resins reinforced with carbon nanotubes , 2005 .

[3]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[4]  Daniel M. Packwood Theory of Bayesian Optimization , 2017 .

[5]  Silvia G. Prolongo,et al.  Comparative study on the adhesive properties of different epoxy resins , 2006 .

[6]  Ling Liu,et al.  Encyclopedia of Database Systems , 2009, Encyclopedia of Database Systems.

[7]  Sang-Bo Han,et al.  Properties of interfacial adhesion for vibration controllability of composite materials as smart structures , 2000 .

[8]  Luis Puigjaner,et al.  Dealing with Uncertainty in Polymer Manufacturing by Using Linear Regression Metrics and Sensitivity Analysis , 2009 .

[9]  Fredrik Olsson,et al.  A literature survey of active machine learning in the context of natural language processing , 2009 .

[10]  A. Kinloch Adhesion and Adhesives: Science and Technology , 2010 .

[11]  T. Lookman,et al.  Accelerated Discovery of Large Electrostrains in BaTiO3‐Based Piezoelectrics Using Active Learning , 2018, Advanced materials.

[12]  Christopher Wolverton,et al.  Accelerated discovery of metallic glasses through iteration of machine learning and high-throughput experiments , 2018, Science Advances.

[13]  Effect of Curing Temperature and Curing Degree on Elastic Recovery of Conductive Particles , 2015 .

[14]  Sanguthevar Rajasekaran,et al.  Accelerating materials property predictions using machine learning , 2013, Scientific Reports.

[15]  William G. Cochran,et al.  Experimental Designs, 2nd Edition , 1950 .

[16]  J. W. Sinclair Effects of Cure Temperature on Epoxy Resin Properties , 1992 .

[17]  Gintaras V. Reklaitis,et al.  Managing financial risk in the coordination of supply chain and product development decisions , 2009 .

[18]  Turab Lookman,et al.  Experimental search for high-temperature ferroelectric perovskites guided by two-step machine learning , 2018, Nature Communications.

[19]  J. P. Morgan,et al.  Design and Analysis: A Researcher's Handbook , 2005, Technometrics.

[20]  The Effect of Epoxy Network Structure on Toughenability , 2012 .

[21]  Lee Luong,et al.  Toughening polymer adhesives using nanosized elastomeric particles , 2014 .

[22]  Yumei Zhou,et al.  Accelerated Search for BaTiO3‐Based Ceramics with Large Energy Storage at Low Fields Using Machine Learning and Experimental Design , 2019, Advanced science.

[23]  安藤 寛,et al.  Cross-Validation , 1952, Encyclopedia of Machine Learning and Data Mining.

[24]  Xinwei Deng,et al.  Experimental design , 2012, WIREs Data Mining Knowl. Discov..

[25]  Anand Chandrasekaran,et al.  Impact of dataset uncertainties on machine learning model predictions: the example of polymer glass transition temperatures , 2019, Modelling and Simulation in Materials Science and Engineering.

[26]  James Theiler,et al.  Accelerated search for materials with targeted properties by adaptive design , 2016, Nature Communications.

[27]  Daniel W. Davies,et al.  Machine learning for molecular and materials science , 2018, Nature.

[28]  Daniel M. Packwood,et al.  Bayesian Optimization for Materials Science , 2017 .

[29]  Z. Wu,et al.  Effects of epoxy/hardener stoichiometry on structures and properties of a diethanolamine-cured epoxy encapsulant , 2016 .

[30]  B. E. Cooper CHAPTER 10 - Experimental Design , 2013 .

[31]  Matiur Rahman Minar,et al.  Recent Advances in Deep Learning: An Overview , 2018, ArXiv.

[32]  K. Jansen,et al.  Effect of chain flexibility in the network structure on the viscoelasticity of epoxy thermosets , 2011 .

[33]  H. Yokoyama,et al.  Homogeneously Dispersed Polyrotaxane in Epoxy Adhesive and Its Improvement in the Fracture Toughness , 2019, Macromolecules.

[34]  E.A.S. Marques,et al.  Design Rules and Methods to Improve Joint Strength , 2017 .

[35]  A. Vaughan,et al.  Effect of resin/hardener stoichiometry on electrical behavior of epoxy networks , 2017, IEEE Transactions on Dielectrics and Electrical Insulation.