On-the-fly closed-loop materials discovery via Bayesian active learning

Active learning—the field of machine learning (ML) dedicated to optimal experiment design—has played a part in science as far back as the 18th century when Laplace used it to guide his discovery of celestial mechanics. In this work, we focus a closed-loop, active learning-driven autonomous system on another major challenge, the discovery of advanced materials against the exceedingly complex synthesis-processes-structure-property landscape. We demonstrate an autonomous materials discovery methodology for functional inorganic compounds which allow scientists to fail smarter, learn faster, and spend less resources in their studies, while simultaneously improving trust in scientific results and machine learning tools. This robot science enables science-over-the-network, reducing the economic impact of scientists being physically separated from their labs. The real-time closed-loop, autonomous system for materials exploration and optimization (CAMEO) is implemented at the synchrotron beamline to accelerate the interconnected tasks of phase mapping and property optimization, with each cycle taking seconds to minutes. We also demonstrate an embodiment of human-machine interaction, where human-in-the-loop is called to play a contributing role within each cycle. This work has resulted in the discovery of a novel epitaxial nanocomposite phase-change memory material.

[1]  J. C. R. Licklider,et al.  Man-Computer Symbiosis , 1960 .

[2]  P. L. Dobruschin The Description of a Random Field by Means of Conditional Probabilities and Conditions of Its Regularity , 1968 .

[3]  E. T. Jaynes,et al.  BAYESIAN METHODS: GENERAL BACKGROUND ? An Introductory Tutorial , 1986 .

[4]  Zoubin Ghahramani,et al.  Combining active learning and semi-supervised learning using Gaussian fields and harmonic functions , 2003, ICML 2003.

[5]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[6]  M. Wuttig,et al.  Phase-change materials for rewriteable data storage. , 2007, Nature materials.

[7]  Safa Kasap,et al.  Springer Handbook of Electronic and Photonic Materials , 2007 .

[8]  I. Takeuchi,et al.  Rapid structural mapping of ternary metallic alloy systems using the combinatorial approach and cluster analysis. , 2007, The Review of scientific instruments.

[9]  Matthias Wuttig,et al.  Resonant bonding in crystalline phase-change materials. , 2008, Nature materials.

[10]  M. Salinga,et al.  A map for phase-change materials. , 2008, Nature materials.

[11]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[12]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[13]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[14]  P Fons,et al.  Interfacial phase-change memory. , 2011, Nature nanotechnology.

[15]  Marco Buongiorno Nardelli,et al.  AFLOWLIB.ORG: A distributed materials properties repository from high-throughput ab initio calculations , 2012 .

[16]  S. Kakade,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2012, IEEE Transactions on Information Theory.

[17]  Charles H. Ward Materials Genome Initiative for Global Competitiveness , 2012 .

[18]  M. Gearing,et al.  Correction: Corrigendum: Tonic inhibition in dentate gyrus impairs long-term potentiation and memory in an Alzheimer’s disease model , 2014, Nature Communications.

[19]  Songlin Feng,et al.  One order of magnitude faster phase change at reduced power in Ti-Sb-Te , 2014, Nature Communications.

[20]  Richard Dronskowski,et al.  Bonding nature of local structural motifs in amorphous GeTe. , 2014, Angewandte Chemie.

[21]  Manh Cuong Nguyen,et al.  On-the-fly machine-learning for high-throughput experiments: search for rare-earth-free permanent magnets , 2014, Scientific Reports.

[22]  I Takeuchi,et al.  High-throughput determination of structural phase diagram and constituent phases using GRENDEL , 2015, Nanotechnology.

[23]  Rahul Rao,et al.  Autonomy in materials research: a case study in carbon nanotube growth , 2016 .

[24]  John M. Gregoire,et al.  Perspective: Composition–structure–property mapping in high-throughput experiments: Turning data into knowledge , 2016 .

[25]  James Theiler,et al.  Accelerated search for materials with targeted properties by adaptive design , 2016, Nature Communications.

[26]  Alexander Hexemer,et al.  On-the-Fly Data Assessment for High-Throughput X-ray Diffraction Measurements. , 2017, ACS combinatorial science.

[27]  Pritish Narayanan,et al.  Neuromorphic computing using non-volatile memory , 2017 .

[28]  Wei Zhang,et al.  Reducing the stochasticity of crystal nucleation to enable subnanosecond memory writing , 2017, Science.

[29]  Thomas Taubner,et al.  Phase-change materials for non-volatile photonic applications , 2017, Nature Photonics.

[30]  C. David Wright,et al.  Fast and reliable storage using a 5  bit, nonvolatile photonic memory cell , 2018, Optica.

[31]  Ian Foster,et al.  Can machine learning identify the next high-temperature superconductor? Examining extrapolation performance for materials discovery , 2018 .

[32]  Alán Aspuru-Guzik,et al.  ChemOS: Orchestrating autonomous experimentation , 2018, Science Robotics.

[33]  Alán Aspuru-Guzik,et al.  Accelerating the discovery of materials for clean energy in the era of smart automation , 2018, Nature Reviews Materials.

[34]  A. Sebastian,et al.  8-bit Precision In-Memory Multiplication with Projected Phase-Change Memory , 2018, 2018 IEEE International Electron Devices Meeting (IEDM).

[35]  T. Lookman,et al.  Accelerated Discovery of Large Electrostrains in BaTiO3‐Based Piezoelectrics Using Active Learning , 2018, Advanced materials.

[36]  Turab Lookman,et al.  Experimental search for high-temperature ferroelectric perovskites guided by two-step machine learning , 2018, Nature Communications.

[37]  Aldenor G. Santos,et al.  Occurrence of the potent mutagens 2- nitrobenzanthrone and 3-nitrobenzanthrone in fine airborne particles , 2019, Scientific Reports.

[38]  Benji Maruyama,et al.  The machine learning revolution in materials? , 2019, MRS Bulletin.

[39]  Li Li,et al.  Optimization of Molecules via Deep Reinforcement Learning , 2018, Scientific Reports.

[40]  Wei Zhang,et al.  Phase-change heterostructure enables ultralow noise and drift for memory operation , 2019, Science.

[41]  Junzhi Wang,et al.  Responsive Cells for rhEGF bioassay Obtained through Screening of a CRISPR/Cas9 Library , 2019, Scientific Reports.

[42]  S. Curtarolo,et al.  Unavoidable disorder and entropy in multi-component systems , 2019, npj Computational Materials.

[43]  J. Gregoire,et al.  Progress and prospects for accelerating materials science with automated and autonomous workflows , 2019, Chemical science.

[44]  Sorelle A. Friedler,et al.  Experiment Specification, Capture and Laboratory Automation Technology (ESCALATE): a software pipeline for automated chemical experimentation and data management , 2019, MRS Communications.

[45]  Ruipeng Li,et al.  A Kriging-Based Approach to Autonomous Experimentation with Applications to X-Ray Scattering , 2019, Scientific Reports.

[46]  Klavs F. Jensen,et al.  Autonomous discovery in the chemical sciences part I: Progress , 2020, Angewandte Chemie.

[47]  M. Wuttig,et al.  Phase-change materials: Empowered by an unconventional bonding mechanism , 2019, MRS Bulletin.

[48]  Reiner Sebastian Sprick,et al.  A mobile robotic chemist , 2020, Nature.

[49]  James R. W. Ulcickas,et al.  Chapter 18:Autonomous Science: Big Data Tools for Small Data Problems in Chemistry , 2020 .

[50]  Zachary W. Ulissi,et al.  Accelerated discovery of CO2 electrocatalysts using active machine learning , 2020, Nature.

[51]  Ian M. Pendleton,et al.  Robot-Accelerated Perovskite Investigation and Discovery , 2020, Chemistry of Materials.

[52]  Kirthevasan Kandasamy,et al.  ChemBO: Bayesian Optimization of Small Organic Molecules with Synthesizable Recommendations , 2019, AISTATS.

[53]  Stefano Ermon,et al.  Closed-loop optimization of fast-charging protocols for batteries with machine learning , 2020, Nature.

[54]  Alán Aspuru-Guzik,et al.  Beyond Ternary OPV: High‐Throughput Experimentation and Self‐Driving Laboratories Optimize Multicomponent Systems , 2019, Advanced materials.

[55]  Ben Shneiderman,et al.  Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy , 2020, Int. J. Hum. Comput. Interact..

[56]  Olle Eriksson,et al.  High-throughput search for rare-earth free permanent magnets , 2020 .

[57]  A. Aspuru-Guzik,et al.  Self-driving laboratory for accelerated discovery of thin-film materials , 2019, Science Advances.