Computational Screening of New Perovskite Materials Using Transfer Learning and Deep Learning

As one of the most studied materials, perovskites exhibit a wealth of superior properties that lead to diverse applications. Computational prediction of novel stable perovskite structures has big potential in the discovery of new materials for solar panels, superconductors, thermal electric, and catalytic materials, etc. By addressing one of the key obstacles of machine learning based materials discovery, the lack of sufficient training data, this paper proposes a transfer learning based approach that exploits the high accuracy of the machine learning model trained with physics-informed structural and elemental descriptors. This gradient boosting regressor model (the transfer learning model) allows us to predict the formation energy with sufficient precision of a large number of materials of which only the structural information is available. The enlarged training set is then used to train a convolutional neural network model (the screening model) with the generic Magpie elemental features with high prediction power. Extensive experiments demonstrate the superior performance of our transfer learning model and screening model compared to the baseline models. We then applied the screening model to filter out promising new perovskite materials out of 21,316 hypothetical perovskite structures with a large portion of them confirmed by existing literature.

[1]  Anubhav Jain,et al.  Python Materials Genomics (pymatgen): A robust, open-source python library for materials analysis , 2012 .

[2]  M. Kovalenko,et al.  Temperature Dependence of the Amplified Spontaneous Emission from CsPbBr3 Nanocrystal Thin Films , 2018 .

[3]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[4]  Yousef Saad,et al.  Data mining for materials: Computational experiments with AB compounds , 2012 .

[5]  J. Goodenough,et al.  A Perovskite Oxide Optimized for Oxygen Evolution Catalysis from Molecular Orbital Principles , 2011, Science.

[6]  Jacob L. Jones,et al.  Advances in Lead-Free Piezoelectric Materials for Sensors and Actuators , 2010, Sensors.

[7]  Andrew L. Ferguson,et al.  Machine learning and data science in soft materials engineering , 2018, Journal of physics. Condensed matter : an Institute of Physics journal.

[8]  Dong Uk Lee,et al.  Iodide management in formamidinium-lead-halide–based perovskite layers for efficient solar cells , 2017, Science.

[9]  Ashley R. Marshall,et al.  Quantum dot–induced phase stabilization of α-CsPbI3 perovskite for high-efficiency photovoltaics , 2016, Science.

[10]  M. Hervieu,et al.  Perovskite manganites and layered cobaltites: potential materials for thermoelectric applications , 2002 .

[11]  Tsutomu Miyasaka,et al.  Organometal halide perovskites as visible-light sensitizers for photovoltaic cells. , 2009, Journal of the American Chemical Society.

[12]  M. Hervieu,et al.  Microstructural and physical properties of layered manganites oxides related to the magnetoresistive perovskites , 1996 .

[13]  Rob Fergus,et al.  Stochastic Pooling for Regularization of Deep Convolutional Neural Networks , 2013, ICLR.

[14]  N. Park,et al.  Lead Iodide Perovskite Sensitized All-Solid-State Submicron Thin Film Mesoscopic Solar Cell with Efficiency Exceeding 9% , 2012, Scientific Reports.

[15]  Abhishek Swarnkar,et al.  Colloidal CsPbBr3 Perovskite Nanocrystals: Luminescence beyond Traditional Quantum Dots. , 2015, Angewandte Chemie.

[16]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[17]  C. Segre,et al.  Structure of the single‐phase high‐temperature superconductor YBa2Cu3O7−δ , 1987 .

[18]  Jiagang Wu Advances in Lead-Free Piezoelectric Materials , 2018 .

[19]  Zhengqi Shi,et al.  Perovskites-Based Solar Cells: A Review of Recent Progress, Materials and Processing Methods , 2018, Materials.

[20]  Ekin D Cubuk,et al.  Screening billions of candidates for solid lithium-ion conductors: A transfer learning approach for small data. , 2019, The Journal of chemical physics.

[21]  J. Vybíral,et al.  Big data of materials science: critical role of the descriptor. , 2014, Physical review letters.

[22]  Ceramic Nanocrystalline Superconductor Gadolinium Barium Copper Oxide (GdBaCuO) at Different Treating Temperatures , 2014 .

[23]  Alán Aspuru-Guzik,et al.  Use machine learning to find energy materials  , 2017, Nature.

[24]  YunKyong Hyon,et al.  Identifying Pb-free perovskites for solar cells by machine learning , 2019, npj Computational Materials.

[25]  Kyle Chard,et al.  Matminer: An open source toolkit for materials data mining , 2018, Computational Materials Science.

[26]  S. Mhaisalkar,et al.  Perovskite Materials for Light‐Emitting Diodes and Lasers , 2016, Advanced materials.

[27]  Jia Zhu,et al.  Monolithic all-perovskite tandem solar cells with 24.8% efficiency exploiting comproportionation to suppress Sn(ii) oxidation in precursor ink , 2019, Nature Energy.

[28]  Christopher J. Bartel,et al.  New tolerance factor to predict the stability of perovskite oxides and halides , 2018, Science Advances.

[29]  Atsuto Seko,et al.  Prediction of Low-Thermal-Conductivity Compounds with First-Principles Anharmonic Lattice-Dynamics Calculations and Bayesian Optimization. , 2015, Physical review letters.

[30]  Miguel A. L. Marques,et al.  Predicting the Thermodynamic Stability of Solids Combining Density Functional Theory and Machine Learning , 2017 .

[31]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[32]  H. Han,et al.  The size effect of TiO2 nanoparticles on a printable mesoscopic perovskite solar cell , 2015 .

[33]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[34]  Krishna Rajan,et al.  Materials Informatics: The Materials ``Gene'' and Big Data , 2015 .

[35]  Wei-keng Liao,et al.  ElemNet: Deep Learning the Chemistry of Materials From Only Elemental Composition , 2018, Scientific Reports.

[36]  Chris Wolverton,et al.  High-throughput DFT calculations of formation energy, stability and oxygen vacancy formation energy of ABO3 perovskites , 2017, Scientific Data.

[37]  C. H. Park,et al.  First-Principles Study of the Structural and the Electronic Properties of the Lead-Halide-Based Inorganic-Organic perovskites (CH3NH3)PbX3 and CsPbX3 (X = Cl, Br, I) , 2004 .

[38]  Z. Ali,et al.  First-Principles Study of Perovskite Molybdates AMoO3 (A = Ca, Sr, Ba) , 2019, Journal of Electronic Materials.

[39]  S. D. Kim,et al.  Preparation and characterization of Ag/MnOx/perovskite catalysts for CO oxidation , 1997 .

[40]  Oleksandr Voznyy,et al.  Perovskite energy funnels for efficient light-emitting diodes. , 2016, Nature nanotechnology.

[41]  Alok Choudhary,et al.  A General-Purpose Machine Learning Framework for Predicting Properties of Inorganic Materials , 2016 .

[42]  Stefano Curtarolo,et al.  Data-Mining-Driven Quantum Mechanics for the Prediction of Structure , 2006 .

[43]  Richard H. Friend,et al.  Overcoming the electroluminescence efficiency limitations of perovskite light-emitting diodes , 2015, Science.

[44]  Shyue Ping Ong,et al.  Deep neural networks for accurate predictions of crystal stability , 2017, Nature Communications.

[45]  Min Gyu Kim,et al.  Colloidally prepared La-doped BaSnO3 electrodes for efficient, photostable perovskite solar cells , 2017, Science.

[46]  Arun Mannodi-Kanakkithodi,et al.  Mining materials design rules from data: The example of polymer dielectrics , 2017 .

[47]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.