Identification of crystal symmetry from noisy diffraction patterns by a shape analysis and deep learning

The robust and automated determination of crystal symmetry is of utmost importance in material characterization and analysis. Recent studies have shown that deep learning (DL) methods can effectively reveal the correlations between X-ray or electron-beam diffraction patterns and crystal symmetry. Despite their promise, most of these studies have been limited to identifying relatively few classes into which a target material may be grouped. On the other hand, the DL-based identification of crystal symmetry suffers from a drastic drop in accuracy for problems involving classification into tens or hundreds of symmetry classes (e.g., up to 230 space groups), severely limiting its practical usage. Here, we demonstrate that a combined approach of shaping diffraction patterns and implementing them in a multistream DenseNet (MSDN) substantially improves the accuracy of classification. Even with an imbalanced dataset of 108,658 individual crystals sampled from 72 space groups, our model achieves 80.12 ± 0.09% space group classification accuracy, outperforming conventional benchmark models by 17–27 percentage points (%p). The enhancement can be largely attributed to the pattern shaping strategy, through which the subtle changes in patterns between symmetrically close crystal systems (e.g., monoclinic vs. orthorhombic or trigonal vs. hexagonal) are well differentiated. We additionally find that the MSDN architecture is advantageous for capturing patterns in a richer but less redundant manner relative to conventional convolutional neural networks. The proposed protocols in regard to both input descriptor processing and DL architecture enable accurate space group classification and thus improve the practical usage of the DL approach in crystal symmetry identification.

[1]  Sunghak Lee,et al.  Understanding the physical metallurgy of the CoCrFeMnNi high-entropy alloy: an atomistic simulation study , 2018, npj Computational Materials.

[2]  P. Moeck On Classification Approaches for Crystallographic Symmetries of Noisy 2D Periodic Patterns , 2019, IEEE Transactions on Nanotechnology.

[3]  A. M. B. DOUGLAS,et al.  X-Ray Crystallography , 1947, Nature.

[4]  M. Scheffler,et al.  Insightful classification of crystal structures using deep learning , 2017, Nature Communications.

[5]  Andrew Beng Jin Teoh,et al.  Periocular Recognition in the Wild: Implementation of RGB-OCLBCP Dual-Stream CNN , 2019, Applied Sciences.

[6]  Ondrej Dyck,et al.  Mapping mesoscopic phase evolution during E-beam induced transformations via deep learning of atomically resolved images , 2018, npj Computational Materials.

[7]  S. Tsang,et al.  The Contribution of Synchrotron X-Ray Powder Diffraction to Modern Zeolite Applications: A Mini-review and Prospects , 2018, Chem.

[8]  Alfred Ludwig,et al.  Discovery of new materials using combinatorial synthesis and high-throughput characterization of thin-film materials libraries combined with computational methods , 2019, npj Computational Materials.

[9]  Andrea Giacometti,et al.  Trend of estimated glomerular filtration rate during ombistasvir/paritaprevir/ritonavir plus dasabuvir ± ribavirin in HIV/HCV co-infected patients , 2018, PloS one.

[10]  Miaozhong Xu,et al.  DenseNet-Based Depth-Width Double Reinforced Deep Learning Neural Network for High-Resolution Remote Sensing Image Per-Pixel Classification , 2018, Remote. Sens..

[11]  Alan A. Coelho An indexing algorithm independent of peak position extraction for X-ray powder diffraction patterns , 2017 .

[12]  Marcus A. Neumann,et al.  X-Cell: a novel indexing algorithm for routine tasks and difficult cases , 2003 .

[13]  Tolga Tasdizen,et al.  Decoding crystallography from high-resolution electron imaging and diffraction datasets with deep learning , 2019, Science Advances.

[14]  T. Hahn International Tables for Crystallography: Space-group symmetry , 2006 .

[15]  Rama Vasudevan,et al.  Deep Learning of Atomically Resolved Scanning Transmission Electron Microscopy Images: Chemical Identification and Tracking Local Transformations. , 2017, ACS nano.

[16]  K. A. Brown,et al.  High-throughput synthesis and characterization of nanocrystalline porphyrinic zirconium metal-organic frameworks. , 2016, Chemical communications.

[17]  M. Lanagan,et al.  High throughput synthesis and characterization of the PbnNb2O5+n (0.5 < n < 4.1) system on a single chip , 2011 .

[18]  Tonio Buonassisi,et al.  Accelerating Materials Development via Automation, Machine Learning, and High-Performance Computing , 2018, Joule.

[19]  T. Hahn International tables for crystallography , 2002 .

[20]  Matthew L. Gong,et al.  Crystallographic prediction from diffraction and chemistry data for higher throughput classification using machine learning , 2020 .

[21]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[22]  Pascal Marc Vecsei,et al.  Neural network based classification of crystal symmetries from x-ray diffraction patterns , 2018, Physical Review B.

[23]  Yunchao Xie,et al.  Rapid Identification of X-ray Diffraction Spectra Based on Very Limited Data by Interpretable Convolutional Neural Networks , 2019, 1912.07750.

[24]  Janet Newman,et al.  Classification of crystallization outcomes using deep convolutional neural networks , 2018, PloS one.

[25]  Harold T. Stokes,et al.  FINDSYM: program for identifying the space‐group symmetry of a crystal , 2005 .

[26]  Kevin Kaufmann,et al.  Crystal symmetry determination in electron diffraction using machine learning , 2020, Science.

[27]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[28]  Xin Zhao,et al.  Materials genomics methods for high-throughput construction of COFs and targeted synthesis , 2018, Nature Communications.

[29]  Pieter P. Plehiers,et al.  A robotic platform for flow synthesis of organic compounds informed by AI planning , 2019, Science.

[30]  Michael Maire,et al.  Learning Implicitly Recurrent CNNs Through Parameter Sharing , 2019, ICLR.

[31]  Tomas Ekeberg,et al.  Condor: a simulation tool for flash X-ray imaging , 2016, Journal of applied crystallography.

[32]  Peter Moeck,et al.  Towards Generalized Noise-Level Dependent Crystallographic Symmetry Classifications of More or Less Periodic Crystal Patterns , 2018, Symmetry.

[33]  I. Tanaka,et al.  $\texttt{Spglib}$: a software library for crystal symmetry search , 2018, 1808.01590.

[34]  Qiang Du,et al.  Using a machine learning approach to determine the space group of a structure from the atomic pair distribution function. , 2019, Acta crystallographica. Section A, Foundations and advances.

[35]  Young-Keun Choi,et al.  Corrigendum: Pyruvate Dehydrogenase Kinase 4 Promotes Vascular Calcification via SMAD1/5/8 Phosphorylation , 2016, Scientific reports.

[36]  Cormac Toher,et al.  AFLOW-SYM: platform for the complete, automatic and self-consistent symmetry analysis of crystals. , 2018, Acta crystallographica. Section A, Foundations and advances.

[37]  W. Park,et al.  Classification of crystal structure using a convolutional neural network , 2017, IUCrJ.

[38]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[39]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[40]  Sergei V. Kalinin,et al.  A self-driving microscope and the Atomic Forge , 2019, MRS Bulletin.

[41]  Ke Zhang,et al.  Multiple Feature Reweight DenseNet for Image Classification , 2019, IEEE Access.

[42]  Sergey V. Krivovichev,et al.  Structure description, interpretation and classification in mineralogical crystallography , 2017 .

[43]  Sergei V. Kalinin,et al.  Big Data Analytics for Scanning Transmission Electron Microscopy Ptychography , 2016, Scientific Reports.

[44]  Savitha Ramasamy,et al.  Fast and interpretable classification of small X-ray diffraction datasets using data augmentation and deep neural networks , 2018, npj Computational Materials.

[45]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[46]  A. Aspuru-Guzik,et al.  Self-driving laboratory for accelerated discovery of thin-film materials , 2019, Science Advances.

[47]  Stefano Curtarolo,et al.  High-throughput electronic band structure calculations: Challenges and tools , 2010, 1004.2974.

[48]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  William I. F. David,et al.  ExtSym: a program to aid space‐group determination from powder diffraction data , 2008 .

[50]  Kevin M. Ryan,et al.  Crystal Structure Prediction via Deep Learning. , 2018, Journal of the American Chemical Society.

[51]  N. Medvedeva,et al.  Magnetism in bcc and fcc Fe with carbon and manganese , 2010, Journal of physics. Condensed matter : an Institute of Physics journal.

[52]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.