Fast approximate STEM image simulations from a machine learning model

Accurate quantum mechanical scanning transmission electron microscopy image simulation methods such as the multislice method require computation times that are too large to use in applications in high-resolution materials imaging that require very large numbers of simulated images. However, higher-speed simulation methods based on linear imaging models, such as the convolution method, are often not accurate enough for use in these applications. We present a method that generates an image from the convolution of an object function and the probe intensity, and then uses a multivariate polynomial fit to a dataset of corresponding multislice and convolution images to correct it. We develop and validate this method using simulated images of Pt and Pt–Mo nanoparticles and find that for these systems, once the polynomial is fit, the method runs about six orders of magnitude faster than parallelized CPU implementations of the multislice method while achieving a 1 − R2 error of 0.010–0.015 and root-mean-square error/standard deviation of dataset being predicted of about 0.1 when compared to full multislice simulations.

[1]  C. Ophus A fast image simulation algorithm for scanning transmission electron microscopy , 2017, Advanced Structural and Chemical Imaging.

[2]  Colin Ophus,et al.  Three-dimensional coordinates of individual atoms in materials revealed by electron tomography. , 2015, Nature materials.

[3]  D. Morgan,et al.  Bayesian Statistical Model for Imaging of Single La Vacancies in LaMnO3 , 2017, Microscopy and Microanalysis.

[4]  D. Morgan,et al.  Three-Dimensional Imaging of Single La Vacancies in LaMnO 3 , 2016, Microscopy and Microanalysis.

[5]  Y. Yao,et al.  STEM image simulation with hybrid CPU/GPU programming. , 2016, Ultramicroscopy.

[6]  R. Bücker,et al.  Low-dose cryo electron ptychography via non-convex Bayesian optimization , 2017, Scientific Reports.

[7]  K. Ishizuka,et al.  A practical approach for STEM image simulation based on the FFT multislice method. , 2002, Ultramicroscopy.

[8]  S. Pennycook,et al.  Atom-by-atom structural and chemical analysis by annular dark-field electron microscopy , 2010, Nature.

[9]  R. Stanley What Is Enumerative Combinatorics , 1986 .

[10]  K. Volz,et al.  STEMsalabim: A high-performance computing cluster friendly code for scanning transmission electron microscopy image simulations of thin specimens. , 2017, Ultramicroscopy.

[11]  P D Nellist,et al.  Probe integrated scattering cross sections in the analysis of atomic resolution HAADF STEM images. , 2013, Ultramicroscopy.

[12]  Jianwei Miao,et al.  A streaming multi-GPU implementation of image simulation algorithms for scanning transmission electron microscopy , 2017, Advanced Structural and Chemical Imaging.

[13]  J. Miao,et al.  Electron tomography at 2.4-ångström resolution , 2012, Nature.

[14]  E. Kirkland Computation in electron microscopy. , 2016, Acta crystallographica. Section A, Foundations and advances.

[15]  J. Miao,et al.  Deciphering chemical order/disorder and material properties at the single-atom level , 2016, Nature.

[16]  W Xu,et al.  A deep convolutional neural network to analyze position averaged convergent beam electron diffraction patterns. , 2017, Ultramicroscopy.

[17]  Benjamin Berkels,et al.  Picometre-precision analysis of scanning transmission electron microscopy images of platinum nanocatalysts , 2014, Nature Communications.

[18]  P. Midgley,et al.  Ultrafast electron diffraction pattern simulations using GPU technology. Applications to lattice vibrations. , 2013, Ultramicroscopy.

[19]  J Sijbers,et al.  A memory efficient method for fully three-dimensional object reconstruction with HAADF STEM. , 2014, Ultramicroscopy.

[20]  S. Stemmer,et al.  Direct Observation of Sr Vacancies in SrTiO 3 by Quantitative Scanning Transmission Electron Microscopy , 2016 .

[21]  S. Stemmer,et al.  Variable-angle high-angle annular dark-field imaging: application to three-dimensional dopant atom profiling , 2015, Scientific Reports.

[22]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[23]  Malcolm L. H. Green,et al.  Simultaneous atomic-resolution electron ptychography and Z-contrast imaging of light and heavy elements in complex nanostructures , 2016, Nature Communications.

[24]  Stephen J. Benkovic,et al.  Corrigendum: RecG and UvsW catalyse robust DNA rewinding critical for stalled DNA replication fork rescue , 2014, Nature Communications.

[25]  P. Nellist,et al.  Rapid estimation of catalyst nanoparticle morphology and atomic-coordination by high-resolution Z-contrast electron microscopy. , 2014, Nano letters.

[26]  Yoshihiro Arai,et al.  Benchmark test of accelerated multi-slice simulation by GPGPU. , 2015, Ultramicroscopy.

[27]  J. M. Cowley,et al.  Fourier Images: I - The Point Source , 1957 .

[28]  J. Miao,et al.  Electron tomography at 2.4 Å resolution , 2011, Microscopy and Microanalysis.

[29]  Dane Morgan,et al.  Integrated Computational and Experimental Structure Refinement for Nanoparticles. , 2016, ACS nano.

[30]  P. W. Bridgman Change of Phase Under Pressure. II. New Melting Curves With a General Thermodynamic Discussion of Melting , 1915 .

[31]  W Van den Broek,et al.  FDES, a GPU-based multislice algorithm with increased efficiency of the computation of the projected potential. , 2015, Ultramicroscopy.

[32]  L. Allen,et al.  Lattice-resolution contrast from a focused coherent electron probe. Part I. , 2003, Ultramicroscopy.

[33]  P. Galindo,et al.  Simulation of high angle annular dark field scanning transmission electron microscopy images of large nanostructures , 2008 .

[34]  Guy Lebanon,et al.  Linear Regression , 2010 .

[35]  Earl J. Kirkland,et al.  Advanced Computing in Electron Microscopy , 1998 .

[36]  J. Miao,et al.  Atomic electron tomography: 3D structures without crystals , 2016, Science.

[37]  C. Dwyer,et al.  Simulation of scanning transmission electron microscope images on desktop computers. , 2010, Ultramicroscopy.