Towards real‐time STEM simulations through targeted subsampling strategies

Scanning transmission electron microscopy images can be complex to interpret on the atomic scale as the contrast is sensitive to multiple factors such as sample thickness, composition, defects and aberrations. Simulations are commonly used to validate or interpret real experimental images, but they come at a cost of either long computation times or specialist hardware such as graphics processing units. Recent works in compressive sensing for experimental STEM images have shown that it is possible to significantly reduce the amount of acquired signal and still recover the full image without significant loss of image quality, and therefore it is proposed here that similar methods can be applied to STEM simulations. In this paper, we demonstrate a method that can significantly increase the efficiency of STEM simulations through a targeted sampling strategy, along with a new approach to independently subsample each frozen phonon layer. We show the effectiveness of this method by simulating a SrTiO3 grain boundary and monolayer 2H‐MoS2 containing a sulphur vacancy using the abTEM software. We also show how this method is not limited to only traditional multislice methods, but also increases the speed of the PRISM simulation method. Furthermore, we discuss the possibility for STEM simulations to seed the acquisition of real data, to potentially lead the way to self‐driving (correcting) STEM.

[1]  A. Kirkland,et al.  The advantages of sub-sampling and Inpainting for scanning transmission electron microscopy , 2023, Applied Physics Letters.

[2]  A. Kirkland,et al.  A Targeted Sampling Strategy for Compressive Cryo Focused Ion Beam Scanning Electron Microscopy , 2022, ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  A. Kirkland,et al.  SIM-STEM Lab: Incorporating Compressed Sensing Theory for Fast STEM Simulation. , 2022, Ultramicroscopy.

[4]  N. Browning,et al.  Compressed STEM Simulations , 2022, Microscopy and Microanalysis.

[5]  Amirafshar Moshtaghpour,et al.  Compressive Scanning Transmission Electron Microscopy , 2021, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  N. Browning,et al.  Sub-Sampled Imaging for STEM: Maximising Image Speed, Resolution and Precision Through Reconstruction Parameter Refinement. , 2021, Ultramicroscopy.

[7]  A. Chroneos,et al.  One-dimensional yttrium silicide electride (Y5Si3:e−) for encapsulation of volatile fission products , 2021, Journal of Applied Physics.

[8]  Toma Susi,et al.  The abTEM code: transmission electron microscopy from first principles , 2021, Open research Europe.

[9]  M. Chi,et al.  Direct visualization of anionic electrons in an electride reveals inhomogeneities , 2021, Science Advances.

[10]  Direct Electron, LP , 2021, Microscopy Today.

[11]  Jan Kirchhof,et al.  Subsampling Approaches for Compressed Sensing with Ultrasound Arrays in Non-Destructive Testing , 2020, Sensors.

[12]  R. Egerton Radiation damage to organic and inorganic specimens in the TEM. , 2019, Micron.

[13]  Taisuke Ozaki,et al.  OpenMX Viewer: A web-based crystalline and molecular graphical user interface program , 2019, Journal of molecular graphics & modelling.

[14]  J Barthel,et al.  Dr. Probe: A software for high-resolution STEM image simulation. , 2018, Ultramicroscopy.

[15]  Michael Unser,et al.  Compressed sensing for STEM tomography. , 2017, Ultramicroscopy.

[16]  Jianwei Miao,et al.  A streaming multi-GPU implementation of image simulation algorithms for scanning transmission electron microscopy , 2017, Advanced Structural and Chemical Imaging.

[17]  K. Volz,et al.  STEMsalabim: A high-performance computing cluster friendly code for scanning transmission electron microscopy image simulations of thin specimens. , 2017, Ultramicroscopy.

[18]  N. Browning,et al.  Implementing an accurate and rapid sparse sampling approach for low-dose atomic resolution STEM imaging , 2016 .

[19]  J. Verbeeck,et al.  Progress and new advances in simulating electron microscopy datasets using MULTEM. , 2016, Ultramicroscopy.

[20]  Marta Betcke,et al.  Accelerated high-resolution photoacoustic tomography via compressed sensing , 2016, Physics in medicine and biology.

[21]  J. Fuhrmann Advanced Computing In Electron Microscopy , 2016 .

[22]  John W. Paisley,et al.  Scalable Bayesian nonparametric dictionary learning , 2015, 2015 23rd European Signal Processing Conference (EUSIPCO).

[23]  W Van den Broek,et al.  FDES, a GPU-based multislice algorithm with increased efficiency of the computation of the projected potential. , 2015, Ultramicroscopy.

[24]  D Van Dyck,et al.  MULTEM: A new multislice program to perform accurate and fast electron diffraction and imaging simulations using Graphics Processing Units with CUDA. , 2015, Ultramicroscopy.

[25]  L. Carin,et al.  The potential for Bayesian compressive sensing to significantly reduce electron dose in high-resolution STEM images. , 2014, Microscopy.

[26]  N. Browning,et al.  Quantifying stoichiometry-induced variations in structure and energy of a SrTiO3 symmetric Σ13 {510}/<100 > grain boundary , 2013 .

[27]  Djemel Ziou,et al.  Is there a relationship between peak-signal-to-noise ratio and structural similarity index measure? , 2013, IET Image Process..

[28]  W. Branford,et al.  MALTS: A Tool to Simulate Lorentz Transmission Electron Microscopy From Micromagnetic Simulations , 2012, IEEE Transactions on Magnetics.

[29]  Z. Yin,et al.  Single-layer MoS2 phototransistors. , 2012, ACS nano.

[30]  Bin Guo,et al.  Coherence, Compressive Sensing, and Random Sensor Arrays , 2011, IEEE Antennas and Propagation Magazine.

[31]  S. Pennycook Seeing the Atoms more Clearly: STEM Imaging from the Crewe Era to Today , 2011, Microscopy and Microanalysis.

[32]  Julio Gómez-Herrero,et al.  2D materials: to graphene and beyond. , 2011, Nanoscale.

[33]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[34]  J. Shan,et al.  Atomically thin MoS₂: a new direct-gap semiconductor. , 2010, Physical review letters.

[35]  C. Dwyer,et al.  Simulation of scanning transmission electron microscope images on desktop computers. , 2010, Ultramicroscopy.

[36]  Tadahiro Ohmi,et al.  Formation and Property of Yttrium and Yttrium Silicide Films as Low Schottcky Barrier material for n-Type Silicon , 2008 .

[37]  A. Rosenauer,et al.  STEMSIM—a New Software Tool for Simulation of STEM HAADF Z-Contrast Imaging , 2008 .

[38]  V. Grillo,et al.  Accurate and Fast Multislice Simulations of HAADF Image Contrast by Parallel Computing , 2008 .

[39]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[40]  J. Zuo,et al.  Web-Based Electron Microscopy Application Software: Web-EMAPS , 2004, Microscopy and Microanalysis.

[41]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[42]  Z. Wang Introduction to Conventional Transmission Electron Microscopy , 2003 .

[43]  P. Stadelmann Image analysis and simulation software in transmission electron microscopy , 2003, Microscopy and Microanalysis.

[44]  C. Koch Determination of core structure periodicity and point defect density along dislocations , 2002 .

[45]  K. Ishizuka,et al.  A practical approach for STEM image simulation based on the FFT multislice method. , 2002, Ultramicroscopy.

[46]  V. F. Sears,et al.  Debye–Waller factor for elemental crystals , 1991 .

[47]  Stephen J. Pennycook,et al.  Z-contrast stem for materials science , 1989 .

[48]  J. Silcox,et al.  Simulation of annular dark field stem images using a modified multislice method , 1987 .

[49]  Pierre Stadelmann,et al.  EMS-A software package for electron diffraction analysis and HREM image simulation in materials science , 1987 .

[50]  S. Morrison,et al.  Single-layer MoS2 , 1986 .

[51]  A V Crewe,et al.  An introduction to the STEM. , 1984, Journal of ultrastructure research.

[52]  K. Ishizuka,et al.  A new theoretical and practical approach to the multislice method , 1977 .

[53]  A. Crewe,et al.  High resolution imaging properties of the STEM. , 1975, Ultramicroscopy.

[54]  A. Crewe,et al.  Scanning transmission electron microscopy * , 1974, Journal of microscopy.

[55]  P. Goodman,et al.  Numerical evaluations of N‐beam wave functions in electron scattering by the multi‐slice method , 1974 .

[56]  J. M. Cowley,et al.  The scattering of electrons by atoms and crystals. I. A new theoretical approach , 1957 .