Image registration of low signal-to-noise cryo-STEM data.

Combining multiple fast image acquisitions to mitigate scan noise and drift artifacts has proven essential for picometer precision, quantitative analysis of atomic resolution scanning transmission electron microscopy (STEM) data. For very low signal-to-noise ratio (SNR) image stacks - frequently required for undistorted imaging at liquid nitrogen temperatures - image registration is particularly delicate, and standard approaches may either fail, or produce subtly specious reconstructed lattice images. We present an approach which effectively registers and averages image stacks which are challenging due to their low-SNR and propensity for unit cell misalignments. Registering all possible image pairs in a multi-image stack leads to significant information surplus. In combination with a simple physical picture of stage drift, this enables identification of incorrect image registrations, and determination of the optimal image shifts from the complete set of relative shifts. We demonstrate the effectiveness of our approach on experimental, cryogenic STEM datasets, highlighting subtle artifacts endemic to low-SNR lattice images and how they can be avoided. High-SNR average images with information transfer out to 0.72 Å are achieved at 300 kV and with the sample cooled to near liquid nitrogen temperature.

[1]  Joachim Weickert,et al.  A Scale-Space Approach to Nonlocal Optical Flow Calculations , 1999, Scale-Space.

[2]  Alemayehu S. Admasu,et al.  Bending and breaking of stripes in a charge ordered manganite , 2017, Nature Communications.

[3]  W. Sigle,et al.  Correcting the linear and nonlinear distortions for atomically resolved STEM spectrum and diffraction imaging , 2018, Microscopy.

[4]  Colin Ophus,et al.  Correcting nonlinear drift distortion of scanning probe and scanning transmission electron microscopies from image pairs with orthogonal scan directions. , 2016, Ultramicroscopy.

[5]  O. L. Krivanek,et al.  Sub-ångstrom resolution using aberration corrected electron optics , 2002, Nature.

[6]  Saso Sturm,et al.  IMAGE-WARP: a real-space restoration method for high-resolution STEM images using quantitative HRTEM analysis. , 2005, Ultramicroscopy.

[7]  M. Zachman,et al.  Site-Specific Preparation of Intact Solid–Liquid Interfaces by Label-Free In Situ Localization and Cryo-Focused Ion Beam Lift-Out , 2016, Microscopy and Microanalysis.

[8]  N. Tanaka Present status and future prospects of spherical aberration corrected TEM/STEM for study of nanomaterials∗ , 2008, Science and technology of advanced materials.

[9]  N. Mathur,et al.  Multiferroic and magnetoelectric materials , 2006, Nature.

[10]  Marin van Heel,et al.  Correlation functions revisited , 1992 .

[11]  H. Alloul Introduction to Superconductivity , 2011 .

[12]  Benjamin Berkels,et al.  Picometre-precision analysis of scanning transmission electron microscopy images of platinum nanocatalysts , 2014, Nature Communications.

[13]  P. Galindo,et al.  An approach to the systematic distortion correction in aberration‐corrected HAADF images , 2006, Journal of microscopy.

[14]  J Frank,et al.  Computer averaging of electron micrographs of 40S ribosomal subunits. , 1981, Science.

[15]  Lena F. Kourkoutis,et al.  Atomically engineered ferroic layers yield a room-temperature magnetoelectric multiferroic , 2016, Nature.

[16]  Guillermo Sapiro,et al.  Fundamental Limits in Multi-Image Alignment , 2016, IEEE Transactions on Signal Processing.

[17]  S. Wolf,et al.  Cryo-scanning transmission electron tomography of vitrified cells , 2014, Nature Methods.

[18]  Alemayehu S. Admasu,et al.  Nature and evolution of incommensurate charge order in manganites visualized with cryogenic scanning transmission electron microscopy , 2018, Proceedings of the National Academy of Sciences.

[19]  M. Shiojiri,et al.  Deconvolution processing of HAADF STEM images. , 2002, Ultramicroscopy.

[20]  Xiahan Sang,et al.  Revolving scanning transmission electron microscopy: correcting sample drift distortion without prior knowledge. , 2014, Ultramicroscopy.

[21]  G. Grüner,et al.  The dynamics of charge-density waves , 1988 .

[22]  Pascal Frossard,et al.  Analysis of Descent-Based Image Registration , 2013, SIAM J. Imaging Sci..

[23]  Zach,et al.  Upper limits for the residual aberrations of a high-resolution aberration-corrected STEM , 2000, Ultramicroscopy.

[24]  Marcus A. Brubaker,et al.  Alignment of cryo-EM movies of individual particles by optimization of image translations. , 2014, Journal of structural biology.

[25]  Martin Hÿtch,et al.  Quantitative measurement of displacement and strain fields from HREM micrographs , 1998 .

[26]  L. Kourkoutis,et al.  Atomic lattice disorder in charge-density-wave phases of exfoliated dichalcogenides (1T-TaS2) , 2016, Proceedings of the National Academy of Sciences.

[27]  Jan Modersitzki,et al.  Numerical Methods for Image Registration , 2004 .

[28]  Hassan Foroosh,et al.  Extension of phase correlation to subpixel registration , 2002, IEEE Trans. Image Process..

[29]  T. McQueen,et al.  Rearrangement of Van-der-Waals Stacking and Formation of a Singlet State at $T = 90$ K in a Cluster Magnet , 2017, 1701.05528.

[30]  N. Elad,et al.  Detection of isolated protein-bound metal ions by single-particle cryo-STEM , 2017, Proceedings of the National Academy of Sciences.

[31]  X. Sang,et al.  Characterizing the response of a scintillator-based detector to single electrons. , 2016, Ultramicroscopy.

[32]  Laurent Joyeux,et al.  Efficiency of 2 D alignment methods , 2002 .

[33]  D. Muller,et al.  Dose-Efficient Cryo-STEM Imaging of Whole Cells Using the Electron Microscope Pixel Array Detector , 2017, Microscopy and Microanalysis.

[34]  Busshitsu Zairyō Kenkyū Kikō Science and technology of advanced materials , 2000 .

[35]  K. Kimoto,et al.  Local crystal structure analysis with several picometer precision using scanning transmission electron microscopy. , 2010, Ultramicroscopy.

[36]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[37]  M. Shatsky,et al.  A method for the alignment of heterogeneous macromolecules from electron microscopy. , 2009, Journal of structural biology.

[38]  S. Yao,et al.  Scanning distortion correction in STEM images. , 2018, Ultramicroscopy.

[39]  M. Kawasaki,et al.  Retrieval process of high-resolution HAADF-STEM images. , 2002, Journal of electron microscopy.

[40]  N. Braidy,et al.  Correcting scanning instabilities from images of periodic structures. , 2012, Ultramicroscopy.

[41]  J. Banavar,et al.  Computer Simulation of Liquids , 1988 .

[42]  Laurent Joyeux,et al.  Efficiency of 2D alignment methods. , 2002, Ultramicroscopy.

[43]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[44]  Peyman Milanfar,et al.  Fundamental performance limits in image registration , 2004, IEEE Trans. Image Process..

[45]  P. Batson,et al.  corrigendum: Sub-ångstrom resolution using aberration corrected electron optics , 2002, Nature.

[46]  David A Muller,et al.  Room design for high-performance electron microscopy. , 2006, Ultramicroscopy.

[47]  Lewys Jones,et al.  Identifying and Correcting Scan Noise and Drift in the Scanning Transmission Electron Microscope , 2013, Microscopy and Microanalysis.

[48]  Wolfgang Dahmen,et al.  Optimized imaging using non-rigid registration , 2014, Ultramicroscopy.