AMST: Alignment to Median Smoothed Template for Focused Ion Beam Scanning Electron Microscopy Image Stacks

Alignment of stacks of serial images generated by Focused Ion Beam Scanning Electron Microscopy (FIB-SEM) is generally performed using translations only, either through slice-by-slice alignments with SIFT or alignment by template matching. However, limitations of these methods are two-fold: the introduction of a bias along the dataset in the z -direction which seriously alters the morphology of observed organelles and a missing compensation for pixel size variations inherent to the image acquisition itself. These pixel size variations result in local misalignments and jumps of a few nanometers in the image data that can compromise downstream image analysis. We introduce a novel approach which enables affine transformations to overcome local misalignments while avoiding the danger of introducing a scaling, rotation or shearing trend along the dataset. Our method first computes a template dataset with an alignment method restricted to translations only. This pre-aligned dataset is then smoothed selectively along the z -axis with a median filter, creating a template to which the raw data is aligned using affine transformations. Our method was applied to FIB-SEM datasets and showed clear improvement of the alignment along the z -axis resulting in a significantly more accurate automatic boundary segmentation using a convolutional neural network.

[1]  J R Kremer,et al.  Computer visualization of three-dimensional image data using IMOD. , 1996, Journal of structural biology.

[2]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  M. Helmstaedter,et al.  Large-volume en-bloc staining for electron microscopy-based connectomics , 2015, Nature Communications.

[5]  Michael A. Sutton,et al.  Metrology in a scanning electron microscope: theoretical developments and experimental validation , 2006 .

[6]  Bradley C. Lowekamp,et al.  Multi-resolution correlative focused ion beam scanning electron microscopy: applications to cell biology. , 2014, Journal of structural biology.

[7]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[8]  David R. Haynor,et al.  PET-CT image registration in the chest using free-form deformations , 2003, IEEE Transactions on Medical Imaging.

[9]  A. Cardona,et al.  Elastic volume reconstruction from series of ultra-thin microscopy sections , 2012, Nature Methods.

[10]  Larry Lindsey,et al.  High-precision automated reconstruction of neurons with flood-filling networks , 2017, Nature Methods.

[11]  Max A. Viergever,et al.  Adaptive Stochastic Gradient Descent Optimisation for Image Registration , 2009, International Journal of Computer Vision.

[12]  K. Mingard,et al.  Investigation of slice thickness and shape milled by a focused ion beam for three-dimensional reconstruction of microstructures. , 2014, Ultramicroscopy.

[13]  J. Rietdorf,et al.  Correlation of two-photon in vivo imaging and FIB/SEM microscopy , 2015, Journal of microscopy.

[14]  Ajay Limaye,et al.  Drishti: a volume exploration and presentation tool , 2012, Optics & Photonics - Optical Engineering + Applications.

[15]  B. Mizaikoff,et al.  FIB/SEM tomography with TEM-like resolution for 3D imaging of high-pressure frozen cells , 2012, Histochemistry and Cell Biology.

[16]  E. Stelzer,et al.  Recycling of Golgi-resident Glycosyltransferases through the ER Reveals a Novel Pathway and Provides an Explanation for Nocodazole-induced Golgi Scattering , 1998, The Journal of cell biology.

[17]  Max A. Viergever,et al.  elastix: A Toolbox for Intensity-Based Medical Image Registration , 2010, IEEE Transactions on Medical Imaging.

[18]  P. Walther,et al.  Freeze substitution of high‐pressure frozen samples: the visibility of biological membranes is improved when the substitution medium contains water , 2002, Journal of microscopy.

[19]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[20]  Stefan Klein,et al.  Fast parallel image registration on CPU and GPU for diagnostic classification of Alzheimer's disease , 2013, Front. Neuroinform..

[21]  S. Subramaniam,et al.  Focused ion beams in biology , 2015, Nature Methods.

[22]  S. Markert,et al.  Minimal Resin Embedding of Multicellular Specimens for Targeted FIB-SEM Imaging , 2017, Microscopy and Microanalysis.

[23]  B. Mizaikoff,et al.  FIB and MIP: understanding nanoscale porosity in molecularly imprinted polymers via 3D FIB/SEM tomography. , 2017, Nanoscale.

[24]  Christopher Churas,et al.  CDeep3M—Plug-and-Play cloud-based deep learning for image segmentation , 2018, Nature Methods.

[25]  S. Maraghechi,et al.  Correction of Scanning Electron Microscope Imaging Artifacts in a Novel Digital Image Correlation Framework , 2019, Experimental Mechanics.