Neuronal Morphological Model-Driven Image Registration for Serial Electron Microscopy Sections

Registration of a series of the two-dimensional electron microscope (EM) images of the brain tissue into volumetric form is an important technique that can be used for neuronal circuit reconstruction. However, complex appearance changes of neuronal morphology in adjacent sections bring difficulty in finding correct correspondences, making serial section neural image registration challenging. To solve this problem, we consider whether there are such stable "markers" in the neural images to alleviate registration difficulty. In this paper, we employ the spherical deformation model to simulate the local neuron structure and analyze the relationship between registration accuracy and neuronal structure shapes in two adjacent sections. The relevant analysis proves that regular circular structures in the section images are instrumental in seeking robust corresponding relationships. Then, we design a new serial section image registration framework driven by this neuronal morphological model, fully utilizing the characteristics of the anatomical structure of nerve tissue and obtaining more reasonable corresponding relationships. Specifically, we leverage a deep membrane segmentation network and neural morphological physical selection model to select the stable rounded regions in neural images. Then, we combine feature extraction and global optimization of correspondence position to obtain the deformation field of multiple images. Experiments on real and synthetic serial EM section neural image datasets have demonstrated that our proposed method could achieve more reasonable and reliable registration results, outperforming the state-of-the-art approaches in qualitative and quantitative analysis.

[1]  Xi Chen,et al.  Performance analysis in serial-section electron microscopy image registration of neuronal tissue , 2022, Medical Imaging.

[2]  Gerhard Stephan,et al.  Segmented anisotropic ssTEM dataset of neural tissue , 2013 .

[3]  Johannes E. Schindelin,et al.  TrakEM2 Software for Neural Circuit Reconstruction , 2012, PloS one.

[4]  M.R. Smith,et al.  Modeling susceptibility difference artifacts produced by metallic implants in magnetic resonance imaging with point-based thin-plate spline image registration , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  A. Hobolth The spherical deformation model. , 2003, Biostatistics.

[6]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[7]  A. A. WANNER,et al.  Challenges of microtome‐based serial block‐face scanning electron microscopy in neuroscience , 2015, Journal of microscopy.

[8]  N. Kasthuri,et al.  New Technique for Ultra-thin Serial Brain Section Imaging Using Scanning Electron Microscopy , 2007, Microscopy and Microanalysis.

[9]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[10]  Yan Wang,et al.  Deep Distance Transform for Tubular Structure Segmentation in CT Scans , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Won-Ki Jeong,et al.  FusionNet: A Deep Fully Residual Convolutional Neural Network for Image Segmentation in Connectomics , 2016, Frontiers in Computer Science.

[12]  Ching-Wei Wang,et al.  Fully automatic and robust 3D registration of serial-section microscopic images , 2015, Scientific Reports.

[13]  Won-Ki Jeong,et al.  ssEMnet: Serial-Section Electron Microscopy Image Registration Using a Spatial Transformer Network with Learned Features , 2017, DLMIA/ML-CDS@MICCAI.

[14]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Alina N. Moga,et al.  An efficient watershed algorithm based on connected components , 2000, Pattern Recognit..

[16]  A. Cardona,et al.  Elastic volume reconstruction from series of ultra-thin microscopy sections , 2012, Nature Methods.

[17]  Le Sun,et al.  Progress in brain neural connectomics , 2018 .

[18]  J. Bourne,et al.  Uniform Serial Sectioning for Transmission Electron Microscopy , 2006, The Journal of Neuroscience.

[19]  Davi D Bock,et al.  Volume electron microscopy for neuronal circuit reconstruction , 2012, Current Opinion in Neurobiology.

[20]  QingMing Luo Brainsmatics—bridging the brain science and brain-inspired artificial intelligence , 2017 .

[21]  H. Sebastian Seung,et al.  Siamese Encoding and Alignment by Multiscale Learning with Self-Supervision , 2019, ArXiv.

[22]  David Grant Colburn Hildebrand,et al.  Imaging ATUM ultrathin section libraries with WaferMapper: a multi-scale approach to EM reconstruction of neural circuits , 2014, Front. Neural Circuits.

[23]  Antonio Torralba,et al.  SIFT Flow: Dense Correspondence across Scenes and Its Applications , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Adrien Bartoli,et al.  Contour-Based TVUS-MR Image Registration for Mapping Small Endometrial Implants , 2013, Abdominal Imaging.

[25]  R. Yuste,et al.  The Brain Activity Map Project and the Challenge of Functional Connectomics , 2012, Neuron.

[26]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[27]  G. Knott,et al.  Serial Section Scanning Electron Microscopy of Adult Brain Tissue Using Focused Ion Beam Milling , 2008, The Journal of Neuroscience.

[28]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.