Accurate Segmentation of Synaptic Cleft with Contour Growing Concatenated with a Convnet

Synaptic cleft is an important area for neuroscientists to analyze the macromolecular complexes related to neurotransmitter transmission. However, the large amount of noise and low signal-to-noise ratio in raw electron micrographs make it challenging to extract this region automatically. In this paper, we propose a simple but effective framework to automatically extract accurate boundaries of synaptic cleft regions. Our approach concatenates a novel contour growing algorithm to a fully convolutional network (FCN), so that it takes both advantages of large receptive field of FCNs and fine-level localization of contour evolution. The contour growing algorithm is based on the flexible evolving tension and synchronous growing controlling to localize the opening contour of clef region. With consideration of both global localization and local segmentation, our approach is more robust to noisy electron micrographs and outperforms all existing single-model FCNs on accurate segmentation of synaptic clefts.

[1]  Friedrich Förster,et al.  Snapshots of nuclear pore complexes in action captured by cryo-electron tomography , 2007, Nature.

[2]  Heng Huang,et al.  Direct Shape Regression Networks for End-to-End Face Alignment , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[3]  Bin Gu,et al.  Asynchronous Doubly Stochastic Sparse Kernel Learning , 2018, AAAI.

[4]  Ting Xu,et al.  Extraction and analysis of actin networks based on Open Active Contour models , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[5]  Iasonas Kokkinos,et al.  Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs , 2014, ICLR.

[6]  Zhiwei Xiong,et al.  UDNet: Up-Down Network for Compact and Efficient Feature Representation in Image Super-Resolution , 2017, 2017 IEEE International Conference on Computer Vision Workshops (ICCVW).

[7]  V. Lučić,et al.  Structural studies by electron tomography: from cells to molecules. , 2005, Annual review of biochemistry.

[8]  Peter Hawkes,et al.  The Electron Microscope as a Structure Projector , 2007 .

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Mingyuan Zhou,et al.  Multimodal Poisson Gamma Belief Network , 2018, AAAI.

[11]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  J. Dubochet,et al.  The mammalian central nervous synaptic cleft contains a high density of periodically organized complexes. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[14]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[15]  Junaed Sattar Snakes , Shapes and Gradient Vector Flow , 2022 .

[16]  V. Lučić,et al.  Cryo-electron tomography: The challenge of doing structural biology in situ , 2013, The Journal of cell biology.

[17]  Akimichi Kaneko,et al.  pH Changes in the Invaginating Synaptic Cleft Mediate Feedback from Horizontal Cells to Cone Photoreceptors by Modulating Ca2+ Channels , 2003, The Journal of general physiology.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Laurent D. Cohen,et al.  On active contour models and balloons , 1991, CVGIP Image Underst..

[20]  Zhiwei Xiong,et al.  Deep Boosting for Image Denoising , 2018, ECCV.