Learning Context Cues for Synapse Segmentation

We present a new approach for the automated segmentation of synapses in image stacks acquired by electron microscopy (EM) that relies on image features specifically designed to take spatial context into account. These features are used to train a classifier that can effectively learn cues such as the presence of a nearby post-synaptic region. As a result, our algorithm successfully distinguishes synapses from the numerous other organelles that appear within an EM volume, including those whose local textural properties are relatively similar. Furthermore, as a by-product of the segmentation, our method flawlessly determines synaptic orientation, a crucial element in the interpretation of brain circuits. We evaluate our approach on three different datasets, compare it against the state-of-the-art in synapse segmentation and demonstrate our ability to reliably collect shape, density, and orientation statistics over hundreds of synapses.

[1]  Angela C. Poole,et al.  The PINK1/Parkin pathway regulates mitochondrial morphology , 2008, Proceedings of the National Academy of Sciences.

[2]  Javier DeFelipe,et al.  Counting Synapses Using FIB/SEM Microscopy: A True Revolution for Ultrastructural Volume Reconstruction , 2009, Front. Neuroanat..

[3]  Joseph F. Murray,et al.  Supervised Learning of Image Restoration with Convolutional Networks , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[4]  Jonathan Brandt,et al.  Robust object detection via soft cascade , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Luis Ibáñez,et al.  The ITK Software Guide , 2005 .

[6]  D. Mastronarde,et al.  Organellar relationships in the Golgi region of the pancreatic beta cell line, HIT-T15, visualized by high resolution electron tomography , 2001, Proceedings of the National Academy of Sciences of the United States of America.

[7]  Tolga Tasdizen,et al.  Automatic markup of neural cell membranes using boosted decision stumps , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[8]  Joseph F. Murray,et al.  Convolutional Networks Can Learn to Generate Affinity Graphs for Image Segmentation , 2010, Neural Computation.

[9]  Ullrich Köthe,et al.  Automated segmentation of synapses in 3D EM data , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[10]  Benjamin Schmid,et al.  A high-level 3D visualization API for Java and ImageJ , 2010, BMC Bioinformatics.

[11]  Qiang Ji,et al.  Shape-Driven Three-Dimensional Watersnake Segmentation of Biological Membranes in Electron Tomography , 2008, IEEE Transactions on Medical Imaging.

[12]  Kristen M. Harris,et al.  Synthesis of Research: Extending Unbiased Stereology of Brain Ultrastructure to Three-dimensional Volumes , 2001, J. Am. Medical Informatics Assoc..

[13]  K. Harris,et al.  Mitochondria detection in electron microscopy images , 2008 .

[14]  J C Fiala,et al.  Reconstruct: a free editor for serial section microscopy , 2005, Journal of microscopy.

[15]  Pascal Fua,et al.  Learning Context Cues for Synapse Segmentation in EM Volumes , 2012, MICCAI.

[16]  S. Brenner,et al.  The structure of the nervous system of the nematode Caenorhabditis elegans. , 1986, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[17]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[18]  Luc Van Gool,et al.  The 2005 PASCAL Visual Object Classes Challenge , 2005, MLCW.

[19]  Demetri Terzopoulos,et al.  Computer-assisted registration, segmentation, and 3D reconstruction from images of neuronal tissue sections , 1994, IEEE Trans. Medical Imaging.

[20]  Ross T. Whitaker,et al.  Detection of neuron membranes in electron microscopy images using a serial neural network architecture , 2010, Medical Image Anal..

[21]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[23]  J DeFelipe,et al.  Estimation of the number of synapses in the cerebral cortex: methodological considerations. , 1999, Cerebral cortex.

[24]  Pascal Fua,et al.  Supervoxel-Based Segmentation of Mitochondria in EM Image Stacks With Learned Shape Features , 2012, IEEE Transactions on Medical Imaging.

[25]  D. Geman,et al.  Stationary Features and Cat Detection , 2008 .

[26]  Alexander G. Gray,et al.  Automatic joint classification and segmentation of whole cell 3D images , 2009, Pattern Recognit..

[27]  Joachim M. Buhmann,et al.  Neuron geometry extraction by perceptual grouping in ssTEM images , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  W. Schubert,et al.  Automated detection and quantification of fluorescently labeled synapses in murine brain tissue sections for high throughput applications. , 2010, Journal of biotechnology.

[29]  Demetri Terzopoulos,et al.  United Snakes , 1999, Medical Image Anal..

[30]  G. Perkins,et al.  Mitochondrial fragmentation in neurodegeneration , 2008, Nature Reviews Neuroscience.

[31]  Ann-Shyn Chiang,et al.  High-throughput Computer Method for 3D Neuronal Structure Reconstruction from the Image Stack of the Drosophila Brain and Its Applications , 2012, PLoS Comput. Biol..

[32]  K. Harris,et al.  Ultrastructural Analysis of Hippocampal Neuropil from the Connectomics Perspective , 2010, Neuron.

[33]  Jens Rittscher,et al.  Spatio-temporal cell cycle phase analysis using level sets and fast marching methods , 2009, Medical Image Anal..

[34]  Guillermo Sapiro,et al.  An energy-based three-dimensional segmentation approach for the quantitative interpretation of electron tomograms , 2005, IEEE Transactions on Image Processing.

[35]  B. S. Manjunath,et al.  Graph cut segmentation of neuronal structures from transmission electron micrographs , 2008, 2008 15th IEEE International Conference on Image Processing.

[36]  Alexander Borst,et al.  Contour-propagation algorithms for semi-automated reconstruction of neural processes , 2008, Journal of Neuroscience Methods.

[37]  Ullrich Köthe,et al.  Segmentation of SBFSEM Volume Data of Neural Tissue by Hierarchical Classification , 2008, DAGM-Symposium.

[38]  C. Mannella,et al.  Reconsidering mitochondrial structure: new views of an old organelle. , 1997, Trends in biochemical sciences.

[39]  Pascal Fua,et al.  A Real-Time Deformable Detector , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.