The NanoZoomer artificial intelligence connectomics pipeline for tracer injection studies of the marmoset brain

We describe our connectomics pipeline for processing anterograde tracer injection data for the brain of the common marmoset (Callithrix jacchus). Brain sections were imaged using a batch slide scanner (NanoZoomer 2.0-HT) and we used artificial intelligence to precisely segment the tracer signal from the background in the fluorescence images. The shape of each brain was reconstructed by reference to a block-face and all data were mapped into a common 3D brain space with atlas and 2D cortical flat map. To overcome the effect of using a single template atlas to specify cortical boundaries, brains were cyto- and myelo-architectonically annotated to create individual 3D atlases. Registration between the individual and common brain cortical boundaries in the flat map space was done to absorb the variation of each brain and precisely map all tracer injection data into one cortical brain space. We describe the methodology of our pipeline and analyze the accuracy of our tracer segmentation and brain registration approaches. Results show our pipeline can successfully process and normalize tracer injection experiments into a common space, making it suitable for large-scale connectomics studies with a focus on the cerebral cortex.

[1]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[2]  Shin Ishii,et al.  MarmoNet: a pipeline for automated projection mapping of the common marmoset brain from whole-brain serial two-photon tomography , 2019, ArXiv.

[3]  Andreas K. Maier,et al.  A Gauss-Seidel Iteration Scheme for Reference-Free 3-D Histological Image Reconstruction , 2015, IEEE Transactions on Medical Imaging.

[4]  Nancy Y. Ip,et al.  China Brain Project: Basic Neuroscience, Brain Diseases, and Brain-Inspired Computing , 2016, Neuron.

[5]  Luis Ibáñez,et al.  The Design of SimpleITK , 2013, Front. Neuroinform..

[6]  Atsushi Iriki,et al.  The Brain/MINDS 3D digital marmoset brain atlas , 2018, Scientific Data.

[7]  Markus Diesmann,et al.  CoCoMac 2.0 and the future of tract-tracing databases , 2012, Front. Neuroinform..

[8]  Christof Koch,et al.  Worldwide initiatives to advance brain research , 2016, Nature Neuroscience.

[9]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Olaf Sporns,et al.  Organizing principles for the cerebral cortex network of commissural and association connections , 2017, Proceedings of the National Academy of Sciences.

[12]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[13]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[14]  O. Sporns,et al.  Architecture of the cerebral cortical association connectome underlying cognition , 2015, Proceedings of the National Academy of Sciences.

[15]  Michael Petrides,et al.  Comprar The Marmoset Brain In Stereotaxic Coordinates | Hironobu Tokuno | 9780124158184 | Academic Press , 2012 .

[16]  Brian B. Avants,et al.  Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brain , 2008, Medical Image Anal..

[17]  Hongkui Zeng,et al.  Neuroinformatics of the Allen Mouse Brain Connectivity Atlas. , 2015, Methods.

[18]  S. B. Eickhoff,et al.  Quantitative architectural analysis: a new approach to cortical mapping , 2005, Anatomy and Embryology.

[19]  Andrew K. C. Wong,et al.  A new method for gray-level picture thresholding using the entropy of the histogram , 1985, Comput. Vis. Graph. Image Process..

[20]  Allan R. Jones,et al.  A mesoscale connectome of the mouse brain , 2014, Nature.

[21]  O. J. Dunn.  Multiple Comparisons Using Rank Sums , 1964 .

[22]  Y. Yamaguchi,et al.  Brain/MINDS: A Japanese National Brain Project for Marmoset Neuroscience , 2016, Neuron.

[23]  Arno Klein,et al.  Evaluation of 14 nonlinear deformation algorithms applied to human brain MRI registration , 2009, NeuroImage.

[24]  Arno Klein,et al.  A reproducible evaluation of ANTs similarity metric performance in brain image registration , 2011, NeuroImage.

[25]  Emery N. Brown,et al.  The BRAIN Initiative: developing technology to catalyse neuroscience discovery , 2015, Philosophical Transactions of the Royal Society B: Biological Sciences.

[26]  Carsten Steger,et al.  An Unbiased Detector of Curvilinear Structures , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Hiroshi Abe,et al.  3D reconstruction of brain section images for creating axonal projection maps in marmosets , 2017, Journal of Neuroscience Methods.

[28]  Nikola T. Markov,et al.  A Weighted and Directed Interareal Connectivity Matrix for Macaque Cerebral Cortex , 2012, Cerebral cortex.

[29]  W. Kruskal,et al.  Use of Ranks in One-Criterion Variance Analysis , 1952 .

[30]  Atsushi Iriki,et al.  A high-throughput neurohistological pipeline for brain-wide mesoscale connectivity mapping of the common marmoset , 2018, bioRxiv.

[31]  A. Schleicher,et al.  Areas 3a, 3b, and 1 of Human Primary Somatosensory Cortex 1. Microstructural Organization and Interindividual Variability , 1999, NeuroImage.

[32]  Timothy O. Laumann,et al.  Informatics and Data Mining Tools and Strategies for the Human Connectome Project , 2011, Front. Neuroinform..

[33]  Satrajit S. Ghosh,et al.  Nipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in Python , 2011, Front. Neuroinform..

[34]  David C. Van Essen,et al.  Application of Information Technology: An Integrated Software Suite for Surface-based Analyses of Cerebral Cortex , 2001, J. Am. Medical Informatics Assoc..

[35]  Akiya Watakabe,et al.  Axonal Projections From the Middle Temporal Area in the Common Marmoset , 2018, Frontiers in Neuroanatomy.

[36]  Piotr Majka,et al.  Towards a comprehensive atlas of cortical connections in a primate brain: Mapping tracer injection studies of the common marmoset into a reference digital template , 2016, The Journal of comparative neurology.

[37]  Karlheinz Meier,et al.  Introducing the Human Brain Project , 2011, FET.

[38]  N. Otsu.  A threshold selection method from gray level histograms , 1979 .

[39]  Michael Petrides,et al.  The marmoset brain in stereotaxic coordinates , 2012 .