Indexing and mining large-scale neuron databases using maximum inner product search

Abstract Morphological retrieval is an effective approach to explore large-scale neuronal databases, as the morphology is correlated with neuronal types, regions, functions, etc. In this paper, we focus on the neuron identification and analysis via morphological retrieval. In our proposed framework, multiple features are extracted to represent 3D neuron data. Because each feature reflects different levels of similarity between neurons, we group features into different hierarchies to compute the similarity matrix. Then, compact binary codes are generated from hierarchical features for efficient similarity search. Since neuronal cells usually have tree-topology structure, it is hard to distinguish different types of neurons simply via traditional binary coding or hashing methods based on Euclidean distance metric and/or linear hyperplanes. Therefore, we employ an asymmetric binary coding strategy based on the maximum inner product search (MIPS), which not only makes it easier to learn the binary coding functions, but also preserves the non-linear characteristics of the neuron morphological data. We evaluate the proposed method on more than 17,000 neurons, by validating the retrieved neurons with associated cell types and brain regions. Experimental results show the superiority of our approach in neuron morphological retrieval compared with other state-of-the-art methods. Moreover, we demonstrate its potential use cases in the identification and analysis of neuron characteristics from large neuron databases.

[1]  Zhi Zhou,et al.  TReMAP: Automatic 3D Neuron Reconstruction Based on Tracing, Reverse Mapping and Assembling of 2D Projections , 2015, Neuroinformatics.

[2]  J. Douglas Armstrong,et al.  Bioinformatics Applications Note Systems Biology Simple Neurite Tracer: Open Source Software for Reconstruction, Visualization and Analysis of Neuronal Processes , 2022 .

[3]  Wei Liu,et al.  Scalable mammogram retrieval using Anchor Graph Hashing , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[4]  Svetlana Lazebnik,et al.  Iterative quantization: A procrustean approach to learning binary codes , 2011, CVPR 2011.

[5]  Akira Chiba,et al.  Three-dimensional neurite tracing under globally varying contrast , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[6]  Dmitri B Chklovskii,et al.  Maximization of the connectivity repertoire as a statistical principle governing the shapes of dendritic arbors , 2009, Proceedings of the National Academy of Sciences.

[7]  Eugene W. Myers,et al.  BlastNeuron for Automated Comparison, Retrieval and Clustering of 3D Neuron Morphologies , 2015, Neuroinformatics.

[8]  Zhi Zhou,et al.  Adaptive Image Enhancement for Tracing 3D Morphologies of Neurons and Brain Vasculatures , 2014, Neuroinformatics.

[9]  Jun Xu,et al.  Fusing Heterogeneous Features From Stacked Sparse Autoencoder for Histopathological Image Analysis , 2016, IEEE Journal of Biomedical and Health Informatics.

[10]  Fumin Shen,et al.  Maximum inner product search for morphological retrieval of large-scale neuron data , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[11]  Zhen Wang,et al.  The ordinal relation preserving binary codes , 2015, Pattern Recognit..

[12]  Erik Meijering,et al.  Neuron tracing in perspective , 2010, Cytometry. Part A : the journal of the International Society for Analytical Cytology.

[13]  Svetlana Lazebnik,et al.  Locality-sensitive binary codes from shift-invariant kernels , 2009, NIPS.

[14]  Hanchuan Peng,et al.  V3D enables real-time 3D visualization and quantitative analysis of large-scale biological image data sets , 2010, Nature Biotechnology.

[15]  G. Ascoli,et al.  L-Measure: a web-accessible tool for the analysis, comparison and search of digital reconstructions of neuronal morphologies , 2008, Nature Protocols.

[16]  Antonio Torralba,et al.  Spectral Hashing , 2008, NIPS.

[17]  R. C Cannon,et al.  An on-line archive of reconstructed hippocampal neurons , 1998, Journal of Neuroscience Methods.

[18]  Piotr Indyk,et al.  Similarity Search in High Dimensions via Hashing , 1999, VLDB.

[19]  Tianming Liu,et al.  SmartTracing: self-learning-based Neuron reconstruction , 2015, Brain Informatics.

[20]  Rongrong Ji,et al.  Supervised hashing with kernels , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Junzhou Huang,et al.  Joint Kernel-Based Supervised Hashing for Scalable Histopathological Image Analysis , 2015, MICCAI.

[22]  Luciano da Fontoura Costa,et al.  Multiscale skeletons by image foresting transform and its application to neuromorphometry , 2002, Pattern Recognit..

[23]  David J. Fleet,et al.  Minimal Loss Hashing for Compact Binary Codes , 2011, ICML.

[24]  Hai Su,et al.  High-throughput histopathological image analysis via robust cell segmentation and hashing , 2015, Medical Image Anal..

[25]  Nassir Navab,et al.  Hashing Forests for Morphological Search and Retrieval in Neuroscientific Image Databases , 2015, MICCAI.

[26]  Mauro Miazaki,et al.  Frontiers in Computational Neuroscience , 2022 .

[27]  Giorgio A. Ascoli,et al.  Doubling up on the Fly: NeuroMorpho.Org Meets Big Data , 2014, Neuroinformatics.

[28]  Daoqiang Zhang,et al.  A generative probability model of joint label fusion for multi-atlas based brain segmentation , 2014, Medical Image Anal..

[29]  Wei Liu,et al.  Learning Binary Codes for Maximum Inner Product Search , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[30]  Xianglong Liu,et al.  Multiple feature kernel hashing for large-scale visual search , 2014, Pattern Recognit..

[31]  David J. Fleet,et al.  Hamming Distance Metric Learning , 2012, NIPS.

[32]  Ping Li,et al.  Asymmetric LSH (ALSH) for Sublinear Time Maximum Inner Product Search (MIPS) , 2014, NIPS.

[33]  Wei Liu,et al.  Learning to Hash for Indexing Big Data—A Survey , 2015, Proceedings of the IEEE.

[34]  Hanchuan Peng,et al.  Deep models for brain EM image segmentation: novel insights and improved performance , 2016, Bioinform..

[35]  Scott T. Acton,et al.  Tree2Tree2: Neuron tracing in 3D , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[36]  Prateek Jain,et al.  Fast Similarity Search for Learned Metrics , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Ming Yang,et al.  Query Specific Rank Fusion for Image Retrieval , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Yujie Li,et al.  Optimization of large-scale mouse brain connectome via joint evaluation of DTI and neuron tracing data , 2015, NeuroImage.

[39]  Wei Liu,et al.  Supervised Discrete Hashing , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  David Suter,et al.  Fast Supervised Hashing with Decision Trees for High-Dimensional Data , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Shuiwang Ji Computational genetic neuroanatomy of the developing mouse brain: dimensionality reduction, visualization, and clustering , 2013, BMC Bioinformatics.

[42]  Larry S. Davis,et al.  Learning predictable binary codes for face indexing , 2015, Pattern Recognit..

[43]  Chao Chen,et al.  An efficient conditional random field approach for automatic and interactive neuron segmentation , 2016, Medical Image Anal..

[44]  Giorgio A. Ascoli,et al.  The importance of metadata to assess information content in digital reconstructions of neuronal morphology , 2014, Cell and Tissue Research.

[45]  Wei Liu,et al.  Towards Large-Scale Histopathological Image Analysis: Hashing-Based Image Retrieval , 2015, IEEE Transactions on Medical Imaging.

[46]  Heng Tao Shen,et al.  Hashing on Nonlinear Manifolds , 2014, IEEE Transactions on Image Processing.

[47]  Eugene W. Myers,et al.  Automatic Neuron Tracing in Volumetric Microscopy Images with Anisotropic Path Searching , 2010, MICCAI.

[48]  G. Ascoli,et al.  NeuroMorpho.Org: A Central Resource for Neuronal Morphologies , 2007, The Journal of Neuroscience.

[49]  Scott T. Acton,et al.  Tubularity Flow Field—A Technique for Automatic Neuron Segmentation , 2015, IEEE Transactions on Image Processing.