DEEPRGVP: A novel microstructure-informed supervised contrastive learning framework for automated identification of the retinogeniculate pathway using dMRI tractography

The retinogeniculate pathway (RGVP) is responsible for carrying visual information from the retina to the lateral geniculate nucleus. Identification and visualization of the RGVP are important in studying the anatomy of the visual system and can inform treatment of related brain diseases. Diffusion MRI (dMRI) tractography is an advanced imaging method that uniquely enables in vivo mapping of the 3D trajectory of the RGVP. Currently, identification of the RGVP from tractography data relies on expert (manual) selection of tractography streamlines, which is time-consuming, has high clinical and expert labor costs, and affected by inter-observer variability. In this paper, we present what we believe is the first deep learning framework, namely DeepRGVP, to enable fast and accurate identification of the RGVP from dMRI tractography data. We design a novel microstructureinformed supervised contrastive learning method that leverages both streamline label and tissue microstructure information to determine positive and negative pairs. We propose a simple and successful streamline-level data augmentation method to address highly imbalanced training data, where the number of RGVP streamlines is much lower than that of non-RGVP streamlines. We perform comparisons with several state-of-the-art deep learning methods that were designed for tractography parcellation, and we show superior RGVP identification results using DeepRGVP.

[1]  C. Westin,et al.  TractoFormer: A Novel Fiber-level Whole Brain Tractography Analysis Framework Using Spectral Embedding and Vision Transformers , 2022, MICCAI.

[2]  L. Leocani,et al.  Anterior optic pathway pathology in CNS demyelinating diseases , 2022, Brain : a journal of neurology.

[3]  N. Makris,et al.  Supwma: Consistent and Efficient Tractography Parcellation of Superficial White Matter with Deep Learning , 2022, 2022 IEEE 19th International Symposium on Biomedical Imaging (ISBI).

[4]  Yogesh Rathi,et al.  Deep Fiber Clustering: Anatomically Informed Unsupervised Deep Learning for Fast and Effective White Matter Parcellation , 2021, MICCAI.

[5]  Alexandra J. Golby,et al.  Comparison of multiple tractography methods for reconstruction of the retinogeniculate visual pathway using diffusion MRI , 2020, bioRxiv.

[6]  Alexandra J. Golby,et al.  Deep white matter analysis (DeepWMA): Fast and consistent tractography segmentation , 2020, Medical Image Anal..

[7]  Ce Liu,et al.  Supervised Contrastive Learning , 2020, NeurIPS.

[8]  Carl-Fredrik Westin,et al.  SlicerDMRI: Diffusion MRI and Tractography Research Software for Brain Cancer Surgery Planning and Visualization , 2020, JCO clinical cancer informatics.

[9]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[10]  Alexandra J. Golby,et al.  Creation of a novel trigeminal tractography atlas for automated trigeminal nerve identification , 2020, NeuroImage.

[11]  Alexandra J. Golby,et al.  Anatomical assessment of trigeminal nerve tractography using diffusion MRI: A comparison of acquisition b-values and single- and multi-fiber tracking strategies , 2020, NeuroImage: Clinical.

[12]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[13]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.

[14]  Ming Dong,et al.  Objective Detection of Eloquent Axonal Pathways to Minimize Postoperative Deficits in Pediatric Epilepsy Surgery Using Diffusion Tractography and Convolutional Neural Networks , 2019, IEEE Transactions on Medical Imaging.

[15]  Tammy Riklin-Raviv,et al.  DeepTract: A Probabilistic Deep Learning Framework for White Matter Fiber Tractography , 2018, MICCAI.

[16]  Thomas Welton,et al.  Aberrant visual pathway development in albinism: From retina to cortex , 2018, Human brain mapping.

[17]  Fang-Cheng Yeh,et al.  Tractography for Surgical Neuro-Oncology Planning: Towards a Gold Standard , 2018, Neurotherapeutics.

[18]  A. Krainik,et al.  Track‐weighted imaging for neuroretina: Evaluations in healthy volunteers and ischemic optic neuropathy , 2018, Journal of magnetic resonance imaging : JMRI.

[19]  Peter F. Neher,et al.  TractSeg - Fast and accurate white matter tract segmentation , 2018, NeuroImage.

[20]  Martin Styner,et al.  TRAFIC: fiber tract classification using deep learning , 2018, Medical Imaging.

[21]  Richard Bowman,et al.  Delineation of the visual pathway in paediatric optic pathway glioma patients using probabilistic tractography, and correlations with visual acuity , 2017, NeuroImage: Clinical.

[22]  Carl-Fredrik Westin,et al.  SlicerDMRI: Open Source Diffusion MRI Software for Brain Cancer Research. , 2017, Cancer research.

[23]  Paul M. Thompson,et al.  FiberNET: An ensemble deep learning framework for clustering white matter fibers , 2017, bioRxiv.

[24]  Leonidas J. Guibas,et al.  PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Y. Anık,et al.  Correlation of the measurements of optical coherence tomography and diffuse tension imaging of optic pathways in amblyopia , 2017, International Ophthalmology.

[26]  Fang-Cheng Yeh,et al.  Visualization of Cranial Nerves Using High-Definition Fiber Tractography. , 2016, Neurosurgery.

[27]  Yogesh Rathi,et al.  Joint Multi-Fiber NODDI Parameter Estimation and Tractography Using the Unscented Information Filter , 2016, Front. Neurosci..

[28]  C. Qi.  Deep Learning on Point Sets for 3 D Classification and Segmentation , 2016 .

[29]  Jun Ma,et al.  Preoperative Visualization of Cranial Nerves in Skull Base Tumor Surgery Using Diffusion Tensor Imaging Technology. , 2016, Turkish neurosurgery.

[30]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[31]  Essa Yacoub,et al.  The WU-Minn Human Connectome Project: An overview , 2013, NeuroImage.

[32]  Mark Jenkinson,et al.  The minimal preprocessing pipelines for the Human Connectome Project , 2013, NeuroImage.

[33]  Jens Frahm,et al.  Reconstruction and Dissection of the Entire Human Visual Pathway Using Diffusion Tensor MRI , 2009, Front. Neuroanat..

[34]  Arthur W. Toga,et al.  Human brain white matter atlas: Identification and assignment of common anatomical structures in superficial white matter , 2008, NeuroImage.

[35]  Uta Schick,et al.  Surgical management of meningiomas involving the optic nerve sheath. , 2004, Journal of neurosurgery.

[36]  W. Wichmann,et al.  Anatomy of the visual system. , 2004, European journal of radiology.

[37]  Michael Wall,et al.  High- and low-risk profiles for the development of multiple sclerosis within 10 years after optic neuritis: experience of the optic neuritis treatment trial. , 2003, Archives of ophthalmology.

[38]  P. Basser,et al.  In vivo fiber tractography using DT‐MRI data , 2000, Magnetic resonance in medicine.

[39]  E R Laws,et al.  Transsphenoidal decompression of the optic nerve and chiasm. Visual results in 62 patients. , 1977, Journal of neurosurgery.

[40]  L W CHACKO,et al.  THE LAMINAR PATTERN OF THE LATERAL GENICULATE BODY IN THE PRIMATES , 1948, Journal of neurology, neurosurgery, and psychiatry.