MR Acquisition-Invariant Representation Learning

Voxelwise classification approaches are popular and effective methods for tissue quantification in brain magnetic resonance imaging (MRI) scans. However, generalization of these approaches is hampered by large differences between sets of MRI scans such as differences in field strength, vendor or acquisition protocols. Due to this acquisition related variation, classifiers trained on data from a specific scanner fail or under-perform when applied to data that was acquired differently. In order to address this lack of generalization, we propose a Siamese neural network (MRAI-net) to learn a representation that minimizes the between-scanner variation, while maintaining the contrast between brain tissues necessary for brain tissue quantification. The proposed MRAI-net was evaluated on both simulated and real MRI data. After learning the MR acquisition invariant representation, any supervised classification model that uses feature vectors can be applied. In this paper, we provide a proof of principle, which shows that a linear classifier applied on the MRAI representation is able to outperform supervised convolutional neural network classifiers for tissue classification when little target training data is available.

[1]  K. Cheng,et al.  In vivo tissue characterization of human brain by chisquares parameter maps: multiparameter proton T2-relaxation analysis. , 1994, Magnetic resonance imaging.

[2]  Koby Crammer,et al.  A theory of learning from different domains , 2010, Machine Learning.

[3]  Nikos Komodakis,et al.  A Deep Metric for Multimodal Registration , 2016, MICCAI.

[4]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[5]  N. Rofsky,et al.  MR imaging relaxation times of abdominal and pelvic tissues measured in vivo at 3.0 T: preliminary results. , 2004, Radiology.

[6]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[7]  F. Wehrli,et al.  In vivo MR microscopy of the human skin , 1997, Magnetic resonance in medicine.

[8]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[11]  Marleen de Bruijne,et al.  Transfer Learning Improves Supervised Image Segmentation Across Imaging Protocols , 2015, IEEE Trans. Medical Imaging.

[12]  N Saeed,et al.  Magnetic resonance image segmentation using pattern recognition, and applied to image registration and quantitation , 1998, NMR in biomedicine.

[13]  Duane A. Yoder,et al.  MRI simulator with static field inhomogeneity , 2002, SPIE Medical Imaging.

[14]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[15]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Yoshua Bengio,et al.  Domain Adaptation for Large-Scale Sentiment Classification: A Deep Learning Approach , 2011, ICML.

[17]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[18]  Koby Crammer,et al.  Analysis of Representations for Domain Adaptation , 2006, NIPS.

[19]  R. Mark Henkelman,et al.  Analysis of biological NMR relaxation data with continuous distributions of relaxation times , 1986 .

[20]  Amir Alansary,et al.  MRBrainS Challenge: Online Evaluation Framework for Brain Image Segmentation in 3T MRI Scans , 2015, Comput. Intell. Neurosci..

[21]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[22]  Yann LeCun,et al.  Signature Verification Using A "Siamese" Time Delay Neural Network , 1993, Int. J. Pattern Recognit. Artif. Intell..

[23]  L O Hall,et al.  Review of MR image segmentation techniques using pattern recognition. , 1993, Medical physics.

[24]  K. Uğurbil,et al.  Magnetic field and tissue dependencies of human brain longitudinal 1H2O relaxation in vivo , 2007, Magnetic resonance in medicine.

[25]  O Jolivet,et al.  In vivo proton relaxation times analysis of the skin layers by magnetic resonance imaging. , 1991, The Journal of investigative dermatology.

[26]  Abdul Rahman Ramli,et al.  Review of brain MRI image segmentation methods , 2010, Artificial Intelligence Review.

[27]  X. Zeng,et al.  Geometric strategies for neuroanatomic analysis from MRI , 2004, NeuroImage.

[28]  Marleen de Bruijne,et al.  Transfer Learning by Asymmetric Image Weighting for Segmentation across Scanners , 2017, ArXiv.

[29]  B M Dawant,et al.  Brain segmentation and white matter lesion detection in MR images. , 1994, Critical reviews in biomedical engineering.

[30]  Y. LeCun,et al.  Learning methods for generic object recognition with invariance to pose and lighting , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[31]  Mark Bydder,et al.  Qualitative and quantitative ultrashort echo time (UTE) imaging of cortical bone. , 2010, Journal of magnetic resonance.

[32]  Arthur Flexer,et al.  Choosing ℓp norms in high-dimensional spaces based on hub analysis , 2015, Neurocomputing.

[33]  Marleen de Bruijne,et al.  Supervised Image Segmentation across Scanner Protocols: A Transfer Learning Approach , 2012, MLMI.

[34]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[35]  Hao Chen,et al.  VoxResNet: Deep voxelwise residual networks for brain segmentation from 3D MR images , 2017, NeuroImage.

[36]  Matthew D Robson,et al.  Magnetic resonance imaging of cortical bone with ultrashort TE pulse sequences. , 2005, Magnetic resonance imaging.

[37]  Sameer Singh,et al.  Computer Vision and Pattern Recognition Techniques for 2-D and 3-D MR Cerebral Cortical Segmentation (Part I): A State-of-the-Art Review , 2002, Pattern Analysis & Applications.

[38]  N. De Stefano,et al.  Clinical use of brain volumetry , 2013, Journal of magnetic resonance imaging : JMRI.

[39]  A. Hofman,et al.  The Rotterdam Scan Study: design update 2016 and main findings , 2015, European Journal of Epidemiology.

[40]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[41]  R P Velthuizen,et al.  MRI segmentation: methods and applications. , 1995, Magnetic resonance imaging.

[42]  Trevor Darrell,et al.  Deep Domain Confusion: Maximizing for Domain Invariance , 2014, CVPR 2014.

[43]  D. Louis Collins,et al.  A new improved version of the realistic digital brain phantom , 2006, NeuroImage.

[44]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[45]  Yann LeCun,et al.  Dimensionality Reduction by Learning an Invariant Mapping , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[46]  D. Louis Collins,et al.  Twenty New Digital Brain Phantoms for Creation of Validation Image Data Bases , 2006, IEEE Transactions on Medical Imaging.

[47]  H Benoit-Cattin,et al.  The SIMRI project: a versatile and interactive MRI simulator. , 2005, Journal of magnetic resonance.

[48]  Shai Ben-David,et al.  Detecting Change in Data Streams , 2004, VLDB.

[49]  P Jezzard,et al.  Functional changes in CSF volume estimated using measurement of water T2 relaxation , 2009, Magnetic resonance in medicine.