Herniated Lumbar Disc Generation and Classification Using Cycle Generative Adversarial Networks on Axial View MRI

A frequent cause of lower back pain presenting with leg pain is a herniated lumbar intervertebral disc. A herniation or a herniated lumbar disc is a change of position of disc material (nucleus pulpous or annulus fibrosis). Usually, the lower back pain goes away within days or weeks. Regular treatment techniques for lower back pain include medication, exercises, relaxation methods and surgery. Back pain and back problems regularly occur in the lumbar region. The spinal canal is made up of vertebrae; each one protects the spinal nerves. Intervertebral discs and facet joints connect the vertebrae above and below. Groups of muscles and ligaments hold the vertebrae and the discs together. Muscles support the spine and the body weight, and they allow us to move. Pressure can result in excessive wear and tear of the other structures. For example, a common problem in the lower back is disc herniation. In this case, pressure on an intervertebral disc makes its center, the nucleus pulposus, protrude backwards and push against the spinal nerves, leading to lower back pain. Detection and classification are the two most important tasks in computer aided diagnosing systems. Detection of a herniated lumbar disc from magnetic resonance imaging (MRI) is a very difficult task for radiologist. The extraction of herniated discs has been achieved by different approaches such as active contours, region growing, watershed techniques, thresholding and deep learning. In this study, to detect intervertebral disc from axial MRIs we develop a method using generative adversarial networks (GANs), especially the CycleGAN model, to automatically generate and detect intervertebral disc and to classify the type of the herniated lumbar disc such as foraminal or median. We propose to explore the importance of axial view MRI to determine the herniation type. Accurately, GANs and other generative networks have created several ways to tackle different problems well known and challenging of medical image analysis, such as segmentation, reconstruction, data simulation, medical image de-noising, and classification. Moreover, their efficiency to synthesize images and data at unprecedented levels of realism also gives hope that the chronic scarcity of labeled data in the medical field can be resolved with the help of these generative models. In our case, having a database that contains several images is a very difficult task. In this paper, we put forward a new approach based on GANs, in order to solve the problem of lumbar intervertebral disc images reduction. This method is based especially on CycleGAN. Consequently, the essential objective of our work is to generate and automatically classify the herniation type as foraminal or median using GANs. Our computer aided diagnosis (CAD) system achieved a 97.2% accuracy on our dataset. This result represents a very high-performance results by providing the state of the art and our work utilizing the GANs technique. Our CAD is very effective and efficient for classifying herniations of lumbar intervertebral discs. Therefore, the contribution of this study appears in: firstly, the use of the CycleGAN model based on convolutional layers to detect and classify the herniation type (median or foraminal) in lumbar intervertebral discs, secondly, the use of axial view MRI in order to classify the type of the herniated intervertebral disc. The main objective of this paper is to help radiologists automatically recognize and classify herniated lumbar discs.

[1]  Daniele Ravì,et al.  Adversarial training with cycle consistency for unsupervised super-resolution in endomicroscopy , 2019, Medical Image Anal..

[2]  Xin Qi,et al.  Adversarial Domain Adaptation for Classification of Prostate Histopathology Whole-Slide Images , 2018, MICCAI.

[3]  R. Rothman,et al.  The use of epidural steroids in the treatment of lumbar radicular pain. A prospective, randomized, double-blind study. , 1985, The Journal of bone and joint surgery. American volume.

[4]  Joseph O. Deasy,et al.  Tumor-Aware, Adversarial Domain Adaptation from CT to MRI for Lung Cancer Segmentation , 2018, MICCAI.

[5]  V. Seifert,et al.  Ultra-long-term outcome of surgically treated far-lateral, extraforaminal lumbar disc herniations: a single-center series , 2012, European spine journal.

[6]  Farida Cheriet,et al.  Watershed Segmentation of Intervertebral Disk and Spinal Canal from MRI Images , 2007, ICIAR.

[7]  Guang Yang,et al.  Adversarial and Perceptual Refinement for Compressed Sensing MRI Reconstruction , 2018, MICCAI.

[8]  Benoit M. Dawant,et al.  Conditional Generative Adversarial Networks for Metal Artifact Reduction in CT Images of the Ear , 2018, MICCAI.

[9]  M. Sayadi,et al.  A novel method based on deep learning for herniated lumbar disc segmentation , 2020, 2020 4th International Conference on Advanced Systems and Emergent Technologies (IC_ASET).

[10]  Bin Deng,et al.  Design of Hidden-Property-Based Variable Universe Fuzzy Control for Movement Disorders and Its Efficient Reconfigurable Implementation , 2019, IEEE Transactions on Fuzzy Systems.

[11]  R. Rothman,et al.  The use of epidural steroids in the treatment of lumbar radicular pain. A prospective, randomized, double-blind study. , 1985, The Journal of bone and joint surgery. American volume.

[12]  Won-Ki Jeong,et al.  Compressed Sensing MRI Reconstruction with Cyclic Loss in Generative Adversarial Networks , 2017, ArXiv.

[13]  Jeremy Tan,et al.  Deep Adversarial Context-Aware Landmark Detection for Ultrasound Imaging , 2018, MICCAI.

[14]  Konstantinos Kamnitsas,et al.  Generative adversarial networks and adversarial methods in biomedical image analysis , 2018, ArXiv.

[15]  Ender Konukoglu,et al.  Unsupervised Detection of Lesions in Brain MRI using constrained adversarial auto-encoders , 2018, ArXiv.

[16]  Tammy Riklin-Raviv,et al.  Accelerated Magnetic Resonance Imaging by Adversarial Neural Network , 2017, DLMIA/ML-CDS@MICCAI.

[17]  Bin Deng,et al.  Scalable Digital Neuromorphic Architecture for Large-Scale Biophysically Meaningful Neural Network With Multi-Compartment Neurons , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[18]  Debiao Li,et al.  Efficient and Accurate MRI Super-Resolution using a Generative Adversarial Network and 3D Multi-Level Densely Connected Network , 2018, MICCAI.

[19]  Max A. Viergever,et al.  Generative Adversarial Networks for Noise Reduction in Low-Dose CT , 2017, IEEE Transactions on Medical Imaging.

[20]  Morteza Mardani,et al.  Deep Generative Adversarial Neural Networks for Compressive Sensing MRI , 2019, IEEE Transactions on Medical Imaging.

[21]  Wei Xu,et al.  Multi-channel Generative Adversarial Network for Parallel Magnetic Resonance Image Reconstruction in K-space , 2018, MICCAI.

[22]  Guang Yang,et al.  Deep De-Aliasing for Fast Compressive Sensing MRI , 2017, ArXiv.

[23]  Jelmer M. Wolterink,et al.  Deep MR to CT Synthesis Using Unpaired Data , 2017, SASHIMI@MICCAI.

[24]  Zhengang Jiang,et al.  Imbalanced biomedical data classification using self-adaptive multilayer ELM combined with dynamic GAN , 2018, BioMedical Engineering OnLine.

[25]  Michel A. Audette,et al.  3D lumbar spine intervertebral disc segmentation and compression simulation from MRI using shape-aware models , 2014, International Journal of Computer Assisted Radiology and Surgery.

[26]  Nassir Navab,et al.  Generating Highly Realistic Images of Skin Lesions with GANs , 2018, OR 2.0/CARE/CLIP/ISIC@MICCAI.

[27]  Andreea Udrea,et al.  Generative Adversarial Neural Networks for Pigmented and Non-Pigmented Skin Lesions Detection in Clinical Images , 2017, 2017 21st International Conference on Control Systems and Computer Science (CSCS).

[28]  Eneko Larrañeta,et al.  Synthesis and characterization of hyaluronic acid hydrogels crosslinked using a solvent-free process for potential biomedical applications , 2018, Carbohydrate polymers.

[29]  Jason J. Corso,et al.  Automatic diagnosis of lumbar disc herniation with shape and appearance features from MRI , 2010, Medical Imaging.

[30]  Jinhua Yu,et al.  Reconstruction of Thin-Slice Medical Images Using Generative Adversarial Network , 2017, MLMI@MICCAI.

[31]  Jiang Wang,et al.  CerebelluMorphic: Large-Scale Neuromorphic Model and Architecture for Supervised Motor Learning , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[32]  Liang Han,et al.  A Cascaded Refinement GAN for Phase Contrast Microscopy Image Super Resolution , 2018, MICCAI.

[33]  Mahmoud Al-Ayyoub,et al.  Computer-aided diagnosis of lumbar disc herniation , 2015, 2015 6th International Conference on Information and Communication Systems (ICICS).

[34]  Ming-Dar Tsai,et al.  Automatic spinal disease diagnoses assisted by 3D unaligned transverse CT slices. , 2004, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[35]  C L Hoad,et al.  Segmentation of MR images for computer-assisted surgery of the lumbar spine , 2002, Physics in medicine and biology.

[36]  Sang Jun Park,et al.  Retinal Vessel Segmentation in Fundoscopic Images with Generative Adversarial Networks , 2017, ArXiv.

[37]  Klaus H. Maier-Hein,et al.  Adversarial Networks for the Detection of Aggressive Prostate Cancer , 2017, ArXiv.

[38]  Jiang Wang,et al.  Efficient Spike-Driven Learning With Dendritic Event-Based Processing , 2021, Frontiers in Neuroscience.

[39]  K. Loparo,et al.  BiCoSS: Toward Large-Scale Cognition Brain With Multigranular Neuromorphic Architecture , 2021, IEEE Transactions on Neural Networks and Learning Systems.

[40]  Georg Langs,et al.  Unsupervised Anomaly Detection with Generative Adversarial Networks to Guide Marker Discovery , 2017, IPMI.

[41]  Sheng Xu,et al.  Adversarial Image Registration with Application for MR and TRUS Image Fusion , 2018, MLMI@MICCAI.

[42]  Michael P. Chwialkowski,et al.  Automated detection and evaluation of lumbar discs in MR images , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[43]  Vipin Chaudhary,et al.  Supervised methods for detection and segmentation of tissues in clinical lumbar MRI , 2014, Comput. Medical Imaging Graph..

[44]  Bin Deng,et al.  Real-Time Neuromorphic System for Large-Scale Conductance-Based Spiking Neural Networks , 2019, IEEE Transactions on Cybernetics.

[45]  Nassir Navab,et al.  GANs for Medical Image Analysis , 2018, Artif. Intell. Medicine.

[46]  Verónica Vilaplana,et al.  Brain MRI super-resolution using 3D generative adversarial networks , 2018, ArXiv.

[47]  Kaushik Roy,et al.  Towards spike-based machine intelligence with neuromorphic computing , 2019, Nature.

[48]  Dwarikanath Mahapatra,et al.  Image Super Resolution Using Generative Adversarial Networks and Local Saliency Maps for Retinal Image Analysis , 2017, MICCAI.

[49]  Ender Konukoglu,et al.  Visual Feature Attribution Using Wasserstein GANs , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[50]  S. Michopoulou,et al.  Image analysis for the diagnosis of MR images of the lumbar spine , 2011 .

[51]  Paul Babyn,et al.  Sharpness-Aware Low-Dose CT Denoising Using Conditional Generative Adversarial Network , 2017, Journal of Digital Imaging.