Deep Learning-Based Super-Resolution Applied to Dental Computed Tomography

The resolution of dental computed tomography (CT) images is limited by detector geometry, sensitivity, patient movement, the reconstruction technique and the need to minimize radiation dose. Recently, the use of convolutional neural network (CNN) architectures has shown promise as a resolution enhancement method. In the current work, two CNN architectures—a subpixel network and the so called U-net—have been considered for the resolution enhancement of 2-D cone-beam CT image slices of ex vivo teeth. To do so, a training set of 5680 cross-sectional slices of 13 teeth and a test set of 1824 slices of 4 structurally different teeth were used. Two existing reconstruction-based super-resolution methods using $\boldsymbol {\ell _{2}}$ -norm and total variation regularization were used for comparison. The results were evaluated with different metrics (peak signal-to-noise ratio, structure similarity index, and other objective measures estimating human perception) and subsequent image-segmentation-based analysis. In the evaluation, micro-CT images were used as ground truth. The results suggest the superiority of the proposed CNN-based approaches over reconstruction-based methods in the case of dental CT images, allowing better detection of medically salient features, such as the size, shape, or curvature of the root canal.

[1]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[2]  Adrian Basarab,et al.  Cone-Beam Computed Tomography contrast validation of an artificial periodontal phantom for use in endodontics , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Wilson S. Geisler,et al.  Image quality assessment based on a degradation model , 2000, IEEE Trans. Image Process..

[4]  YiNan Zhang,et al.  Deep Learning- and Transfer Learning-Based Super Resolution Reconstruction from Single Medical Image , 2017, Journal of healthcare engineering.

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[7]  Weimin Huang,et al.  Brain tumor grading based on Neural Networks and Convolutional Neural Networks , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Tianqi Chen,et al.  Empirical Evaluation of Rectified Activations in Convolutional Network , 2015, ArXiv.

[9]  Adrian Basarab,et al.  Comparison of an adaptive local thresholding method on CBCT and µCT endodontic images , 2017, Physics in medicine and biology.

[10]  Xiaoou Tang,et al.  Learning a Deep Convolutional Network for Image Super-Resolution , 2014, ECCV.

[11]  D Brüllmann,et al.  Spatial resolution in CBCT machines for dental/maxillofacial applications-what do we know today? , 2015, Dento maxillo facial radiology.

[12]  Ghassem Tofighi,et al.  Deep Learning-based Pipeline to Recognize Alzheimer’s Disease using fMRI Data , 2016, bioRxiv.

[13]  Luiz Fernando Machado Silveira,et al.  Anatomical evaluation of the root canal diameter and root thickness on the apical third of mesial roots of molars , 2011, Anatomical science international.

[14]  Tammy Riklin-Raviv,et al.  De-noising of Contrast-Enhanced MRI Sequences by an Ensemble of Expert Deep Neural Networks , 2016, LABELS/DLMIA@MICCAI.

[15]  Peter J. Huber,et al.  The place of the L1-norm in robust estimation , 1987 .

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Keith Horner,et al.  Cone Beam CT for Dental and Maxillofacial Radiology ( Evidence Based Guidelines) , 2012 .

[19]  Kerstin Petersson,et al.  ENDODONTIC EPIDEMIOLOGY AND TREATMENT OUTCOME: GENERAL CONSIDERATIONS , 2002 .

[20]  Hu Chen,et al.  Low-dose CT via convolutional neural network. , 2017, Biomedical optics express.

[21]  Nico Karssemeijer,et al.  Deep multi-scale location-aware 3D convolutional neural networks for automated detection of lacunes of presumed vascular origin , 2016, NeuroImage: Clinical.

[22]  Ove A Peters,et al.  Current challenges and concepts in the preparation of root canal systems: a review. , 2004, Journal of endodontics.

[23]  K Gulabivala,et al.  Outcome of primary root canal treatment: systematic review of the literature - part 1. Effects of study characteristics on probability of success. , 2007, International endodontic journal.

[24]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[25]  Chih-Yuan Yang,et al.  Single-Image Super-Resolution: A Benchmark , 2014, ECCV.

[26]  Jong Chul Ye,et al.  Deep Convolutional Framelets: A General Deep Learning Framework for Inverse Problems , 2017, SIAM J. Imaging Sci..

[27]  Kyoung Mu Lee,et al.  Accurate Image Super-Resolution Using Very Deep Convolutional Networks , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[29]  Daniel Rueckert,et al.  Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Kirby G. Vosburgh,et al.  3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support , 2014 .

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  Kebin Jia,et al.  Multiscale CNNs for Brain Tumor Segmentation and Diagnosis , 2016, Comput. Math. Methods Medicine.

[33]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[34]  Edilson Ervolino,et al.  Periapical lesions decrease insulin signal and cause insulin resistance. , 2013, Journal of endodontics.

[35]  Jean-Yves Tourneret,et al.  Fast Single Image Super-Resolution , 2015, ArXiv.

[36]  Maria del C. Valdés Hernández,et al.  Super Resolution Convolutional Neural Networks for Increasing Spatial Resolution of ^1 H Magnetic Resonance Spectroscopic Imaging , 2017, MIUA.

[37]  Konstantinos Kamnitsas,et al.  Multi-input Cardiac Image Super-Resolution Using Convolutional Neural Networks , 2016, MICCAI.

[38]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Giuseppe Mercuro,et al.  Can a chronic dental infection be considered a cause of cardiovascular disease? A review of the literature. , 2011, International journal of cardiology.

[40]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[41]  Dinggang Shen,et al.  Deep ensemble learning of sparse regression models for brain disease diagnosis , 2017, Medical Image Anal..

[42]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[43]  Kyong Hwan Jin,et al.  Fast and robust segmentation of the striatum using deep convolutional neural networks , 2016, Journal of Neuroscience Methods.

[44]  Giuseppe Mercuro,et al.  Association of endodontic infection with detection of an initial lesion to the cardiovascular system. , 2011, Journal of endodontics.

[45]  A. Fouad,et al.  Can apical periodontitis modify systemic levels of inflammatory markers? A systematic review and meta-analysis. , 2013, Journal of endodontics.

[46]  Yaozong Gao,et al.  Estimating CT Image from MRI Data Using 3D Fully Convolutional Networks , 2016, LABELS/DLMIA@MICCAI.

[47]  Chen Yen-Wei,et al.  An Adaptive Backpropagation Algorithm for Limited-Angle CT Image Reconstruction , 2000 .

[48]  Guillermo Machuca,et al.  Diabetes mellitus, periapical inflammation and endodontic treatment outcome , 2011, Medicina oral, patologia oral y cirugia bucal.

[49]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[50]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[51]  Bruno Sixou,et al.  Total variation super-resolution for 3D trabecular bone micro-structure segmentation , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).