High-Resolution Chest X-Ray Bone Suppression Using Unpaired CT Structural Priors

There is clinical evidence that suppressing the bone structures in Chest X-rays (CXRs) improves diagnostic value, either for radiologists or computer-aided diagnosis. However, bone-free CXRs are not always accessible. We hereby propose a coarse-to-fine CXR bone suppression approach by using structural priors derived from unpaired computed tomography (CT) images. In the low-resolution stage, we use the digitally reconstructed radiograph (DRR) image that is computed from CT as a bridge to connect CT and CXR. We then perform CXR bone decomposition by leveraging the DRR bone decomposition model learned from unpaired CTs and domain adaptation between CXR and DRR. To further mitigate the domain differences between CXRs and DRRs and speed up the learning convergence, we perform all the aboved operations in Laplacian of Gaussian (LoG) domain. After obtaining the bone decomposition result in DRR, we upsample it to a high resolution, based on which the bone region in the original high-resolution CXR is cropped and processed to produce a high-resolution bone decomposition result. Finally, such a produced bone image is subtracted from the original high-resolution CXR to obtain the bone suppression result. We conduct experiments and clinical evaluations based on two benchmarking CXR databases to show that (i) the proposed method outperforms the state-of-the-art unsupervised CXR bone suppression approaches; (ii) the CXRs with bone suppression are instrumental to radiologists for reducing their false-negative rate of lung diseases from 15% to 8%; and (iii) state-of-the-art disease classification performances are achieved by learning a deep network that takes the original CXR and its bone-suppressed image as inputs.

[1]  Li Yao,et al.  Weakly Supervised Medical Diagnosis and Localization from Multiple Resolutions , 2018, ArXiv.

[2]  Bram van Ginneken,et al.  Clavicle segmentation in chest radiographs , 2012, Medical Image Anal..

[3]  Nassir Navab,et al.  X-Ray In-Depth Decomposition: Revealing the Latent Structures , 2016, MICCAI.

[4]  Taesung Park,et al.  CyCADA: Cycle-Consistent Adversarial Domain Adaptation , 2017, ICML.

[5]  Shiguang Shan,et al.  SynRhythm: Learning a Deep Heart Rate Estimator from General to Specific , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[6]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[7]  Bram van Ginneken,et al.  Suppression of Translucent Elongated Structures: Applications in Chest Radiography , 2013, IEEE Transactions on Medical Imaging.

[8]  Hao Chen,et al.  Semantic-Aware Generative Adversarial Nets for Unsupervised Domain Adaptation in Chest X-ray Segmentation , 2018, MLMI@MICCAI.

[9]  Prafulla Dhariwal,et al.  Glow: Generative Flow with Invertible 1x1 Convolutions , 2018, NeurIPS.

[10]  Ulas Bagci,et al.  Cross-modality Knowledge Transfer for Prostate Segmentation from CT Scans , 2019, DART/MIL3ID@MICCAI.

[11]  拓海 杉山,et al.  “Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks”の学習報告 , 2017 .

[12]  Bram van Ginneken,et al.  Filter learning: Application to suppression of bony structures from chest radiographs , 2006, Medical Image Anal..

[13]  Konstantinos Kamnitsas,et al.  Unsupervised domain adaptation in brain lesion segmentation with adversarial networks , 2016, IPMI.

[14]  Bo Zhou,et al.  Generation of Virtual Dual Energy Images from Standard Single-Shot Radiographs using Multi-scale and Conditional Adversarial Network , 2018, ACCV.

[15]  Brett W Carter,et al.  Missed Lung Cancer. , 2018, Radiologic clinics of North America.

[16]  C A Mistretta,et al.  Single-exposure dual-energy computed radiography: improved detection and processing. , 1990, Radiology.

[17]  Hiroyuki Yoshida,et al.  Computerized detection of pulmonary nodules in chest radiographs based on morphological features and wavelet snake model , 2002, Medical Image Anal..

[18]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[19]  K. L. Baishnab,et al.  An analysis of CANNY and LAPLACIAN of GAUSSIAN image filters in regard to evaluating retinal image , 2014, 2014 International Conference on Green Computing Communication and Electrical Engineering (ICGCCEE).

[20]  Su Ruan,et al.  Medical Image Synthesis with Context-Aware Generative Adversarial Networks , 2016, MICCAI.

[21]  Nassir Navab,et al.  DeepDRR - A Catalyst for Machine Learning in Fluoroscopy-guided Procedures , 2018, MICCAI.

[22]  Yue Zhang,et al.  Task Driven Generative Modeling for Unsupervised Domain Adaptation: Application to X-ray Image Segmentation , 2018, MICCAI.

[23]  Kenji Suzuki,et al.  Separation of Bones From Chest Radiographs by Means of Anatomically Specific Multiple Massive-Training ANNs Combined With Total Variation Minimization Smoothing , 2014, IEEE Transactions on Medical Imaging.

[24]  Jiannan Wang,et al.  Encoding CT Anatomy Knowledge for Unpaired Chest X-ray Image Decomposition , 2019, MICCAI.

[25]  L. Plank,et al.  Dual-energy X-ray absorptiometry and body composition , 2005, Current opinion in clinical nutrition and metabolic care.

[26]  Shubhangi D.C,et al.  Edge Detection of Femur Bones in X-ray images - A comparative study of Edge Detectors , 2012 .

[27]  Lin Yang,et al.  Translating and Segmenting Multimodal Medical Volumes with Cycle- and Shape-Consistency Generative Adversarial Network , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[28]  Shiguang Shan,et al.  Tattoo Image Search at Scale: Joint Detection and Compact Representation Learning , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Kunio Doi,et al.  Image-processing technique for suppressing ribs in chest radiographs by means of massive training artificial neural network (MTANN) , 2006, IEEE Transactions on Medical Imaging.

[31]  Hayit Greenspan,et al.  Lung Structures Enhancement in Chest Radiographs via CT Based FCNN Training , 2018, RAMBO+BIA+TIA@MICCAI.

[32]  Shiguang Shan,et al.  Deep Multi-Task Learning for Joint Prediction of Heterogeneous Face Attributes , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[33]  K. R. Ramakrishnan,et al.  Detection of edges from projections , 1992, IEEE Trans. Medical Imaging.

[34]  Qianjin Feng,et al.  Bone Suppression of Chest Radiographs With Cascaded Convolutional Networks in Wavelet Domain , 2019, IEEE Access.

[35]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[36]  Mark R. Pickering,et al.  A new multi-modal similarity measure for fast gradient-based 2D-3D image registration , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[37]  Mark R. Pickering,et al.  A computationally efficient approach for 2D-3D image registration , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[38]  Stefan Jaeger,et al.  Two public chest X-ray datasets for computer-aided screening of pulmonary diseases. , 2014, Quantitative imaging in medicine and surgery.

[39]  Qianjin Feng,et al.  Cascade of multi-scale convolutional neural networks for bone suppression of chest radiographs in gradient domain , 2017, Medical Image Anal..

[40]  Francesc Moreno-Noguer,et al.  GANimation: Anatomically-aware Facial Animation from a Single Image , 2018, ECCV.

[41]  Peter Maday,et al.  Elimination of clavicle shadows to help automatic lung nodule detection on chest radiographs , 2009 .

[42]  Jens von Berg,et al.  A novel bone suppression method that improves lung nodule detection , 2015, International Journal of Computer Assisted Radiology and Surgery.

[43]  D. Brenner,et al.  Computed tomography--an increasing source of radiation exposure. , 2007, The New England journal of medicine.

[44]  G W Sherouse,et al.  Computation of digitally reconstructed radiographs for use in radiotherapy treatment design. , 1990, International journal of radiation oncology, biology, physics.

[45]  R. Sukesh Kumar,et al.  An improved edge detection using morphological Laplacian of Gaussian operator , 2015, 2015 2nd International Conference on Signal Processing and Integrated Networks (SPIN).

[46]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[47]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.