Cascade of multi-scale convolutional neural networks for bone suppression of chest radiographs in gradient domain

Suppression of bony structures in chest radiographs (CXRs) is potentially useful for radiologists and computer-aided diagnostic schemes. In this paper, we present an effective deep learning method for bone suppression in single conventional CXR using deep convolutional neural networks (ConvNets) as basic prediction units. The deep ConvNets were adapted to learn the mapping between the gradients of the CXRs and the corresponding bone images. We propose a cascade architecture of ConvNets (called CamsNet) to refine progressively the predicted bone gradients in which the ConvNets work at successively increased resolutions. The predicted bone gradients at different scales from the CamsNet are fused in a maximum-a-posteriori framework to produce the final estimation of a bone image. This estimation of a bone image is subtracted from the original CXR to produce a soft-tissue image in which the bone components are eliminated. Our method was evaluated on a dataset that consisted of 504 cases of real two-exposure dual-energy subtraction chest radiographs (404 cases for training and 100 cases for test). The results demonstrate that our method can produce high-quality and high-resolution bone and soft-tissue images. The average relative mean absolute error of the produced bone images and peak signal-to-noise ratio of the produced soft-tissue images were 3.83% and 38.7dB, respectively. The average bone suppression ratio of our method was 83.8% for the CXRs with pixel sizes of nearly 0.194mm. Furthermore, we apply the trained CamsNet model on the CXRs acquired by various types of X-ray machines, including scanned films, and our method can also produce visually appealing bone and soft-tissue images.

[1]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[2]  Kunio Doi,et al.  Suppression of the contrast of ribs in chest radiographs by means of massive training artificial neural network , 2004, SPIE Medical Imaging.

[3]  Kenji Suzuki,et al.  Computerized Detection of Lung Nodules by Means of “Virtual Dual-Energy” Radiography , 2013, IEEE Transactions on Biomedical Engineering.

[4]  Peter Vock,et al.  Dual energy subtraction: principles and clinical applications. , 2009, European journal of radiology.

[5]  Jian Sun,et al.  Guided Image Filtering , 2010, ECCV.

[6]  Renjie Liao,et al.  Deep Edge-Aware Filters , 2015, ICML.

[7]  Bram van Ginneken,et al.  Segmentation of anatomical structures in chest radiographs using supervised methods: a comparative study on a public database , 2006, Medical Image Anal..

[8]  Kenji Suzuki,et al.  Enhancement of chest radiographs obtained in the intensive care unit through bone suppression and consistent processing , 2016, Physics in medicine and biology.

[9]  Tong Fang,et al.  Gradient domain layer separation under independent motion , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Tae-Seong Kim,et al.  Rib suppression in frontal chest radiographs: A blind source separation approach , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[11]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[12]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[13]  Kunio Doi,et al.  Image-processing technique for suppressing ribs in chest radiographs by means of massive training artificial neural network (MTANN) , 2006, IEEE Transactions on Medical Imaging.

[14]  Rama Chellappa,et al.  Edge Suppression by Gradient Field Transformation Using Cross-Projection Tensors , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[15]  Sebastian Nowozin,et al.  Cascades of Regression Tree Fields for Image Restoration , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Jing-Wein Wang,et al.  A nonparametric-based rib suppression method for chest radiographs , 2012, Comput. Math. Appl..

[18]  Peter Maday,et al.  Elimination of clavicle shadows to help automatic lung nodule detection on chest radiographs , 2009 .

[19]  Xiaoou Tang,et al.  Image Super-Resolution Using Deep Convolutional Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  M D Fox,et al.  Enhancement of chest radiographs with gradient operators. , 1988, IEEE transactions on medical imaging.

[21]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[22]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[23]  Kunio Doi,et al.  Improved detection of subtle lung nodules by use of chest radiographs with bone suppression imaging: receiver operating characteristic analysis with and without localization. , 2011, AJR. American journal of roentgenology.

[24]  Rob Fergus,et al.  Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-scale Convolutional Architecture , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[25]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[26]  Bram van Ginneken,et al.  Suppression of Translucent Elongated Structures: Applications in Chest Radiography , 2013, IEEE Transactions on Medical Imaging.

[27]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Bram van Ginneken,et al.  Filter learning: Application to suppression of bony structures from chest radiographs , 2006, Medical Image Anal..

[29]  K. Doi,et al.  Development of a digital image database for chest radiographs with and without a lung nodule: receiver operating characteristic analysis of radiologists' detection of pulmonary nodules. , 2000, AJR. American journal of roentgenology.

[30]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[31]  Alessandro Foi,et al.  Image Denoising by Sparse 3-D Transform-Domain Collaborative Filtering , 2007, IEEE Transactions on Image Processing.

[32]  Rob Fergus,et al.  Restoring an Image Taken through a Window Covered with Dirt or Rain , 2013, 2013 IEEE International Conference on Computer Vision.

[33]  Kenji Suzuki,et al.  Separation of Bones From Chest Radiographs by Means of Anatomically Specific Multiple Massive-Training ANNs Combined With Total Variation Minimization Smoothing , 2014, IEEE Transactions on Medical Imaging.