Assisting Radiologists in X-Ray Diagnostics

Studies have shown that radiologists working together with Computer Aided Diagnostic software have increased accuracy. Automated screening software can be used to prioritize X-Rays coming in for diagnosis. We developed a suite of machine learning algorithms that aim to improve radiologist performance. It provides suggested diagnostics, a heatmap showing pathological areas and a bone subtracted version of the image which helps radiologists to identify fractures. We test different configurations for our diagnosis model, training it on both normal and enhanced images, using one or two branches. Our experiments show that adding enhanced inputs (lung segmented and bone subtracted versions of the input) increases the performance of our algorithm, which in turn increases the performance of the radiologist user. This shows that preprocessing the images before input increases model performance. More research is needed to find other preprocessing techniques, to refine existing ones, and to determine the optimal number and type of input X-Rays.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Zhi Zhang,et al.  Bag of Tricks for Image Classification with Convolutional Neural Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  S. Armato,et al.  Automated lung segmentation in digitized posteroanterior chest radiographs. , 1998, Academic radiology.

[4]  Bo Zhou,et al.  Generation of Virtual Dual Energy Images from Standard Single-Shot Radiographs using Multi-scale and Conditional Adversarial Network , 2018, ACCV.

[5]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Li Yao,et al.  Learning to diagnose from scratch by exploiting dependencies among labels , 2017, ArXiv.

[9]  Steven Horng,et al.  MIMIC-CXR, a de-identified publicly available database of chest radiographs with free-text reports , 2019, Scientific Data.

[10]  Yifan Yu,et al.  CheXpert: A Large Chest Radiograph Dataset with Uncertainty Labels and Expert Comparison , 2019, AAAI.

[11]  Han Zhang,et al.  Self-Attention Generative Adversarial Networks , 2018, ICML.

[12]  Kenji Suzuki,et al.  Separation of Bones From Chest Radiographs by Means of Anatomically Specific Multiple Massive-Training ANNs Combined With Total Variation Minimization Smoothing , 2014, IEEE Transactions on Medical Imaging.

[13]  Elizabeth A Krupinski,et al.  A Systematic Review of Fatigue in Radiology: Is It a Problem? , 2018, AJR. American journal of roentgenology.

[14]  Roger G. Mark,et al.  MIMIC-CXR: A large publicly available database of labeled chest radiographs , 2019, ArXiv.

[15]  Muktabh Mayank Srivastava,et al.  Boosted Cascaded Convnets for Multilabel Classification of Thoracic Diseases in Chest Radiographs , 2017, ICIAR.

[16]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Hayit Greenspan,et al.  Improving the Segmentation of Anatomical Structures in Chest Radiographs Using U-Net with an ImageNet Pre-trained Encoder , 2018, RAMBO+BIA+TIA@MICCAI.

[18]  Bram van Ginneken,et al.  Filter learning: Application to suppression of bony structures from chest radiographs , 2006, Medical Image Anal..

[19]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[20]  Yi Yang,et al.  Diagnose like a Radiologist: Attention Guided Convolutional Neural Network for Thorax Disease Classification , 2018, ArXiv.

[21]  Taimur Hassan,et al.  Fully Convolutional Neural Network for Lungs Segmentation from Chest X-Rays , 2018, ICIAR.

[22]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.