CXNet-m1: Anomaly Detection on Chest X-Rays With Image-Based Deep Learning

Detecting anomaly of chest X-ray images by advanced technologies, such as deep learning, is an urgent need to improve the work efficiency and diagnosis accuracy. Fine-tuning existing deep learning networks for medical image processing suffers from over-fitting and low transfer efficiency. To overcome such limitations, we design a hierarchical convolutional neural network (CNN) structure for ChestX-ray14 and propose a new network CXNet-m1, which is much shorter, thinner but more powerful than fine-tuning. We also raise a novel loss function sin-loss, which can learn discriminative information from misclassified and indistinguishable images. Besides, we optimize the convolutional kernels of CXNet-m1 to achieve better classification accuracy. The experimental results show that our light model CXNet-m1 with sin-loss function achieves better accuracy rate, recall rate, F1-score, and AUC value. It illustrates that designing a proper CNN is better than fine-tuning deep networks, and the increase of training data is vital to enhance the performance of CNN.

[1]  Geoffrey Zweig,et al.  The microsoft 2016 conversational speech recognition system , 2016, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  David R. Musicant,et al.  Lagrangian Support Vector Machines , 2001, J. Mach. Learn. Res..

[4]  Wei Guo,et al.  A hybrid intelligent multi-fault detection method for rotating machinery based on RSGWPT, KPCA and Twin SVM. , 2017, ISA transactions.

[5]  Joseph Antony,et al.  Quantifying radiographic knee osteoarthritis severity using deep convolutional neural networks , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[6]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.

[7]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[8]  Edward Kim,et al.  A deep semantic mobile application for thyroid cytopathology , 2016, SPIE Medical Imaging.

[9]  Jun Li,et al.  Active Learning With Convolutional Neural Networks for Hyperspectral Image Classification Using a New Bayesian Approach , 2018, IEEE Transactions on Geoscience and Remote Sensing.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Chao Zhang,et al.  Numerical Investigation of the Dynamic Responses of Long-Span Bridges With Consideration of the Random Traffic Flow Based on the Intelligent ACO-BPNN Model , 2018, IEEE Access.

[12]  Lorenzo Rosasco,et al.  Are Loss Functions All the Same? , 2004, Neural Computation.

[13]  Luhua Lai,et al.  Sequence-based prediction of protein protein interaction using a deep-learning algorithm , 2017, BMC Bioinformatics.

[14]  Ping Zhang,et al.  Identification of Bruised Apples Using a 3-D Multi-Order Local Binary Patterns Based Feature Extraction Algorithm , 2018, IEEE Access.

[15]  Goutam Saha,et al.  Detection of cardiac abnormality from PCG signal using LMS based least square SVM classifier , 2010, Expert Syst. Appl..

[16]  Yunong Zhang,et al.  Robust Zeroing Neural-Dynamics and Its Time-Varying Disturbances Suppression Model Applied to Mobile Robot Manipulators , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Yunong Zhang,et al.  A Hybrid Multi-Objective Scheme Applied to Redundant Robot Manipulators , 2017, IEEE Transactions on Automation Science and Engineering.

[18]  S. Schreiber,et al.  Spike‐timing dependent inhibitory plasticity to learn a selective gating of backpropagating action potentials , 2017, The European journal of neuroscience.

[19]  Harry Zhang,et al.  The Optimality of Naive Bayes , 2004, FLAIRS.

[20]  Zheng Xiang,et al.  The Excellent Properties of a Dense Grid-Based HOG Feature on Face Recognition Compared to Gabor and LBP , 2018, IEEE Access.

[21]  Yan Cui,et al.  Transfer Learning for Molecular Cancer Classification Using Deep Neural Networks , 2019, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[22]  Dorin Comaniciu,et al.  Learning to recognize Abnormalities in Chest X-Rays with Location-Aware Dense Networks , 2018, CIARP.

[23]  Geoffrey E. Hinton,et al.  Learning representations by back-propagation errors, nature , 1986 .

[24]  Shuai Li,et al.  Tracking Control of Robot Manipulators with Unknown Models: A Jacobian-Matrix-Adaption Method , 2018, IEEE Transactions on Industrial Informatics.

[25]  Mauro Birattari,et al.  Dm63 Heuristics for Combinatorial Optimization Ant Colony Optimization Exercises Outline Ant Colony Optimization: the Metaheuristic Application Examples Generalized Assignment Problem (gap) Connection between Aco and Other Metaheuristics Encodings Capacited Vehicle Routing Linear Ordering Ant Colony , 2022 .

[26]  Reshma Khemchandani,et al.  Twin Support Vector Machines for Pattern Classification , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Yi Song,et al.  Sustainability Evaluation of Power Grid Construction Projects Using Improved TOPSIS and Least Square Support Vector Machine with Modified Fly Optimization Algorithm , 2018 .

[28]  Andrew Y. Ng,et al.  CheXNet: Radiologist-Level Pneumonia Detection on Chest X-Rays with Deep Learning , 2017, ArXiv.

[29]  Shih-Fu Chang,et al.  Modeling Multimodal Clues in a Hybrid Deep Learning Framework for Video Classification , 2017, IEEE Transactions on Multimedia.

[30]  Yue-Shi Lee,et al.  Cluster-based under-sampling approaches for imbalanced data distributions , 2009, Expert Syst. Appl..

[31]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[32]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[33]  Wei Chen,et al.  Spatial prediction of landslide susceptibility using data mining-based kernel logistic regression, naive Bayes and RBFNetwork models for the Long County area (China) , 2019, Bulletin of Engineering Geology and the Environment.

[34]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[35]  Bertrand Michel,et al.  Correlation and variable importance in random forests , 2013, Statistics and Computing.

[36]  Guo Cao,et al.  Cascaded Random Forest for Hyperspectral Image Classification , 2018, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.

[37]  Jianming Jin Theory and Computation of Electromagnetic Fields , 2010 .

[38]  Tie-Yan Liu,et al.  Listwise approach to learning to rank: theory and algorithm , 2008, ICML '08.

[39]  Dong Xu,et al.  SPFTN: A Self-Paced Fine-Tuning Network for Segmenting Objects in Weakly Labelled Videos , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[41]  Shuai Li,et al.  BAS: Beetle Antennae Search Algorithm for Optimization Problems , 2017, ArXiv.

[42]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[43]  Oscar Castillo,et al.  Optimization of type-2 fuzzy weights in backpropagation learning for neural networks using GAs and PSO , 2016, Appl. Soft Comput..

[44]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Meng-Xing Tang,et al.  Fully Automatic Myocardial Segmentation of Contrast Echocardiography Sequence Using Random Forests Guided by Shape Model , 2018, IEEE Transactions on Medical Imaging.

[46]  Mayank Arya Chandra,et al.  Survey on SVM and their application in image classification , 2018 .

[47]  Amin Khodaei,et al.  Leveraging Accuracy-Uncertainty Tradeoff in SVM to Achieve Highly Accurate Outage Predictions , 2018, IEEE Transactions on Power Systems.

[48]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[49]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[50]  Zied Elouedi,et al.  Naive Bayes vs decision trees in intrusion detection systems , 2004, SAC '04.

[51]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[52]  Stewart Worrall,et al.  Transferring visual knowledge for a robust road environment perception in intelligent vehicles , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[53]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[54]  Rajarsi R. Gupta,et al.  Spatial Organization and Molecular Correlation of Tumor-Infiltrating Lymphocytes Using Deep Learning on Pathology Images. , 2018, Cell reports.

[55]  Reshma Rastogi,et al.  Tree-based localized fuzzy twin support vector clustering with square loss function , 2017, Applied Intelligence.

[56]  Laurence Parker,et al.  Utilization Trends in Noncardiac Thoracic Imaging, 2002-2014. , 2017, Journal of the American College of Radiology : JACR.

[57]  Ronald M. Summers,et al.  Learning to Read Chest X-Rays: Recurrent Neural Cascade Model for Automated Image Annotation , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).