相关论文

Abstract:&NA; Recent advances in machine learning yielded new techniques to train deep neural networks, which resulted in highly successful applications in many pattern recognition tasks such as object detection and speech recognition. In this paper we provide a head‐to‐head comparison between a state‐of‐the art in mammography CAD system, relying on a manually designed feature set and a Convolutional Neural Network (CNN), aiming for a system that can ultimately read mammograms independently. Both systems are trained on a large data set of around 45,000 images and results show the CNN outperforms the traditional CAD system at low sensitivity and performs comparable at high sensitivity. We subsequently investigate to what extent features such as location and patient information and commonly used manual features can still complement the network and see improvements at high specificity over the CNN especially with location and context features, which contain information not available to the CNN. Additionally, a reader study was performed, where the network was compared to certified screening radiologists on a patch level and we found no significant difference between the network and the readers. HighlightsA system based on deep learning is shown to outperform a state‐of‐the art CAD system.Adding complementary handcrafted features to the CNN is shown to increase performance.The system based on deep learning is shown to perform at the level of a radiologist. Graphical abstract Figure. No caption available.

参考文献

[1]  B. Efron Bootstrap Methods: Another Look at the Jackknife , 1979 .

[2]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Yueh-Min Huang,et al.  A novel approach to diagnose diabetes based on the fractal characteristics of retinal images , 2003, IEEE Transactions on Information Technology in Biomedicine.

[4]  N. Karssemeijer,et al.  Segmentation of suspicious densities in digital mammograms. , 2001, Medical physics.

[5]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[6]  Nico Karssemeijer,et al.  Standalone computer-aided detection compared to radiologists’ performance for the detection of mammographic masses , 2012, European Radiology.

[7]  Thomas Hofmann,et al.  Greedy Layer-Wise Training of Deep Networks , 2007 .

[8]  Yoshua Bengio,et al.  Practical Recommendations for Gradient-Based Training of Deep Architectures , 2012, Neural Networks: Tricks of the Trade.

[9]  C. D'Orsi,et al.  Effectiveness of computer-aided detection in community mammography practice. , 2011, Journal of the National Cancer Institute.

[10]  David Gur,et al.  Computer-aided detection; the effect of training databases on detection of subtle breast masses. , 2010, Academic radiology.

[11]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[12]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[13]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[14]  Konrad Schindler,et al.  3D Scene Flow Estimation with a Piecewise Rigid Scene Model , 2015, International Journal of Computer Vision.

[15]  P. Taylor,et al.  Impact of computer-aided detection prompts on the sensitivity and specificity of screening mammography. , 2005, Health technology assessment.

[16]  Håkan Jonsson,et al.  The Impact of Mammographic Screening on Breast Cancer Mortality in Europe: A Review of Observational Studies , 2012, Journal of medical screening.

[17]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[18]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  C. Lehman,et al.  Diagnostic Accuracy of Digital Screening Mammography With and Without Computer-Aided Detection. , 2015, JAMA internal medicine.

[21]  Harm de Vries,et al.  RMSProp and equilibrated adaptive learning rates for non-convex optimization. , 2015 .

[22]  Berkman Sahiner,et al.  Classification of mass and normal breast tissue: a convolution neural network classifier with spatial domain and texture images , 1996, IEEE Trans. Medical Imaging.

[23]  Nico Karssemeijer,et al.  Effect of independent multiple reading of mammograms on detection performance , 2004, SPIE Medical Imaging.

[24]  Nico Karssemeijer,et al.  Invariant Features for Discriminating Cysts from Solid Lesions in Mammography , 2014, Digital Mammography / IWDM.

[25]  K. Doi,et al.  Current status and future potential of computer-aided diagnosis in medical imaging. , 2005, The British journal of radiology.

[26]  L. Tabár,et al.  Mammography service screening and mortality in breast cancer patients: 20-year follow-up before and after introduction of screening , 2003, The Lancet.

[27]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[28]  Rangaraj M. Rangayyan,et al.  Gradient and texture analysis for the classification of mammographic masses , 2000, IEEE Transactions on Medical Imaging.

[29]  Jürgen Schmidhuber,et al.  Multi-column deep neural network for traffic sign classification , 2012, Neural Networks.

[30]  Nico Karssemeijer,et al.  Use of Normal Tissue Context in Computer-Aided Detection of Masses in Mammograms , 2009, IEEE Transactions on Medical Imaging.

[31]  Anna Bornefalk Hermansson,et al.  On the comparison of FROC curves in mammography CAD systems. , 2005, Medical physics.

[32]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[33]  Nico Karssemeijer,et al.  Detection of stellate distortions in mammograms , 1996, IEEE Trans. Medical Imaging.

[34]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[35]  Bernt Schiele,et al.  What Makes for Effective Detection Proposals? , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[37]  Pedro M. Domingos,et al.  Deep Symmetry Networks , 2014, NIPS.

[38]  David Silver,et al.  Move Evaluation in Go Using Deep Convolutional Neural Networks , 2014, ICLR.

[39]  David Hinkley,et al.  Bootstrap Methods: Another Look at the Jackknife , 2008 .

[40]  N. Karssemeijer,et al.  A new 2D segmentation method based on dynamic programming applied to computer aided detection in mammography. , 2004, Medical physics.

[41]  B. van Ginneken,et al.  Computer-aided diagnosis: how to move from the laboratory to the clinic. , 2011, Radiology.

[42]  Rangaraj M. Rangayyan,et al.  Measures of acutance and shape for classification of breast tumors , 1997, IEEE Transactions on Medical Imaging.

[43]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  M. Elter,et al.  CADx of mammographic masses and clustered microcalcifications: a review. , 2009, Medical physics.

[45]  Andrew Zisserman,et al.  Spatial Transformer Networks , 2015, NIPS.

[46]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[47]  Luca Maria Gambardella,et al.  Flexible, High Performance Convolutional Neural Networks for Image Classification , 2011, IJCAI.

[48]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[49]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[50]  A. Malich,et al.  CAD for mammography: the technique, results, current role and further developments , 2006, European Radiology.

[51]  Robert M. Nishikawa,et al.  Current status and future directions of computer-aided diagnosis in mammography , 2007, Comput. Medical Imaging Graph..

[52]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[53]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[54]  Koen E. A. van de Sande,et al.  Selective Search for Object Recognition , 2013, International Journal of Computer Vision.

[55]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[56]  Maryellen L. Giger,et al.  Automated seeded lesion segmentation on digital mammograms , 1998, IEEE Transactions on Medical Imaging.

[57]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[58]  Jonathan H Sunshine,et al.  How widely is computer-aided detection used in screening and diagnostic mammography? , 2010, Journal of the American College of Radiology : JACR.

[59]  N. Karssemeijer,et al.  An automatic method to discriminate malignant masses from normal tissue in digital mammograms1 , 2000, Physics in medicine and biology.

[60]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[61]  Nico Karssemeijer,et al.  Computer-Aided Diagnosis in Medical Imaging , 2001, IEEE Trans. Medical Imaging.

[62]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[63]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[64]  S. Astley,et al.  Computer-aided detection in mammography. , 2004, Clinical radiology.

[65]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

引用
Rough Sets
Lecture Notes in Computer Science
2019
Holographic Visualisation of Radiology Data and Automated Machine Learning-based Medical Image Segmentation
ArXiv
2018
The state of the art of deep learning models in medical science and their challenges
Multimedia Systems
2020
High Accuracy Thyroid Tumor Image Recognition Based on Hybrid Multiple Models Optimization
IEEE Access
2020
Assessment of Faster R-CNN in Man-Machine Collaborative Search
2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
2019
MAMMO: A Deep Learning Solution for Facilitating Radiologist-Machine Collaboration in Breast Cancer Diagnosis
ArXiv
2018
Prediction as a Rule for Unsupervised Learning in Deep Neural Networks
2017
Deep learning of symmetrical discrepancies for computer-aided detection of mammographic masses
Medical Imaging
2017
Multi-level features combined end-to-end learning for automated pathological grading of breast cancer on digital mammograms
Comput. Medical Imaging Graph.
2019
Fast few-shot transfer learning for disease identification from chest x-ray images using autoencoder ensemble
Medical Imaging
2020
Deep Neural Networks Improve Radiologists’ Performance in Breast Cancer Screening
IEEE Transactions on Medical Imaging
2019
Breast density classification in mammograms: An investigation of encoding techniques in binary-based local patterns
Comput. Biol. Medicine
2020
Encoding Clinical Priori in 3D Convolutional Neural Networks for Prostate Cancer Detection in bpMRI
ArXiv
2020
Automated Analysis of Unregistered Multi-View Mammograms With Deep Learning
IEEE Transactions on Medical Imaging
2017
Applying Data-driven Imaging Biomarker in Mammography for Breast Cancer Screening: Preliminary Study
Scientific Reports
2018
Convolutional neural network approach for enhanced capture of breast parenchymal complexity patterns associated with breast cancer risk
Medical Imaging
2017
Breast screening and artificial intelligence: an independent evaluation of two different software carried out at Valenciennes hospital
Other Conferences
2020
CycleGAN for style transfer in X-ray angiography
International Journal of Computer Assisted Radiology and Surgery
2019
Exploring Medical Data Classification with Three-Way Decision Trees
HEALTHINF
2019
Deep learning with spatiotemporal consistency for nerve segmentation in ultrasound images
ArXiv
2017