Mass detection in digital breast tomosynthesis data using convolutional neural networks and multiple instance learning

Digital breast tomosynthesis (DBT) was developed in the field of breast cancer screening as a new tomographic technique to minimize the limitations of conventional digital mammography breast screening methods. A computer-aided detection (CAD) framework for mass detection in DBT has been developed and is described in this paper. The proposed framework operates on a set of two-dimensional (2D) slices. With plane-to-plane analysis on corresponding 2D slices from each DBT, it automatically learns complex patterns of 2D slices through a deep convolutional neural network (DCNN). It then applies multiple instance learning (MIL) with a randomized trees approach to classify DBT images based on extracted information from 2D slices. This CAD framework was developed and evaluated using 5040 2D image slices derived from 87 DBT volumes. The empirical results demonstrate that this proposed CAD framework achieves much better performance than CAD systems that use hand-crafted features and deep cardinality-restricted Bolzmann machines to detect masses in DBTs.

[1]  Zhuowen Tu,et al.  Multiple clustered instance learning for histopathology cancer image classification, segmentation and clustering , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[3]  Zhuowen Tu,et al.  Weakly supervised histopathology cancer image segmentation and classification , 2014, Medical Image Anal..

[4]  Xinbo Gao,et al.  A deep feature based framework for breast masses classification , 2016, Neurocomputing.

[5]  N Karssemeijer,et al.  Use of border information in the classification of mammographic masses , 2006, Physics in medicine and biology.

[6]  Berkman Sahiner,et al.  Computer-aided detection system for breast masses on digital tomosynthesis mammograms: preliminary experience. , 2005, Radiology.

[7]  Andrew D. A. Maidment,et al.  Effect of denoising on the quality of reconstructed images in digital breast tomosynthesis , 2013, Medical Imaging.

[8]  Anselmo Cardoso de Paiva,et al.  Classification of breast regions as mass and non-mass based on digital mammograms using taxonomic indexes and SVM , 2015, Comput. Biol. Medicine.

[9]  I. Sechopoulos.  A review of breast tomosynthesis. Part II. Image reconstruction, processing and analysis, and advanced applications. , 2013, Medical physics.

[10]  Makoto Yoshizawa,et al.  Mass detection using deep convolutional neural network for mammographic computer-aided diagnosis , 2016, 2016 55th Annual Conference of the Society of Instrument and Control Engineers of Japan (SICE).

[11]  Ingvar Andersson,et al.  Long-term effects of mammography screening: updated overview of the Swedish randomised trials , 2002, The Lancet.

[12]  Horst Bischof,et al.  MIForests: Multiple-Instance Learning with Randomized Trees , 2010, ECCV.

[13]  Lubomir M. Hadjiiski,et al.  Mass detection in digital breast tomosynthesis: Deep convolutional neural network with transfer learning from mammography. , 2016, Medical physics.

[14]  Thomas Frauenfelder,et al.  Deep Learning in Mammography: Diagnostic Accuracy of a Multipurpose Image Analysis Software in the Detection of Breast Cancer , 2017, Investigative radiology.

[15]  D. Kopans,et al.  Digital tomosynthesis in breast imaging. , 1997, Radiology.

[16]  Gustavo Carneiro,et al.  of Deep Learning Methods in Mammography, Cardiovascular, and Microscopy Image Analysis , 2017 .

[17]  Ryan P. Adams,et al.  Cardinality Restricted Boltzmann Machines , 2012, NIPS.

[18]  Robert M. Nishikawa,et al.  A multi-scale 3D radial gradient filter for computerized mass detection in digital tomosynthesis breast images , 2005 .

[19]  Ronald M. Summers,et al.  Anatomy-specific classification of medical images using deep convolutional nets , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[20]  Berkman Sahiner,et al.  Computer-aided detection of masses in digital tomosynthesis mammography: comparison of three approaches. , 2008, Medical physics.

[21]  Isabelle Bloch,et al.  Detection of masses and architectural distortions in digital breast tomosynthesis images using fuzzy and a contrario approaches , 2014, Pattern Recognit..

[22]  Zhi-Hua Zhou,et al.  Multi-instance multi-label learning , 2008, Artif. Intell..

[23]  D. Miglioretti,et al.  Individual and Combined Effects of Age, Breast Density, and Hormone Replacement Therapy Use on the Accuracy of Screening Mammography , 2003, Annals of Internal Medicine.

[24]  Xiaohui Xie,et al.  Deep Multi-instance Networks with Sparse Label Assignment for Whole Mammogram Classification , 2016, bioRxiv.

[25]  Zhuowen Tu,et al.  Context-Constrained Multiple Instance Learning for Histopathology Image Segmentation , 2012, MICCAI.

[26]  Thomas Hofmann,et al.  Support Vector Machines for Multiple-Instance Learning , 2002, NIPS.

[27]  Thomas G. Dietterich,et al.  Solving the Multiple Instance Problem with Axis-Parallel Rectangles , 1997, Artif. Intell..

[28]  Yan Xu,et al.  Deep learning of feature representation with multiple instance learning for medical image analysis , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[29]  Gustavo Carneiro,et al.  Combining Deep Learning and Structured Prediction for Segmenting Masses in Mammograms , 2017, Deep Learning and Convolutional Neural Networks for Medical Image Computing.

[30]  Berkman Sahiner,et al.  Application of boundary detection information in breast tomosynthesis reconstruction. , 2007, Medical physics.

[31]  Gary Doran,et al.  A theoretical and empirical analysis of support vector machine methods for multiple-instance classification , 2014, Machine Learning.

[32]  D. Kopans,et al.  Digital Breast Tomosynthesis: State of the Art. , 2015, Radiology.

[33]  Yong Man Ro,et al.  Latent feature representation with 3-D multi-view deep convolutional neural network for bilateral analysis in digital breast tomosynthesis , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[34]  Nico Karssemeijer,et al.  Mass detection in reconstructed digital breast tomosynthesis volumes with a computer-aided detection system trained on 2D mammograms. , 2013, Medical physics.

[35]  M. Giger,et al.  Computerized mass detection for digital breast tomosynthesis directly from the projection images. , 2006, Medical physics.

[36]  Mathieu Lamard,et al.  Multiple-Instance Learning for Anomaly Detection in Digital Mammography , 2016, IEEE Transactions on Medical Imaging.

[37]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.