A parasitic metric learning net for breast mass classification based on mammography

Abstract Accurate classification of different tumors in mammography plays a critical role in the early diagnosis of breast cancer. However, owing to variations in appearance, it is a challenging task to distinguish malignant instances from benign ones. For this purpose, we train a deep convolutional neural networks (CNNs) to obtain more discriminative description of breast tissues. Benefiting from the discriminative representation, metric learning layers are proposed to further improve performance of the deep structure. The best-performing model restricts the depth of backpropagation of joint training in only the metric learning layers. Relation between metric learning layers and tradition CNNs structures seems like parasitism relationship between species, where one species, the parasite, benefits at the expense of the other. Therefore, the proposed method is named as parasitic metric learning net. To confirm veracity of our method, classification experiments on breast mass images of two widely used databases are performed. Comparing performance of the proposed method with traditional ones, competitive results are achieved. Meanwhile, the parameter updating strategy for our parasitic metric net may inspire a way of improving performance of a pre-trained CNNs model on particular medical image processing or other computer vision tasks.

[1]  Asoke K. Nandi,et al.  Toward breast cancer diagnosis based on automated segmentation of masses in mammograms , 2009, Pattern Recognit..

[2]  Defeng Wang,et al.  Automatic detection of breast cancers in mammograms using structured support vector machines , 2009, Neurocomputing.

[3]  Yunsong Li,et al.  Breast mass classification in digital mammography based on extreme learning machine , 2016, Neurocomputing.

[4]  Mariusz Bajger,et al.  Two graph theory based methods for identifying the pectoral muscle in mammograms , 2007, Pattern Recognit..

[5]  H. D. Cheng,et al.  Mass lesion detection with a fuzzy neural network , 2004, Pattern Recognit..

[6]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[7]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[8]  Leonid Karlinsky,et al.  A Region Based Convolutional Network for Tumor Detection and Classification in Breast Mammography , 2016, LABELS/DLMIA@MICCAI.

[9]  Richard H. Moore,et al.  THE DIGITAL DATABASE FOR SCREENING MAMMOGRAPHY , 2007 .

[10]  Xinbo Gao,et al.  A deep feature based framework for breast masses classification , 2016, Neurocomputing.

[11]  Nikos Dimitropoulos,et al.  Mammographic masses characterization based on localized texture and dataset fractal analysis using linear, neural and support vector machine classifiers , 2006, Artif. Intell. Medicine.

[12]  C. Combes,et al.  Parasitism: The Ecology and Evolution of Intimate Interactions , 2001 .

[13]  Hongmin Cai,et al.  Discrimination of Breast Cancer with Microcalcifications on Mammography by Deep Learning , 2016, Scientific Reports.

[14]  Jiwen Lu,et al.  Discriminative Deep Metric Learning for Face Verification in the Wild , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Shengcai Liao,et al.  Deep Metric Learning for Person Re-identification , 2014, 2014 22nd International Conference on Pattern Recognition.

[16]  Asoke K. Nandi,et al.  Development of tolerant features for characterization of masses in mammograms , 2009, Comput. Biol. Medicine.

[17]  Fei Gao,et al.  Deep Multimodal Distance Metric Learning Using Click Constraints for Image Ranking , 2017, IEEE Transactions on Cybernetics.

[18]  Xuelong Li,et al.  Mammographic mass segmentation: Embedding multiple features in vector-valued level set in ambiguous regions , 2011, Pattern Recognit..

[19]  Nico Karssemeijer,et al.  Temporal Change Analysis for Characterization of Mass Lesions in Mammography , 2007, IEEE Transactions on Medical Imaging.

[20]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[22]  Brijesh Verma,et al.  Neural Classification of Mass Abnormalities with Different Types of Features in Digital Mammography , 2006, Int. J. Comput. Intell. Appl..

[23]  W. Getz Biomass transformation webs provide a unified approach to consumer-resource modelling. , 2011, Ecology letters.

[24]  Gerald Schaefer,et al.  Thermography based breast cancer analysis using statistical features and fuzzy classification , 2009, Pattern Recognit..

[25]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[26]  Alberto Signoroni,et al.  Bacterial colony counting with Convolutional Neural Networks in Digital Microbiology Imaging , 2017, Pattern Recognit..

[27]  Gang Wang,et al.  Reconstruction-Based Metric Learning for Unconstrained Face Verification , 2015, IEEE Transactions on Information Forensics and Security.

[28]  Isabelle Bloch,et al.  Detection of masses and architectural distortions in digital breast tomosynthesis images using fuzzy and a contrario approaches , 2014, Pattern Recognit..

[29]  Lei Zhang,et al.  Cross-Domain Visual Matching via Generalized Similarity Measure and Feature Learning , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  Martyn P. Nash,et al.  Breast lesion co-localisation between X-ray and MR images using finite element modelling , 2013, Medical Image Anal..

[33]  Ling Zhang,et al.  Automated breast cancer detection and classification using ultrasound images: A survey , 2015, Pattern Recognit..

[34]  Konstantinos Kamnitsas,et al.  Multi-scale 3D convolutional neural networks for lesion segmentation in brain MRI , 2015 .

[35]  Jiwen Lu,et al.  Deep Metric Learning for Visual Tracking , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[36]  Jianping Fan,et al.  Hierarchical learning of multi-task sparse metrics for large-scale image classification , 2017, Pattern Recognit..

[37]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[38]  Meng Yang,et al.  Large-Margin Softmax Loss for Convolutional Neural Networks , 2016, ICML.

[39]  Bert Huang,et al.  Learning a Distance Metric from a Network , 2011, NIPS.

[40]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[41]  Brijesh Verma,et al.  Variable Hidden Neuron Ensemble for Mass Classification in Digital Mammograms [Application Notes] , 2013, IEEE Computational Intelligence Magazine.

[42]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[43]  Jinfeng Yi,et al.  Efficient distance metric learning by adaptive sampling and mini-batch stochastic gradient descent (SGD) , 2013, Machine Learning.

[44]  Tomaso A. Poggio,et al.  Example-Based Learning for View-Based Human Face Detection , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Qaisar Abbas,et al.  DeepCAD: A Computer-Aided Diagnosis System for Mammographic Masses Using Deep Invariant Features , 2016, Comput..

[46]  Gang Wang,et al.  Localized Multifeature Metric Learning for Image-Set-Based Face Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[47]  Xinbo Gao,et al.  Latent feature mining of spatial and marginal characteristics for mammographic mass classification , 2014, Neurocomputing.

[48]  Trevor Darrell,et al.  DeCAF: A Deep Convolutional Activation Feature for Generic Visual Recognition , 2013, ICML.

[49]  Rangaraj M. Rangayyan,et al.  Measures of acutance and shape for classification of breast tumors , 1997, IEEE Transactions on Medical Imaging.

[50]  Jitendra Malik,et al.  Region-Based Convolutional Networks for Accurate Object Detection and Segmentation , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Yongyi Yang,et al.  Pectoral muscle segmentation in mammograms based on homogenous texture and intensity deviation , 2013, Pattern Recognit..

[52]  Brijesh Verma,et al.  A novel soft cluster neural network for the classification of suspicious areas in digital mammograms , 2009, Pattern Recognit..

[53]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[54]  Robert M. Nishikawa,et al.  Microcalcification Classification Assisted by Content-Based Image Retrieval for Breast Cancer Diagnosis , 2007, 2007 IEEE International Conference on Image Processing.

[55]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .

[56]  Ian W. Ricketts,et al.  The Mammographic Image Analysis Society digital mammogram database , 1994 .

[57]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[58]  Gustavo Carneiro,et al.  Automated Mass Detection in Mammograms Using Cascaded Deep Learning and Random Forests , 2015, 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[59]  A. Jemal,et al.  Cancer statistics, 2015 , 2015, CA: a cancer journal for clinicians.