Deep Learning Techniques on Texture Analysis of Chest and Breast Images

The deep learning techniques can automatically learn texture and image context features from training data without the need of explicit feature engineering. With proper and sufficient training data, useful features can be learned to support various medical image analysis applications. In this chapter, we discuss recent deep learning studies on the analysis of chest and breast images. The specific elaborated computerized techniques are computer-aided detection, computer-aided diagnosis, and automatic semantic mapping. We show that the feature learned with the deep learning techniques can be helpful to boost the performances of these computerized applications for the analysis of medical images.

[1]  Wei Shen,et al.  Multi-crop Convolutional Neural Networks for lung nodule malignancy suspiciousness classification , 2017, Pattern Recognit..

[2]  Lubomir M. Hadjiiski,et al.  Computer-aided diagnosis of pulmonary nodules on CT scans: segmentation and classification using 3D active contours. , 2006, Medical physics.

[3]  Xiao Liu,et al.  Stacked deep polynomial network based representation learning for tumor classification with small ultrasound image dataset , 2016, Neurocomputing.

[4]  Lubomir M. Hadjiiski,et al.  Malignant and benign breast masses on 3D US volumetric images: effect of computer-aided diagnosis on radiologist accuracy. , 2007, Radiology.

[5]  Rich Caruana,et al.  Multitask Learning , 1998, Encyclopedia of Machine Learning and Data Mining.

[6]  Jan Cornelis,et al.  A novel computer-aided lung nodule detection system for CT images. , 2011, Medical physics.

[7]  Jeon-Hor Chen,et al.  Robust Texture Analysis Using Multi-Resolution Gray-Scale Invariant Features for Breast Sonographic Tumor Diagnosis , 2013, IEEE Transactions on Medical Imaging.

[8]  S. Lam,et al.  Probability of cancer in pulmonary nodules detected on first screening CT. , 2013, The New England journal of medicine.

[9]  Xia Li,et al.  Comparative evaluation of support vector machines for computer aided diagnosis of lung cancer in CT based on a multi-dimensional data set , 2013, Comput. Methods Programs Biomed..

[10]  Marleen de Bruijne,et al.  Combining Generative and Discriminative Representation Learning for Lung CT Analysis With Convolutional Restricted Boltzmann Machines , 2016, IEEE Transactions on Medical Imaging.

[11]  Jie-Zhi Cheng,et al.  Computer-aided US diagnosis of breast lesions by using cell-based contour grouping. , 2010, Radiology.

[12]  S. Armato,et al.  Automated lung segmentation for thoracic CT impact on computer-aided diagnosis. , 2004, Academic radiology.

[13]  D. Lynch,et al.  The National Lung Screening Trial: overview and study design. , 2011, Radiology.

[14]  Hon J. Yu,et al.  Selection of diagnostic features on breast MRI to differentiate between malignant and benign lesions using computer-aided diagnosis: differences in lesions presenting as mass and non-mass-like enhancement , 2009, European Radiology.

[15]  Emmanuel J. Candès,et al.  The curvelet transform for image denoising , 2002, IEEE Trans. Image Process..

[16]  Berkman Sahiner,et al.  Computer-aided characterization of mammographic masses: accuracy of mass segmentation and its effects on characterization , 2001, IEEE Transactions on Medical Imaging.

[17]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[18]  Temesguen Messay,et al.  A new computationally efficient CAD system for pulmonary nodule detection in CT imagery , 2010, Medical Image Anal..

[19]  Berkman Sahiner,et al.  Computer-aided diagnosis of pulmonary nodules on CT scans: improvement of classification performance with nodule surface features. , 2009, Medical physics.

[20]  B. van Ginneken,et al.  Pulmonary perifissural nodules on CT scans: rapid growth is not a predictor of malignancy. , 2012, Radiology.

[21]  Bai Ying Lei,et al.  Bridging Computational Features Toward Multiple Semantic Features with Multi-task Regression: A Study of CT Pulmonary Nodules , 2016, MICCAI.

[22]  Jiayu Zhou,et al.  Integrating low-rank and group-sparse structures for robust multi-task learning , 2011, KDD.

[23]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[24]  Fang-Cheng Yeh,et al.  Cell-competition algorithm: a new segmentation algorithm for multiple objects with irregular boundaries in ultrasound images. , 2005, Ultrasound in medicine & biology.

[25]  Tin Kam Ho,et al.  The Random Subspace Method for Constructing Decision Forests , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  O S Miettinen,et al.  Early lung cancer action project: a summary of the findings on baseline screening. , 2001, The oncologist.

[27]  Tomás Lozano-Pérez,et al.  A Framework for Multiple-Instance Learning , 1997, NIPS.

[28]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[29]  T. Freer,et al.  Screening mammography with computer-aided detection: prospective study of 12,860 patients in a community breast center. , 2001, Radiology.

[30]  G. Tourassi Journey toward computer-aided diagnosis: role of image texture analysis. , 1999, Radiology.

[31]  M. Masotti,et al.  Computer-aided mass detection in mammography: false positive reduction via gray-scale invariant ranklet texture features. , 2009, Medical physics.

[32]  Fang-Cheng Yeh,et al.  ACCOMP: Augmented cell competition algorithm for breast lesion demarcation in sonography. , 2010, Medical physics.

[33]  Lauge Sørensen,et al.  Quantitative Analysis of Pulmonary Emphysema Using Local Binary Patterns , 2010, IEEE Transactions on Medical Imaging.

[34]  Bram van Ginneken,et al.  Automatic detection of subsolid pulmonary nodules in thoracic computed tomography images , 2014, Medical Image Anal..

[35]  C. Langlotz RadLex: a new method for indexing online educational materials. , 2006, Radiographics : a review publication of the Radiological Society of North America, Inc.

[36]  J. Austin,et al.  Guidelines for management of small pulmonary nodules detected on CT scans: a statement from the Fleischner Society. , 2005, Radiology.

[37]  Chin-Shang Li,et al.  Distinguishing benign from malignant pulmonary nodules with helical chest CT in children with malignant solid tumors. , 2006, Radiology.

[38]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[39]  Marcos Salganicoff,et al.  Segmentation of pulmonary nodules of various densities with morphological approaches and convexity models , 2011, Medical Image Anal..

[40]  Sidong Liu,et al.  Pairwise Latent Semantic Association for Similarity Computation in Medical Imaging , 2016, IEEE Transactions on Biomedical Engineering.

[41]  J. Baker,et al.  Computer-aided classification of breast masses: performance and interobserver variability of expert radiologists versus residents. , 2011, Radiology.

[42]  Hao Chen,et al.  Standard Plane Localization in Fetal Ultrasound via Domain Transferred Deep Neural Networks , 2015, IEEE Journal of Biomedical and Health Informatics.

[43]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[44]  Bai Ying Lei,et al.  Automatic Scoring of Multiple Semantic Attributes With Multi-Task Feature Leverage: A Study on Pulmonary Nodules in CT Images , 2017, IEEE Transactions on Medical Imaging.

[45]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.

[46]  Xiuhua Guo,et al.  Computer-Aided Diagnosis for Early-Stage Lung Cancer Based on Longitudinal and Balanced Data , 2013, PloS one.

[47]  Hao Chen,et al.  Multilevel Contextual 3-D CNNs for False Positive Reduction in Pulmonary Nodule Detection , 2017, IEEE Transactions on Biomedical Engineering.

[48]  Joachim M. Buhmann,et al.  Towards weakly supervised semantic segmentation by means of multiple instance and multitask learning , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[49]  Masahiro Tsuboi,et al.  International Association for the Study of Lung Cancer/American Thoracic Society/European Respiratory Society International Multidisciplinary Classification of Lung Adenocarcinoma , 2011, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[50]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[51]  George Papandreou,et al.  Weakly- and Semi-Supervised Learning of a DCNN for Semantic Image Segmentation , 2015, ArXiv.

[52]  Ruey-Feng Chang,et al.  Automatic ultrasound segmentation and morphology based diagnosis of solid breast tumors , 2004, Breast Cancer Research and Treatment.

[53]  P. Cooperberg,et al.  Computer-aided detection in screening CT for pulmonary nodules. , 2006, AJR. American journal of roentgenology.

[54]  Daniel L. Rubin,et al.  On combining image-based and ontological semantic dissimilarities for medical image retrieval applications , 2014, Medical Image Anal..

[55]  M. Giger,et al.  Breast image analysis for risk assessment, detection, diagnosis, and treatment of cancer. , 2013, Annual review of biomedical engineering.

[56]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[57]  Bram van Ginneken,et al.  Solid, Part-Solid, or Non-Solid?: Classification of Pulmonary Nodules in Low-Dose Chest Computed Tomography by a Computer-Aided Diagnosis System , 2015, Investigative radiology.

[58]  K. Han,et al.  Breast lesions on sonograms: computer-aided diagnosis with nearly setting-independent features and artificial neural networks. , 2003, Radiology.

[59]  Bram van Ginneken,et al.  Bag-of-Frequencies: A Descriptor of Pulmonary Nodules in Computed Tomography Images , 2015, IEEE Transactions on Medical Imaging.

[60]  M. Giger,et al.  Anniversary paper: History and status of CAD and quantitative image analysis: the role of Medical Physics and AAPM. , 2008, Medical physics.

[61]  E. Hoffman,et al.  Lung image database consortium: developing a resource for the medical imaging research community. , 2004, Radiology.

[62]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[63]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[64]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[65]  Wagner Coelho A. Pereira,et al.  Analysis of Co-Occurrence Texture Statistics as a Function of Gray-Level Quantization for Classifying Breast Ultrasound , 2012, IEEE Transactions on Medical Imaging.

[66]  Hee Chan Kim,et al.  Computer-aided diagnosis of solid breast nodules: use of an artificial neural network based on multiple sonographic features , 2004, IEEE Transactions on Medical Imaging.

[67]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[68]  Takeshi Nakaura,et al.  Pulmonary nodules: estimation of malignancy at thin-section helical CT--effect of computer-aided diagnosis on performance of radiologists. , 2006, Radiology.

[69]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[70]  Hao Chen,et al.  Automatic Fetal Ultrasound Standard Plane Detection Using Knowledge Transferred Recurrent Neural Networks , 2015, MICCAI.

[71]  Kavita Garg,et al.  Lung cancer: interobserver agreement on interpretation of pulmonary findings at low-dose CT screening. , 2008, Radiology.

[72]  M. Masotti,et al.  Computer-aided detection of lung nodules via 3D fast radial transform, scale space representation, and Zernike MIP classification. , 2011, Medical physics.

[73]  Razvan Pascanu,et al.  Learning Algorithms for the Classification Restricted Boltzmann Machine , 2012, J. Mach. Learn. Res..

[74]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[75]  Yaozong Gao,et al.  Collaborative regression-based anatomical landmark detection. , 2015, Physics in medicine and biology.

[76]  André Victor Alvarenga,et al.  Complexity curve and grey level co-occurrence matrix in the texture evaluation of breast tumor on ultrasound images. , 2007, Medical physics.

[77]  Marco Das,et al.  Small pulmonary nodules: effect of two computer-aided detection systems on radiologist performance. , 2006, Radiology.

[78]  Bram van Ginneken,et al.  Automatic classification of pulmonary peri-fissural nodules in computed tomography using an ensemble of 2D views and a convolutional neural network out-of-the-box , 2015, Medical Image Anal..

[79]  A. Dirksen,et al.  The Danish Randomized Lung Cancer CT Screening Trial—Overall Design and Results of the Prevalence Round , 2009, Journal of thoracic oncology : official publication of the International Association for the Study of Lung Cancer.

[80]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[81]  Adrien Depeursinge,et al.  Predicting Visual Semantic Descriptive Terms From Radiological Image Data: Preliminary Results With Liver Lesions in CT , 2014, IEEE Transactions on Medical Imaging.

[82]  Pascal Vincent,et al.  Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion , 2010, J. Mach. Learn. Res..

[83]  Myrna C B Godoy,et al.  Subsolid pulmonary nodules and the spectrum of peripheral adenocarcinomas of the lung: recommended interim guidelines for assessment and management. , 2009, Radiology.

[84]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[85]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[86]  W. Moon,et al.  Computer‐aided diagnosis using morphological features for classifying breast lesions on ultrasound , 2008, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.

[87]  Jin Mo Goo,et al.  Pulmonary adenocarcinomas appearing as part-solid ground-glass nodules: Is measuring solid component size a better prognostic indicator? , 2015, European Radiology.

[88]  Bram van Ginneken,et al.  Pulmonary Nodule Detection in CT Images: False Positive Reduction Using Multi-View Convolutional Networks , 2016, IEEE Transactions on Medical Imaging.

[89]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[90]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[91]  Prateek Prasanna,et al.  Co-occurrence of Local Anisotropic Gradient Orientations (CoLlAGe): Distinguishing Tumor Confounders and Molecular Subtypes on MRI , 2014, MICCAI.

[92]  Chong-Wah Ngo,et al.  Evaluating bag-of-visual-words representations in scene classification , 2007, MIR '07.

[93]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[94]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[95]  Maryellen L. Giger,et al.  Automated Method for Improving System Performance of Computer-Aided Diagnosis in Breast Ultrasound , 2009, IEEE Transactions on Medical Imaging.

[96]  Charless C. Fowlkes,et al.  Contour Detection and Hierarchical Image Segmentation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[97]  Wei Shen,et al.  Learning from Experts: Developing Transferable Deep Features for Patient-Level Lung Cancer Prediction , 2016, MICCAI.

[98]  K Doi,et al.  Improvement in radiologists' detection of clustered microcalcifications on mammograms. The potential of computer-aided diagnosis. , 1990, Investigative radiology.

[99]  Geoffrey E. Hinton A Practical Guide to Training Restricted Boltzmann Machines , 2012, Neural Networks: Tricks of the Trade.

[100]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[101]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[102]  Gillian D Sanders,et al.  Accuracy of clinicians and models for estimating the probability that a pulmonary nodule is malignant. , 2013, Annals of the American Thoracic Society.

[103]  Xiang Zhang,et al.  OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks , 2013, ICLR.

[104]  A. Jemal,et al.  Cancer statistics, 2015 , 2015, CA: a cancer journal for clinicians.

[105]  Bram van Ginneken,et al.  A large-scale evaluation of automatic pulmonary nodule detection in chest CT using local image features and k-nearest-neighbour classification , 2009, Medical Image Anal..

[106]  P. Mielke,et al.  A Generalization of Cohen's Kappa Agreement Measure to Interval Measurement and Multiple Raters , 1988 .

[107]  Wei Shen,et al.  Multi-scale Convolutional Neural Networks for Lung Nodule Classification , 2015, IPMI.

[108]  M K Markey,et al.  Application of the mutual information criterion for feature selection in computer-aided diagnosis. , 2001, Medical physics.