Deep Learning for Medical Image Processing: Overview, Challenges and Future

The health care sector is totally different from any other industry. It is a high priority sector and consumers expect the highest level of care and services regardless of cost. The health care sector has not achieved society’s expectations, even though the sector consumes a huge percentage of national budgets. Mostly, the interpretations of medical data are analyzed by medical experts. In terms of a medical expert interpreting images, this is quite limited due to its subjectivity and the complexity of the images; extensive variations exist between experts and fatigue sets in due to their heavy workload. Following the success of deep learning in other real-world applications, it is seen as also providing exciting and accurate solutions for medical imaging, and is seen as a key method for future applications in the health care sector. In this chapter, we discuss state-of-the-art deep learning architecture and its optimization when used for medical image segmentation and classification. The chapter closes with a discussion of the challenges of deep learning methods with regard to medical imaging and open research issue.

[1]  Ghassem Tofighi,et al.  DeepAD: Alzheimer’s Disease Classification via Deep Convolutional Neural Networks using MRI and fMRI , 2016, bioRxiv.

[2]  Max A. Viergever,et al.  Deep convolutional neural networks for automatic coronary calcium scoring in a screening study with low-dose chest CT , 2016, SPIE Medical Imaging.

[3]  Tal Hassner,et al.  Age and gender classification using convolutional neural networks , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[4]  Giovanni Montana,et al.  Predicting Alzheimer's disease: a neuroimaging study with 3D convolutional neural networks , 2015, ICPRAM 2015.

[5]  Nima Tajbakhsh,et al.  Automatic polyp detection in colonoscopy videos , 2017, Medical Imaging.

[6]  John A. Quinn,et al.  Deep Convolutional Neural Networks for Microscopy-Based Point of Care Diagnostics , 2016, MLHC.

[7]  Mong-Li Lee,et al.  Constrained-MSER detection of retinal pathology , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[8]  N. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Transactions on Medical Imaging.

[9]  Miguel Ángel Guevara-López,et al.  Representation learning for mammography mass lesion classification with convolutional neural networks , 2016, Comput. Methods Programs Biomed..

[10]  Ayman El-Baz,et al.  Alzheimer's disease diagnostics by adaptation of 3D convolutional network , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[11]  Jie Yang,et al.  Brain MRI segmentation with patch-based CNN approach , 2016, 2016 35th Chinese Control Conference (CCC).

[12]  Andreas Uhl,et al.  Colonic Polyp Classification with Convolutional Neural Networks , 2016, 2016 IEEE 29th International Symposium on Computer-Based Medical Systems (CBMS).

[13]  Yixuan Yuan,et al.  Deep learning for polyp recognition in wireless capsule endoscopy images , 2017, Medical physics.

[14]  Benjamin Q. Huynh,et al.  SU-D-207B-06: Predicting Breast Cancer Malignancy On DCE-MRI Data Using Pre-Trained Convolutional Neural Networks. , 2016, Medical physics.

[15]  Arif Iqbal Umar,et al.  Efficient leukocyte segmentation and recognition in peripheral blood image. , 2016, Technology and health care : official journal of the European Society for Engineering and Medicine.

[16]  Andreas Uhl,et al.  Convolutional Neural Network Architectures for the Automated Diagnosis of Celiac Disease , 2016, CARE@MICCAI.

[17]  Yuhang Dong,et al.  Evaluations of deep convolutional neural networks for automatic identification of malaria infected cells , 2017, 2017 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[18]  Dimitris K. Iakovidis,et al.  Weakly-supervised Convolutional learning for detection of inflammatory gastrointestinal lesions , 2016, 2016 IEEE International Conference on Imaging Systems and Techniques (IST).

[19]  Muhammad Imran Razzak,et al.  Accurate Microscopic Red Blood Cell Image Enhancement and Segmentation , 2015, IWBBIO.

[20]  Andreas Uhl,et al.  Exploring Deep Learning and Transfer Learning for Colonic Polyp Classification , 2016, Comput. Math. Methods Medicine.

[21]  Mong-Li Lee,et al.  Transformed Representations for Convolutional Neural Networks in Diabetic Retinopathy Screening , 2014, AAAI Workshop: Modern Artificial Intelligence for Health Analytics.

[22]  Hong Liu,et al.  Applying deep learning technology to automatically identify metaphase chromosomes using scanning microscopic images: an initial investigation , 2016, BiOS.

[23]  Jae-Ho Han,et al.  Advanced deep learning for blood vessel segmentation in retinal fundus images , 2017, 2017 5th International Winter Conference on Brain-Computer Interface (BCI).

[24]  Anubha Gupta,et al.  Overlapping cell nuclei segmentation in microscopic images using deep belief networks , 2016, ICVGIP '16.

[25]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[26]  Andrew Zisserman,et al.  Microscopy cell counting and detection with fully convolutional regression networks , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[27]  Bram van Ginneken,et al.  Towards automatic pulmonary nodule management in lung cancer screening with deep learning , 2016, Scientific Reports.

[28]  Subhashini Venugopalan,et al.  Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. , 2016, JAMA.

[29]  Nasir M. Rajpoot,et al.  Locality Sensitive Deep Learning for Detection and Classification of Nuclei in Routine Colon Cancer Histology Images , 2016, IEEE Trans. Medical Imaging.

[30]  Seong-Whan Lee,et al.  Hierarchical feature representation and multimodal fusion with deep learning for AD/MCI diagnosis , 2014, NeuroImage.

[31]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[32]  T Chandrakumar,et al.  Classifying Diabetic Retinopathy using Deep Learning Architecture , 2016 .

[33]  Renato Natal M. Jorge,et al.  Computational Vision and Medical Image Processing V : Proceedings of the 5th Eccomas Thematic Conference on Computational Vision and Medical Image Processing (VipIMAGE 2015, Tenerife, Spain, October 19-21, 2015) , 2015 .

[34]  Jordi Vitrià,et al.  Deep Learning Features for Wireless Capsule Endoscopy Analysis , 2016, CIARP.

[35]  Hiroki Nakano,et al.  Cascaded Neural Networks with Selective Classifiers and its evaluation using Lung X-ray CT Images , 2016, ArXiv.

[36]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[37]  B Huynh,et al.  MO-DE-207B-06: Computer-Aided Diagnosis of Breast Ultrasound Images Using Transfer Learning From Deep Convolutional Neural Networks. , 2016, Medical physics.

[38]  Max A. Viergever,et al.  Automatic coronary artery calcium scoring in cardiac CT angiography using paired convolutional neural networks , 2016, Medical Image Anal..

[39]  Robert J. Gillies,et al.  Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[40]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[41]  Richard H. Moore,et al.  THE DIGITAL DATABASE FOR SCREENING MAMMOGRAPHY , 2007 .

[42]  Yike Guo,et al.  Small bowel motility assessment based on fully convolutional networks and long short-term memory , 2017, Knowl. Based Syst..

[43]  Honglak Lee,et al.  An Analysis of Single-Layer Networks in Unsupervised Feature Learning , 2011, AISTATS.

[44]  Christopher Malon,et al.  Identifying histological elements with convolutional neural networks , 2008, CSTST.

[45]  Frans Coenen,et al.  Convolutional Neural Networks for Diabetic Retinopathy , 2016, MIUA.

[46]  Ge Yu,et al.  Breast tumor detection in digital mammography based on extreme learning machine , 2014, Neurocomputing.

[47]  Alexandre X. Falcão,et al.  Diagnosis of human intestinal parasites by deep learning , 2015 .

[48]  Mrinal Haloi,et al.  Improved Microaneurysm Detection using Deep Neural Networks , 2015, ArXiv.

[49]  Max A. Viergever,et al.  Automatic Coronary Calcium Scoring in Cardiac CT Angiography Using Convolutional Neural Networks , 2015, MICCAI.

[50]  Rong Zhang,et al.  Lesion detection of endoscopy images based on convolutional neural network features , 2015, 2015 8th International Congress on Image and Signal Processing (CISP).

[51]  Krzysztof Krawiec,et al.  Segmenting Retinal Blood Vessels With Deep Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[52]  N. Karssemeijer,et al.  Discriminating solitary cysts from soft tissue lesions in mammography using a pretrained deep convolutional neural network , 2017, Medical physics.

[53]  Muhammad Imran Razzak,et al.  Automatic detection of malarial parasite using microscopic blood images , 2015 .

[54]  Berkman Sahiner,et al.  Computer-aided detection system for breast masses on digital tomosynthesis mammograms: preliminary experience. , 2005, Radiology.

[55]  Dominique P. Pioletti,et al.  Computer Methods in Biomechanics and Biomedical Engineering , 2007 .

[56]  Andreas Uhl,et al.  CNN transfer learning for the automated diagnosis of celiac disease , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[57]  Hui Li,et al.  Digital mammographic tumor classification using transfer learning from deep convolutional neural networks , 2016, Journal of medical imaging.

[58]  Janne Heikkilä,et al.  Transfer Learning for Cell Nuclei Classification in Histopathology Images , 2016, ECCV Workshops.