Understanding Deep Convolutional Networks for Biomedical Imaging: A Practical Tutorial

Medical imaging seeks to unveil the internal structures hidden by the skin and bones to assist disease diagnosis and also treatment optimisation. In the past, processing medical images used to be a laborious task. However, the development of artificial intelligence has allowed the machine to gain a high level of understanding to perceive and extract information from biomedical images. Deep learning models, in particular, the convolutional neural networks (CNNs), were developed and implemented successfully for various biomedical applications. Therefore, it is of paramount importance for healthcare practitioners to understand the mechanisms behind the implemented CNNs to accurately interpret their outcomes. This tutorial summarises the key steps to train a functional CNNs. CNNs are usually constructed in the order of a convolution operation, ReLU, spatial pooling and followed by the fully connected layers. In addition, we have also introduced a number of preprocessing methods that target the image augmentation to combat the sparse data problem. We further explored a generative model as an augmentation method known as the generative adversarial networks (GANs), where GANs may yield new useful information to the dataset as compared to the classical augmentation.

[1]  Tien Yin Wong,et al.  Glaucoma detection based on deep convolutional neural network , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[3]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[4]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[5]  Guang Yang,et al.  DAGAN: Deep De-Aliasing Generative Adversarial Networks for Fast Compressed Sensing MRI Reconstruction , 2018, IEEE Transactions on Medical Imaging.

[6]  W. Bradley,et al.  History of medical imaging. , 2008, Proceedings of the American Philosophical Society.

[7]  Tong Zhang,et al.  Solving large scale linear prediction problems using stochastic gradient descent algorithms , 2004, ICML.

[8]  Youbao Tang,et al.  CT Image Enhancement Using Stacked Generative Adversarial Networks and Transfer Learning for Lesion Segmentation Improvement , 2018, MLMI@MICCAI.

[9]  Jian Sun,et al.  Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognition , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Jean Ponce,et al.  A Theoretical Analysis of Feature Pooling in Visual Recognition , 2010, ICML.

[11]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[12]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[13]  A. N. Kolmogorov,et al.  Foundations of the theory of probability , 1960 .

[14]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.