Compact Convolutional Neural Networks for Pterygium Classification using Transfer Learning

Pterygium is one of the eye diseases that are prevalent among the workers who are frequently exposed to sunlight such as farmers, construction workers and fishermen. It is an eye disease that can be screened easily by health practitioners. However, most of the previously mentioned workers are rarely aware of the pterygium existence. Hence, health practitioners usually visit them to perform basic health checkup that includes eye disease screening. Due to many tests that need to be performed for each checkup cycle, a modern tool is required to make the screening process faster. As a result, this paper discusses a compact convolutional neural networks (CNN) approach to pterygium classification using transfer learning. Its architecture consists of only two layers of CNN and two layers of fully connected (FC) components. Rectified linear unit is used as the activation function except for the last FC layer, which utilizes Softmax function. The weights and biases are transferred from the first two layers of VGG-M architecture. Three regularization methods were experimented that include local response normalization, batch normalization and dropout. The best network configuration in term of accuracy with 0.9833 value is obtained by using local response normalization with dropout. On the other hand, the best area under the curve performance of 0.9865 is achieved by using batch normalization and dropout. Therefore, the developed compact system has managed to classify well the pterygium image taken from the frontal view.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  David Beymer,et al.  Lung tissue characterization for emphysema differential diagnosis using deep convolutional neural networks , 2019, Medical Imaging.

[3]  Elizabeth A. Krupinski,et al.  Missed cancer and visual search of mammograms: what feature-based machine-learning can tell us that deep-convolution learning cannot , 2019, Medical Imaging.

[4]  Amir Shmuel,et al.  Using Deep Learning Algorithms to Automatically Identify the Brain MRI Contrast: Implications for Managing Large Databases , 2018, Neuroinformatics.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Sean R. Anderson,et al.  Compact Deep Neural Networks for Computationally Efficient Gesture Classification From Electromyography Signals , 2018, 2018 7th IEEE International Conference on Biomedical Robotics and Biomechatronics (Biorob).

[7]  Philippe Burlina,et al.  Automated detection of erythema migrans and other confounding skin lesions via deep learning , 2019, Comput. Biol. Medicine.

[8]  Mohd Asyraf Zulkifley,et al.  Robust single object tracker based on kernelled patch of a fixed RGB camera , 2016 .

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[12]  Lin Yang,et al.  MDNet: A Semantically and Visually Interpretable Medical Image Diagnosis Network , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Mohd Asyraf Zulkifley,et al.  Pterygium-Net: a deep learning approach to pterygium detection and localization , 2019, Multimedia Tools and Applications.

[14]  Niki Trigoni,et al.  Multiple-Model Fully Convolutional Neural Networks for Single Object Tracking on Thermal Infrared Video , 2018, IEEE Access.

[15]  Shang-Hong Lai,et al.  A Compact Deep Learning Model for Robust Facial Expression Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[16]  William Moran,et al.  Robust hierarchical multiple hypothesis tracker for multiple object tracking , 2012, 2012 19th IEEE International Conference on Image Processing.

[17]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[18]  Mohd Asyraf Zulkifley,et al.  Two Streams Multiple-Model Object Tracker for Thermal Infrared Video , 2019, IEEE Access.

[19]  Paul Sajda,et al.  Compact convolutional neural networks for classification of asynchronous steady-state visual evoked potentials , 2018, Journal of neural engineering.

[20]  Alberto Quattrini Li,et al.  MDNet: Multi-Patch Dense Network for Coral Classification , 2018, OCEANS 2018 MTS/IEEE Charleston.