A novel fused convolutional neural network for biomedical image classification

AbstractWith the advent of biomedical imaging technology, the number of captured and stored biomedical images is rapidly increasing day by day in hospitals, imaging laboratories and biomedical institutions. Therefore, more robust biomedical image analysis technology is needed to meet the requirement of the diagnosis and classification of various kinds of diseases using biomedical images. However, the current biomedical image classification methods and general non-biomedical image classifiers cannot extract more compact biomedical image features or capture the tiny differences between similar images with different types of diseases from the same category. In this paper, we propose a novel fused convolutional neural network to develop a more accurate and highly efficient classifier for biomedical images, which combines shallow layer features and deep layer features from the proposed deep neural network architecture. In the analysis, it was observed that the shallow layers provided more detailed local features, which could distinguish different diseases in the same category, while the deep layers could convey more high-level semantic information used to classify the diseases among the various categories. A detailed comparison of our approach with traditional classification algorithms and popular deep classifiers across several public biomedical image datasets showed the superior performance of our proposed method for biomedical image classification. In addition, we also evaluated the performance of our method in modality classification of medical images using the ImageCLEFmed dataset. Graphical abstractThe graphical abstract shows the fused, deep convolutional neural network architecture proposed for biomedical image classification. In the architecture, we can clearly see the feature-fusing process going from shallow layers and the deep layers.

[1]  S MarcusDaniel,et al.  Open Access Series of Imaging Studies (OASIS) , 2007 .

[2]  Manohar Paluri,et al.  Metric Learning with Adaptive Density Discrimination , 2015, ICLR.

[3]  Dimitri Van De Ville,et al.  Near-Affine-Invariant Texture Learning for Lung Tissue Analysis Using Isotropic Wavelet Frames , 2012, IEEE Transactions on Information Technology in Biomedicine.

[4]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Xiaogang Wang,et al.  Medical image classification with convolutional neural network , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[7]  Pol Cirujeda,et al.  Medical Image Classification via 2D color feature based Covariance Descriptors , 2015, CLEF.

[8]  Shihui Ying,et al.  Histopathological Image Classification With Color Pattern Random Binary Hashing-Based PCANet and Matrix-Form Classifier , 2017, IEEE Journal of Biomedical and Health Informatics.

[9]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[10]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Henning Müller,et al.  Overview of the ImageCLEF 2015 Medical Classification Task , 2015, CLEF.

[13]  David Dagan Feng,et al.  Transfer learning of a convolutional neural network for HEp-2 cell image classification , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[14]  Michael I. Jordan,et al.  Deep Transfer Learning with Joint Adaptation Networks , 2016, ICML.

[15]  Qaisar Abbas,et al.  Automatic recognition of severity level for diagnosis of diabetic retinopathy using deep visual features , 2017, Medical & Biological Engineering & Computing.

[16]  Philip Heng Wai Leong,et al.  Convolutional Neural Networks for Subfigure Classification , 2015, CLEF.

[17]  Christoph M. Friedrich,et al.  FHDO Biomedical Computer Science Group at Medical Classification Task of ImageCLEF 2015 , 2015, CLEF.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Mehmet A. Orgun,et al.  A novel end-to-end classifier using domain transferred deep convolutional neural networks for biomedical images , 2017, Comput. Methods Programs Biomed..

[20]  Yilmaz Kaya,et al.  A novel approach for SEMG signal classification with adaptive local binary patterns , 2015, Medical & Biological Engineering & Computing.

[21]  Subrahmanyam Murala,et al.  Peak Valley Edge Patterns: A New Descriptor for Biomedical Image Indexing and Retrieval , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Shiv Ram Dubey,et al.  Local Bit-Plane Decoded Pattern: A Novel Feature Descriptor for Biomedical Image Retrieval , 2016, IEEE Journal of Biomedical and Health Informatics.

[23]  Lei Wang,et al.  HEp-2 Cell Image Classification with Convolutional Neural Networks , 2014, 2014 1st Workshop on Pattern Recognition Techniques for Indirect Immunofluorescence Images.

[24]  Heng Huang,et al.  Large Margin Local Estimate With Applications to Medical Image Classification , 2015, IEEE Transactions on Medical Imaging.

[25]  Henning Müller,et al.  Evaluating performance of biomedical image retrieval systems - An overview of the medical image retrieval task at ImageCLEF 2004-2013 , 2015, Comput. Medical Imaging Graph..

[26]  Xiaogang Wang,et al.  Factors in Finetuning Deep Model for Object Detection with Long-Tail Distribution , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  David Dagan Feng,et al.  X-ray image classification using domain transferred convolutional neural networks and local sparse spatial pyramid , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[28]  Valerio Persico,et al.  Big Data for Health , 2019, Encyclopedia of Big Data Technologies.

[29]  John G. Csernansky,et al.  Open Access Series of Imaging Studies (OASIS): Cross-sectional MRI Data in Young, Middle Aged, Nondemented, and Demented Older Adults , 2007, Journal of Cognitive Neuroscience.

[30]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  R. J. Ramteke,et al.  Modality Based Medical Image Classification , 2016 .

[32]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.