Parallel Capsule Networks for Classification of White Blood Cells

Capsule Networks (CapsNets) is a machine learning architecture proposed to overcome some of the shortcomings of convolutional neural networks (CNNs). However, CapsNets have mainly outperformed CNNs in datasets where images are small and/or the objects to identify have minimal background noise. In this work, we present a new architecture, parallel CapsNets, which exploits the concept of branching the network to isolate certain capsules, allowing each branch to identify different entities. We applied our concept to the two current types of CapsNet architectures, studying the performance for networks with different layers of capsules. We tested our design in a public, highly unbalanced dataset of acute myeloid leukaemia images (15 classes). Our experiments showed that conventional CapsNets show similar performance than our baseline CNN (ResNeXt-50) but depict instability problems. In contrast, parallel CapsNets can outperform ResNeXt-50, is more stable, and shows better rotational invariance than both, conventional CapsNets and ResNeXt-50.

[1]  Concetto Spampinato,et al.  Diagnosing Colorectal Polyps in the Wild with Capsule Networks , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[2]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Badrinath Roysam,et al.  Automated Classification of Apoptosis in Phase Contrast Microscopy Using Capsule Network , 2020, IEEE Transactions on Medical Imaging.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  I. Zlobec,et al.  Classification of colorectal tissue images from high throughput tissue microarrays by ensemble deep learning methods , 2021, Scientific Reports.

[6]  Daniel L. Rubin,et al.  Self-Attention Capsule Networks for Object Classification , 2019 .

[7]  Ulas Bagci,et al.  Capsules for Object Segmentation , 2018, ArXiv.

[8]  Karl Rohr,et al.  Inception Capsule Network for Retinal Blood Vessel Segmentation and Centerline Extraction , 2019, bioRxiv.

[9]  Su-Lin Lee,et al.  Intravascular Imaging and Computer Assisted Stenting, and Large-Scale Annotation of Biomedical Data and Expert Label Synthesis , 2017, Lecture Notes in Computer Science.

[10]  Soman K P,et al.  Breast Cancer Classification using Capsule Network with Preprocessed Histology Images , 2019, 2019 International Conference on Communication and Signal Processing (ICCSP).

[11]  Robertas Alzbutas,et al.  Convolutional capsule network for classification of breast cancer histology images , 2018, ICIAR.

[12]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[13]  K. Spiekermann,et al.  Human-level recognition of blast cells in acute myeloid leukaemia with convolutional neural networks , 2019, Nat. Mach. Intell..

[14]  Yan Shen,et al.  Dynamic Routing on Deep Neural Network for Thoracic Disease Classification and Sensitive Area Localization , 2018, MLMI@MICCAI.

[15]  Ying Fu,et al.  WBCaps: A Capsule Architecture-based Classification Model Designed for White Blood Cells Identification , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[16]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[17]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[18]  Jayanthi Sivaswamy,et al.  Glaucoma Assessment from OCT images using Capsule Network , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Shadi Albarqouni,et al.  Capsule Networks against Medical Imaging Data Challenges , 2018, CVII-STENT/LABELS@MICCAI.

[22]  Geoffrey E. Hinton,et al.  Matrix capsules with EM routing , 2018, ICLR.