CNL-UNet: A novel lightweight deep learning architecture for multimodal biomedical image segmentation with false output suppression

Abstract Automatic biomedical image segmentation plays an important role in speeding up disease detection and diagnosis. The rapid development of Deep Learning has shown ground-breaking improvements in this context. However, state-of-the-art networks like U-Net and SegNet often have poor performance on challenging domains. Most of the recent works were domains specific and computationally expensive. This paper proposes a novel lightweight architecture named CNL-UNet for 2D multimodal Biomedical Image Segmentation. The proposed CNL-UNet has a pre-trained encoder enriched with transfer learning techniques to learn sufficiently from the small amount of data. It has modified skip connections to reduce semantic gaps between the corresponding level of the encoder-decoder layer. Furthermore, the proposed architecture is enhanced with a novel Classifier and Localizer (CNL) module. This module provides us with additional classification and localization information with greater accuracy. Fusing this information with the segmentation output, the CNL-UNet can suppress false positives and false negatives. The proposed architcture has comparatively fewer parameters (11.5M) than U-Net (31M), SegNet (29M), and most of the recent works. Thus it is a lightweight architecture and also less prone to overfit. Besides, in the case of simple datasets, the pruned version of the CNL-UNet can be used. We evaluated our proposed architecture on multimodal biomedical image datasets, namely Chest X-ray, Dermoscopy, Microscopy, Ultrasound, and MRI images. The results demonstrate the superior performance of our proposed architecture over most of the existing networks. We have shown that our model can learn quickly, segment precisely, and automatically suppress falsely classified outputs.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Clement J. McDonald,et al.  Lung Segmentation in Chest Radiographs Using Anatomical Atlases With Nonrigid Registration , 2014, IEEE Transactions on Medical Imaging.

[3]  Jinjun Xiong,et al.  Biomedical Image Segmentation Using Fully Convolutional Networks on TrueNorth , 2018, 2018 IEEE 31st International Symposium on Computer-Based Medical Systems (CBMS).

[4]  Noel C. F. Codella,et al.  Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) , 2019, ArXiv.

[5]  David J. Evans,et al.  A parallel genetic algorithm for cell image segmentation , 2001, Electron. Notes Theor. Comput. Sci..

[6]  Asif Iqbal Khan,et al.  CoroNet: A deep neural network for detection and diagnosis of COVID-19 from chest x-ray images , 2020, Computer Methods and Programs in Biomedicine.

[7]  Xiao Xiao,et al.  MSDU-Net: A Multi-Scale Dilated U-Net for Blur Detection , 2020, Sensors.

[8]  Thomas de Lange,et al.  ResUNet++: An Advanced Architecture for Medical Image Segmentation , 2019, 2019 IEEE International Symposium on Multimedia (ISM).

[9]  Guangtai Ding,et al.  L-FCN: A lightweight fully convolutional network for biomedical semantic segmentation , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jerry L Prince,et al.  Current methods in medical image segmentation. , 2000, Annual review of biomedical engineering.

[12]  Lanfen Lin,et al.  UNet 3+: A Full-Scale Connected UNet for Medical Image Segmentation , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  Lei Ai,et al.  A large, open source dataset of stroke anatomical brain images and manual lesion segmentations , 2017, Scientific Data.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Zanoni Dias,et al.  DuaLAnet: Dual Lesion Attention Network for Thoracic Disease Classification in Chest X-Rays , 2020, 2020 International Conference on Systems, Signals and Image Processing (IWSSIP).

[16]  Hui Huang,et al.  Epileptic Seizure Detection in EEG Signals Using a Unified Temporal-Spectral Squeeze-and-Excitation Network , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[17]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[18]  Payel Ghosh,et al.  Segmentation of medical images using a genetic algorithm , 2006, GECCO.

[19]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[20]  Michael J. A. Girard,et al.  DRUNET: A Dilated-Residual U-Net Deep Learning Network to Digitally Stain Optic Nerve Head Tissues in Optical Coherence Tomography Images , 2018, Biomedical optics express.

[21]  Tuan D. Pham,et al.  DUNet: A deformable network for retinal vessel segmentation , 2018, Knowl. Based Syst..

[22]  Clement J. McDonald,et al.  Automatic Tuberculosis Screening Using Chest Radiographs , 2014, IEEE Transactions on Medical Imaging.

[23]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[24]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[25]  Maciej A Mazurowski,et al.  Radiogenomics of lower-grade glioma: algorithmically-assessed tumor shape is associated with tumor genomic subtypes and patient outcomes in a multi-institutional study with The Cancer Genome Atlas data , 2017, Journal of Neuro-Oncology.

[26]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[27]  Peter Caccetta,et al.  ResUNet-a: a deep learning framework for semantic segmentation of remotely sensed data , 2019, ISPRS Journal of Photogrammetry and Remote Sensing.

[28]  Jinxing Li,et al.  DualCheXNet: dual asymmetric feature learning for thoracic disease classification in chest X-rays , 2019, Biomed. Signal Process. Control..

[29]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[30]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[31]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Srikanth Tammina,et al.  Transfer learning using VGG-16 with Deep Convolutional Neural Network for Classifying Images , 2019, International Journal of Scientific and Research Publications (IJSRP).

[33]  Pulkit Kumar,et al.  U-Segnet: Fully Convolutional Neural Network Based Automated Brain Tissue Segmentation Tool , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[34]  Ben Glocker,et al.  Attention Gated Networks: Learning to Leverage Salient Regions in Medical Images , 2018, Medical Image Anal..

[35]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[36]  Dongqing Zhang,et al.  HeadLocNet: Deep convolutional neural networks for accurate classification and multi-landmark localization of head CTs , 2020, Medical Image Anal..

[37]  Harald Kittler,et al.  The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions , 2018, Scientific Data.

[38]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[39]  Mateusz Buda,et al.  Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm , 2019, Comput. Biol. Medicine.

[40]  Sakib Reza,et al.  TransResUNet: Improving U-Net Architecture for Robust Lungs Segmentation in Chest X-rays , 2020, 2020 IEEE Region 10 Symposium (TENSYMP).

[41]  Yujie Li,et al.  NAS-Unet: Neural Architecture Search for Medical Image Segmentation , 2019, IEEE Access.

[42]  Kunihiko Fukushima,et al.  Neocognitron: A Self-Organizing Neural Network Model for a Mechanism of Visual Pattern Recognition , 1982 .

[43]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[44]  Alexey Shvets,et al.  TernausNetV2: Fully Convolutional Network for Instance Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[45]  Jun Zhang,et al.  LU-NET: An Improved U-Net for Ventricular Segmentation , 2019, IEEE Access.

[46]  Yao Lu,et al.  RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images , 2019, IEEE Access.

[47]  Xin Yang,et al.  Joint Segmentation and Landmark Localization of Fetal Femur in Ultrasound Volumes , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).