FU-Net: fast biomedical image segmentation model based on bottleneck convolution layers

Recently, the introduction of Convolutional Neural Network (CNNs) has advanced the way of solving image segmentation tasks. Semantic image segmentation has considerably benefited from employing various CNN models. The most widely used network in this field is U-Net and its different variations. However, these models require significant number of trainable parameters, floating-point operations per second, and great computational power to be trained. These factors make real-time semantic segmentation in low powered devices very hard. Therefore, in the present paper, we aim to modify particular aspects of the U-Net model to improve its performance through developing a fast U-Net (FU-Net) relying on bottleneck convolution layers in the contraction and expansion paths of the model. The proposed model can be utilized in semantic segmentation applications even on the devices with limited computational power and memory by ensuring the state-of-the-art performance. The amount of memory required by the proposed model is reduced by 23 times when compared with the original U-Net. Moreover, the modifications allowed achieving better performance. In conducted experiments, we assessed the performance of the proposed model on two biomedical image segmentation datasets, namely 2018 Data Science Bowl and ICIS 2018: Skin Lesion Analysis Towards Melanoma Detection. FU-Net demonstrated the state-of-the-art results in biomedical image segmentation, requiring the number of trainable parameters reduced by eight times compared with the original U-Net model. In addition, using bottleneck layers decreased the number of computations, resulting in nearly 30% speed-up at the training, validation and test stages. Furthermore, despite relying on fewer parameters FU-Net achieved a slight improvement of the performance in terms of pixel accuracy, Jaccard index, and dice coefficient evaluation metrics.

[1]  Tony F. Chan,et al.  Active contours without edges , 2001, IEEE Trans. Image Process..

[2]  Constantine Butakoff,et al.  Independent Histogram Pursuit for Segmentation of Skin Lesions , 2008, IEEE Transactions on Biomedical Engineering.

[3]  J J Vaquero,et al.  Applying watershed algorithms to the segmentation of clustered nuclei. , 1998, Cytometry.

[4]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[5]  Anne E Carpenter,et al.  Nucleus segmentation across imaging experiments: the 2018 Data Science Bowl , 2019, Nature Methods.

[6]  Zhidong Deng,et al.  Recent progress in semantic image segmentation , 2018, Artificial Intelligence Review.

[7]  Gwanggil Jeon,et al.  Improving resolution of medical images with deep dense convolutional neural network , 2018, Concurr. Comput. Pract. Exp..

[8]  Mohammad Sohel Rahman,et al.  MultiResUNet : Rethinking the U-Net Architecture for Multimodal Biomedical Image Segmentation , 2019, Neural Networks.

[9]  Francisco López-Ferreras,et al.  Road-Sign Detection and Recognition Based on Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[10]  Carlos Alberto Silva,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. , 2016, IEEE transactions on medical imaging.

[11]  Ehud Rivlin,et al.  Memory based active contour algorithm using pixel-level classified images for colon crypt segmentation , 2015, Comput. Medical Imaging Graph..

[12]  LinLin Shen,et al.  Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network , 2017, Sensors.

[13]  Wei Wu,et al.  A Real-Time Super-Resolution Method Based on Convolutional Neural Networks , 2019, Circuits Syst. Signal Process..

[14]  Majid Mirmehdi,et al.  Real-Time Detection and Recognition of Road Traffic Signs , 2012, IEEE Transactions on Intelligent Transportation Systems.

[15]  James Bailey,et al.  Computer-Aided Diagnosis of Melanoma Using Border- and Wavelet-Based Texture Analysis , 2012, IEEE Transactions on Information Technology in Biomedicine.

[16]  Heung-Il Suk,et al.  Deep Learning in Medical Image Analysis. , 2017, Annual review of biomedical engineering.

[17]  Jianhua Lu,et al.  Dense Convolutional Networks for Semantic Segmentation , 2019, IEEE Access.

[18]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[19]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[20]  Shuo Wen Chang,et al.  KUnet: Microscopy Image Segmentation With Deep Unet Based Convolutional Networks , 2019, 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC).

[21]  Jeremiah Neubert,et al.  Deep learning approaches to biomedical image segmentation , 2020 .

[22]  B. Mansouri,et al.  The Treatment of Actinic Keratoses-The Rule Rather Than the Exception. , 2017, JAMA dermatology.

[23]  Gwanggil Jeon,et al.  VisGraphNet: A complex network interpretation of convolutional neural features , 2021, Inf. Sci..

[24]  Julie Ann A. Salido,et al.  Using Deep Learning for Melanoma Detection in Dermoscopy Images , 2018 .

[25]  Dalin Song,et al.  Link between type 2 diabetes and Alzheimer’s disease: from epidemiology to mechanism and treatment , 2015, Clinical interventions in aging.

[26]  Bulat Ibragimov,et al.  Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks , 2017, Medical physics.