GCHA-Net: Global context and hybrid attention network for automatic liver segmentation

Liver segmentation is a critical step in liver cancer diagnosis and surgical planning. The U-Net's architecture is one of the most efficient deep networks for medical image segmentation. However, the continuous downsampling operators in U-Net causes the loss of spatial information. To solve these problems, we propose a global context and hybrid attention network, called GCHA-Net, to adaptive capture the structural and detailed features. To capture the global features, a global attention module (GAM) is designed to model the channel and positional dimensions of the interdependencies. To capture the local features, a feature aggregation module (FAM) is designed, where a local attention module (LAM) is proposed to capture the spatial information. LAM can make our model focus on the local liver regions and suppress irrelevant information. The experimental results on the dataset LiTS2017 show that the dice per case (DPC) value and dice global (DG) value of liver were 96.5% and 96.9%, respectively. Compared with the state-of-the-art models, our model has superior performance in liver segmentation. Meanwhile, we test the experiment results on the 3Dircadb dataset, and it shows our model can obtain the highest accuracy compared with the closely related models. From these results, it can been seen that the proposed model can effectively capture the global context information and build the correlation between different convolutional layers. The code is available at the website: https://github.com/HuaxiangLiu/GCAU-Net.

[1]  Jun Liu,et al.  Active contour driven by adaptive-scale local-energy signed pressure force function based on bias correction for medical image segmentation , 2022, IET Image Processing.

[2]  Ali Asghar Heidari,et al.  Directional mutation and crossover boosted ant colony optimization with application to COVID-19 X-ray image segmentation , 2022, Computers in Biology and Medicine.

[3]  Zongda Wu,et al.  How to ensure the confidentiality of electronic medical records on the cloud: A technical perspective , 2022, Comput. Biol. Medicine.

[4]  Ali Asghar Heidari,et al.  Multilevel threshold image segmentation for COVID-19 chest radiography: A framework using horizontal and vertical multiverse optimization , 2022, Computers in Biology and Medicine.

[5]  M. A. Mahmoud,et al.  An Automated Image Segmentation and Useful Feature Extraction Algorithm for Retinal Blood Vessels in Fundus Images , 2022, Electronics.

[6]  Mohamed Elhoseny,et al.  Integrating Elman recurrent neural network with particle swarm optimization algorithms for an improved hybrid training of multidisciplinary datasets , 2021, Expert Syst. Appl..

[7]  Yong Xia,et al.  Multiscale attention guided U-Net architecture for cardiac segmentation in short-axis MRI images , 2021, Comput. Methods Programs Biomed..

[8]  Zongda Wu,et al.  Time series classification based on multi-feature dictionary representation and ensemble learning , 2021, Expert Syst. Appl..

[9]  Bang Jun Lei,et al.  A contour-aware feature-merged network for liver segmentation based on shape prior knowledge , 2021, Neurocomputing.

[10]  Mazin Abed Mohammed,et al.  Comprehensive review of retinal blood vessel segmentation and classification techniques: intelligent solutions for green computing in medical images, current challenges, open issues, and knowledge gaps in fundus medical images , 2021, Network Modeling Analysis in Health Informatics and Bioinformatics.

[11]  Jinke Wang,et al.  SAR-U-Net: Squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in Computed Tomography , 2021, Comput. Methods Programs Biomed..

[12]  Jun Liu,et al.  Fuzzy region-based active contour driven by global and local fitting energy for image segmentation , 2021, Appl. Soft Comput..

[13]  Hesheng Liu,et al.  Region-edge-based active contours driven by hybrid and local fuzzy region-based energy for image segmentation , 2021, Inf. Sci..

[14]  Jiangxiong Fang,et al.  Localised edge-region-based active contour for medical image segmentation , 2021, IET Image Process..

[15]  Zongda Wu,et al.  A dummy-based user privacy protection approach for text information retrieval , 2020, Knowl. Based Syst..

[16]  Song Li,et al.  Bottleneck feature supervised U-Net for pixel-wise liver and tumor segmentation , 2020, Expert Syst. Appl..

[17]  Jianming Liang,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[18]  Mahmood Fathy,et al.  Bi-Directional ConvLSTM U-Net with Densley Connected Convolutions , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[19]  Jun Liu,et al.  Active Contour Driven by Weighted Hybrid Signed Pressure Force for Image Segmentation , 2019, IEEE Access.

[20]  Giancarlo Mauri,et al.  USE-Net: incorporating Squeeze-and-Excitation blocks into U-Net for prostate zonal segmentation of multi-institutional MRI datasets , 2019, Neurocomputing.

[21]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[22]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Yadong Wang,et al.  Low‐rank and sparse decomposition based shape model and probabilistic atlas for automatic pathological organ segmentation , 2017, Medical Image Anal..

[24]  Jialin Peng,et al.  Automatic 3D liver segmentation based on deep learning and globally optimized surface evolution , 2016, Physics in medicine and biology.

[25]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Yi Yang,et al.  Attention to Scale: Scale-Aware Semantic Image Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[28]  Xinjian Chen,et al.  Automatic Liver Segmentation Based on Shape Constraints and Deformable Graph Cut in CT Images , 2015, IEEE Transactions on Image Processing.

[29]  Salvatore Calcagno,et al.  Image Contrast Enhancement by Distances Among Points in Fuzzy Hyper-Cubes , 2015, CAIP.

[30]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Baohua Zhang,et al.  The study and application of the improved region growing algorithm for liver segmentation , 2014 .

[33]  Zidong Wang,et al.  Image-Based Quantitative Analysis of Gold Immunochromatographic Strip via Cellular Neural Network Approach , 2014, IEEE Transactions on Medical Imaging.

[34]  B. van Ginneken,et al.  Computer-aided diagnosis: how to move from the laboratory to the clinic. , 2011, Radiology.

[35]  Jianwu Xu,et al.  Computer-aided measurement of liver volumes in CT by means of geodesic active contour segmentation coupled with level-set algorithms. , 2010, Medical physics.

[36]  Mazin Abed Mohammed,et al.  Hybridizing Convolutional Neural Network for Classification of Lung Diseases , 2022, Int. J. Swarm Intell. Res..

[37]  Jie Zhou,et al.  Recognition of Imbalanced Epileptic EEG Signals by a Graph-Based Extreme Learning Machine , 2021, Wirel. Commun. Mob. Comput..

[38]  Jaroslav Frnda,et al.  Incorporating Artificial Fish Swarm in Ensemble Classification Framework for Recurrence Prediction of Cervical Cancer , 2021, IEEE Access.

[39]  Ümit Budak,et al.  Cascaded deep convolutional encoder-decoder neural networks for efficient liver tumor segmentation. , 2019, Medical hypotheses.

[40]  Y. Matsuoka,et al.  Robotics for surgery. , 1999, Annual review of biomedical engineering.