Fully-automated functional region annotation of liver via a 2.5D class-aware deep neural network with spatial adaptation

BACKGROUND AND OBJECTIVE Automatic functional region annotation of liver should be very useful for preoperative planning of liver resection in the clinical domain. However, many traditional computer-aided annotation methods based on anatomical landmarks or the vascular tree often fail to extract accurate liver segments. Furthermore, these methods are difficult to fully automate and thus remain time-consuming. To address these issues, in this study we aim to develop a fully-automated approach for functional region annotation of liver using deep learning based on 2.5D class-aware deep neural networks with spatial adaptation. METHODS 112 CT scans were fed into our 2.5D class-aware deep neural network with spatial adaptation for automatic functional region annotation of liver. The proposed model was built upon the ResU-net architecture, which adaptively selected a stack of adjacent CT slices as input and, generating masks corresponding to the center slice, automatically annotated the liver functional region from abdominal CT images. Furthermore, to minimize the problem of class-level ambiguity between different slices, the anatomy class-specific information was used. RESULTS The final algorithm performance for automatic functional region annotation of liver showed large overlap with that of manual reference segmentation. The dice similarity coefficient of hepatic segments achieved high scores and an average dice score of 0.882. The entire calculation time was quite fast (~5 s) compared to manual annotation (~2.5 hours). CONCLUSION The proposed models described in this paper offer a feasible solution for fully-automated functional region annotation of liver from CT images. The experimental results demonstrated that the proposed method can attain a high average dice score and low computational time. Therefore, this work should allow for improved liver surgical resection planning by our precise segmentation and simple fully-automated method.

[1]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[2]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[3]  J. Duncan,et al.  Deep learning for liver tumor diagnosis part I: development of a convolutional neural network classifier for multi-phasic MRI , 2019, European Radiology.

[4]  Ronald M. Summers,et al.  A large annotated medical image dataset for the development and evaluation of segmentation algorithms , 2019, ArXiv.

[5]  Heinz-Otto Peitgen,et al.  Clinical relevance of model based computer-assisted diagnosis and therapy , 2008, SPIE Medical Imaging.

[6]  Ronald M. Summers,et al.  A New 2.5D Representation for Lymph Node Detection Using Random Sets of Deep Convolutional Neural Network Observations , 2014, MICCAI.

[7]  Xiaopeng Yang,et al.  Segmentation of liver and vessels from CT images and classification of liver segments for preoperative liver surgical planning in living donor liver transplantation , 2017, Comput. Methods Programs Biomed..

[8]  Jia Gu,et al.  Superpixel-based and boundary-sensitive convolutional neural network for automated liver segmentation , 2018, Physics in medicine and biology.

[9]  Gérard G. Medioni,et al.  Pose-Aware Face Recognition in the Wild , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Thomas Lehnert,et al.  Virtual planning of liver resections: image processing, visualization and volumetric evaluation , 1999, Int. J. Medical Informatics.

[12]  Frans Vos,et al.  A hybrid segmentation method for partitioning the liver based on 4D DCE-MR images , 2018, Medical Imaging.

[13]  Milan Sonka,et al.  Liver segment approximation in CT data for surgical resection planning , 2004, SPIE Medical Imaging.

[14]  Bernhard Preim,et al.  Analysis of vasculature for liver surgical planning , 2002, IEEE Transactions on Medical Imaging.

[15]  Shi-zhong Yang,et al.  Feature Matching Conditional GAN for Fast Radio Burst Localization with Cluster-fed Telescope , 2019, The Astrophysical Journal.

[16]  Dário Augusto Borges Oliveira,et al.  Automatic Couinaud Liver and Veins Segmentation from CT Images , 2008, BIOSIGNALS.

[17]  Decheng Wu,et al.  Energy-Efficient Reconstruction Method for Transmission Lines Galloping With Conditional Generative Adversarial Network , 2020, IEEE Access.

[18]  Shuicheng Yan,et al.  Fine-grained Human-centric Tracklet Segmentation with Single Frame Supervision. , 2019, IEEE transactions on pattern analysis and machine intelligence.

[19]  Hans-Peter Meinzer,et al.  Computerized planning of liver surgery - an overview , 2002, Comput. Graph..

[20]  N. Ayache,et al.  Fully Automatic Anatomical, Pathological, and Functional Segmentation from CT Scans for Hepatic Surgery , 2001 .

[21]  Gang Wang,et al.  Functional Region Annotation of Liver CT Image Based on Vascular Tree , 2016, BioMed research international.

[22]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[23]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[24]  Ying Ju,et al.  A Simplified Method to Segment Liver According to Couinaud's Classification , 2007, 2007 1st International Conference on Bioinformatics and Biomedical Engineering.

[25]  Antoine Vacavant,et al.  Automatic segmentation methods for liver and hepatic vessels from CT and MRI volumes, applied to the Couinaud scheme , 2019, Comput. Biol. Medicine.