KISEG: A Three-Stage Segmentation Framework for Multi-level Acceleration of Chest CT Scans from COVID-19 Patients

During the ongoing COVID-19 outbreak, it is critical to perform an accurate diagnosis of COVID-19 pneumonia by computed tomography (CT). Although chest lesion segmentation plays a pivotal role in computer-aided diagnosis (CAD), accuracy is hindered by the lack of a publicly available CT dataset with manual annotation. In addition, for clinical deployment, how to balance the accuracy versus efficiency for the semantic segmentation model remains challenging. To address these issues, we construct the first CT dataset of COVID-19 pneumonia with pixel-wise lesion annotations. We propose a three-stage framework, called KISEG (Key and Intermediate frame of Segmentation), to enhance performance on serial CT image segmentation with multi-level acceleration. We first take a policy to divide frames of serial CT into two groups, key frames and intermediate frames. Then KISEG employs a main model (accurate but cumbersome) for key frame segmentation. And third, an auxiliary model was employed for intermediate frame segmentation with incorporating the information of key frames during the fusion module. Moreover, we propose a Gaussian Kernel Dropout for data augmentation. Experiments on our dataset demonstrate that our proposed KISEG achieves comparable accuracy with state-of-the-art methods and fewer GFLOPs, speeding up from 2.88\(\times \) to 9.16\(\times \). This dataset has been made public for further research of COVID-19 for AI community, released on http://ncov-ai.big.ac.cn/download.

[1]  Suyog Gupta,et al.  To prune, or not to prune: exploring the efficacy of pruning for model compression , 2017, ICLR.

[2]  Geoffrey E. Hinton,et al.  Distilling the Knowledge in a Neural Network , 2015, ArXiv.

[3]  Holger Schwenk,et al.  Supervised Learning of Universal Sentence Representations from Natural Language Inference Data , 2017, EMNLP.

[4]  Kaiming He,et al.  Focal Loss for Dense Object Detection , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Jian Sun,et al.  DFANet: Deep Feature Aggregation for Real-Time Semantic Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Manvel Avetisian,et al.  Radiologist-Level Stroke Classification on Non-contrast CT Scans with Deep U-Net , 2019, MICCAI.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  W. Liang,et al.  Clinically Applicable AI System for Accurate Diagnosis, Quantitative Measurements, and Prognosis of COVID-19 Pneumonia Using Computed Tomography , 2020, Cell.

[9]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[12]  Eugenio Culurciello,et al.  ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation , 2016, ArXiv.

[13]  Chen Chen,et al.  3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI , 2019, MICCAI.

[14]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[15]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.