The delineation of largely deformed brain midline using regression-based line detection network.

PURPOSE The human brain has two cerebral hemispheres that are roughly symmetric and separated by a midline, which is nearly a straight line shown in axial CT images in healthy subjects. However, brain diseases such as hematoma and tumors often cause midline shift, where the degree of shift can be regarded as a quantitative indication in clinical practice. To facilitate clinical evaluation, we need computer-aided methods to automate this quantification. Nevertheless, most existing studies focused on the landmark- or symmetry-based methods that provide only the existence of shift or its maximum distance, which could be easily affected by anatomical variability and large brain deformations. Intuitive results such as midline delineation or measurement are lacking. In this study, we focus on developing an automated and robust method based on the fully convolutional neural network for the delineation of midline in largely deformed brains. METHODS We propose a novel regression-based line detection network (RLDN) for the robust midline delineation, especially in largely deformed brains. Specifically, to improve the robustness of delineation in largely deformed brains, we regard the delineation of the midline as the skeleton extraction task and then use the multi-scale bidirectional integration module to acquire more representative features. Based on the skeleton extraction, we incorporate the regression task into it to delineate more accurate and continuous midline, especially in largely deformed brains. Our study utilized the public CQ 500 dataset (128 subjects) for training with hold-out validation on 61 subjects from a private cohort accrued from a local hospital. RESULTS The mean line distance error and F1-score were 1.17 ± 0.72 mm with 0.78 on CQ 500 test set, and 4.15 ± 3.97 mm with 0.61 on the private dataset. Besides, significant differences (p < 0.05) were observed between our method and other comparative ones on these two datasets. CONCLUSIONS This work provides a novel solution to acquire robust delineation of the midline, especially in largely deformed brains, and achieves state-of-the-art performance on the public and our private dataset, which makes it possible for automated diagnosis of relevant brain diseases in the future.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Radu Horaud,et al.  A Comprehensive Analysis of Deep Regression , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Zhuowen Tu,et al.  Holistically-Nested Edge Detection , 2015, ICCV.

[4]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[5]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Sasank Chilamkurthy,et al.  Deep learning algorithms for detection of critical findings in head CT scans: a retrospective study , 2018, The Lancet.

[7]  Tze-Yun Leong,et al.  Automatic detection and quantification of brain midline shift using anatomical marker model , 2014, Comput. Medical Imaging Graph..

[8]  Jau-Min Wong,et al.  Automatic recognition of midline shift on brain CT images , 2010, Comput. Biol. Medicine.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Guoying Zhao,et al.  SRN: Side-Output Residual Network for Object Symmetry Detection in the Wild , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Maxim Pisov,et al.  Incorporating Task-Specific Structural Knowledge into CNNs for Brain Midline Shift Detection , 2019, iMIMIC/ML-CDS@MICCAI.

[12]  Wei Shen,et al.  Hi-Fi: Hierarchical Feature Integration for Skeleton Detection , 2018, IJCAI.

[13]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Guanglin Li,et al.  Automatic estimation of midline shift in patients with cerebral glioma based on enhanced voigt model and local symmetry , 2015, Australasian Physical & Engineering Sciences in Medicine.