Data Fusion Framework For The Prediction Of Early Hematoma Expansion Based On CNN

Spontaneous intracerebral hemorrhage (ICHs) is one of the common types of stroke. Patients with ICHs may bleed again in the early stage. The early hematoma expansion(HE) will increase the patient’s mortality. Clinical status and laboratory parameters can be used as risk factors for HE. In terms of image signs, HE can be predicted based on the presence of independently predictable computed tomography(CT) signs. However, the sensitivity of these signs is not very high. Therefore, we propose an automatic framework of bimodal data fusion for the prediction of HE. The first pathway is a channel-attention-based encoder which extracts CT image features of brain hematoma and focuses on the lesion site. The second input is clinical parameters and this pathway only consists of transposed convolution. Finally, the outputs of two pathways are concatenated in the channel dimension. The experimental results indicate that our automatic framework based on CNN is superior to previous imaging-based methods, especially in terms of sensitivity. To the best of our knowledge, this is the first study that uses a fully automatic method to predict the early HE in patients with ICHs. Our framework achieved a comparable accuracy with the state-of-the-art method.

[1]  Qi Li,et al.  Black Hole Sign: Novel Imaging Marker That Predicts Hematoma Growth in Patients With Intracerebral Hemorrhage , 2016, Stroke.

[2]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[3]  Qi Li,et al.  Blend Sign on Computed Tomography: Novel and Reliable Predictor for Early Hematoma Growth in Patients With Intracerebral Hemorrhage , 2015, Stroke.

[4]  Li Yu,et al.  Ψ-Net: Focusing on the border areas of intracerebral hemorrhage on CT images , 2020, Comput. Methods Programs Biomed..

[5]  Francesco Visin,et al.  A guide to convolution arithmetic for deep learning , 2016, ArXiv.

[6]  Pietro Liò,et al.  A Multi-modal Convolutional Neural Network Framework for the Prediction of Alzheimer’s Disease , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[7]  Eric E. Smith,et al.  Defining hematoma expansion in intracerebral hemorrhage , 2011, Neurology.

[8]  L. Sugrue,et al.  Hybrid 3D/2D Convolutional Neural Network for Hemorrhage Evaluation on Head CT , 2018, American Journal of Neuroradiology.

[9]  S. Greenberg,et al.  Association Between Hypodensities Detected by Computed Tomography and Hematoma Expansion in Patients With Intracerebral Hemorrhage. , 2016, JAMA neurology.

[10]  Paul Suetens,et al.  Prediction of final infarct volume from native CT perfusion and treatment parameters using deep learning , 2018, Medical Image Anal..

[11]  Sebastian J. Schlecht,et al.  SurvivalNet: Predicting patient survival from diffusion weighted magnetic resonance images using cascaded fully convolutional and 3D Convolutional Neural Networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[12]  Fa-jin Lv,et al.  Intraventricular Hemorrhage and Early Hematoma Expansion in Patients with Intracerebral Hemorrhage , 2015, Scientific Reports.

[13]  Eufrozina Selariu,et al.  Swirl sign in intracerebral haemorrhage: definition, prevalence, reliability and prognostic value , 2012, BMC Neurology.

[14]  Johannes Wikner,et al.  Comparison of ABC/2 estimation technique to computer-assisted planimetric analysis in warfarin-related intracerebral parenchymal hemorrhage. , 2006, Stroke.

[15]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[16]  Bram van Ginneken,et al.  Intracerebral Haemorrhage Segmentation in Non-Contrast CT , 2019, Scientific Reports.

[17]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[18]  Qi Li,et al.  Island Sign: An Imaging Predictor for Early Hematoma Expansion and Poor Outcome in Patients With Intracerebral Hemorrhage , 2017, Stroke.

[19]  Yunjun Yang,et al.  Prediction of hematoma expansion in spontaneous intracerebral hemorrhage using support vector machine , 2019, EBioMedicine.

[20]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.