Left Atrial Appendage Segmentation Using Fully Convolutional Neural Networks and Modified Three-Dimensional Conditional Random Fields

Thrombosis has become a global disease threatening human health. The left atrial appendage (LAA) is a major source of thrombosis in patients with atrial fibrillation (AF). Positive correlation exists between LAA volume and AF risk. LAA morphology has been suggested to influence thromboembolic risk in AF patients and to help predict thromboembolic events in low-risk patient groups. Automatic segmentation of LAA can greatly help physicians diagnose AF. In consideration of the large anatomical variations of the LAA, we proposed a robust method for automatic LAA segmentation on computed tomographic angiography (CTA) data using fully convolutional neural networks with three-dimensional (3–D) conditional random fields (CRFs). After manual localization of ROI of LAA, we adopted the FCN in natural image segmentation and transferred their learned models by fine-tuning the networks to segment each 2–D LAA slice. Subsequently, we used a modified dense 3–D CRF that accounts for the 3–D spatial information and larger contextual information to refine the segmentations of all slices. Our method was evaluated on 150 sets of CTA data using five-fold cross validation. Compared with manual annotation, we obtained a mean dice overlap of $\text{94.76}\%$ and a mean volume overlap of $\text{91.10}\%$ with a computation time of less than 40 s per volume. Experimental results demonstrated the robustness of our method in dealing with large anatomical variations and computational efficiency for adoption in a daily clinical routine.)

[1]  J. Healey,et al.  Left atrial appendage occlusion debate revisited. , 2015, Circulation.

[2]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[3]  A. Camm,et al.  Left atrial appendage: structure, function, and role in thromboembolism , 1999, Heart.

[4]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[5]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[6]  Olivier Ecabert,et al.  Combination of shape-constrained and inflation deformable models with application to the segmentation of the left atrial appendage , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[7]  Xiaoxiao Li,et al.  Semantic Image Segmentation via Deep Parsing Network , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Saibal Kar,et al.  Percutaneous left atrial appendage closure vs warfarin for atrial fibrillation: a randomized clinical trial. , 2014, JAMA.

[9]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[10]  G. Hankey,et al.  Stroke , 2017, The Lancet.

[11]  L. Fauchier,et al.  Rhythm control in atrial fibrillation , 2016, The Lancet.

[12]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[13]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Olivier Ecabert,et al.  Automatic Model-Based Segmentation of the Heart in CT Images , 2008, IEEE Transactions on Medical Imaging.

[15]  PhengAnn Heng,et al.  Automated extraction of bronchus from 3D CT images of lung based on genetic algorithm and 3D region growing , 2000, Medical Imaging: Image Processing.

[16]  Gerhard Hindricks,et al.  Impact of left atrial appendage morphology on peri-interventional thromboembolic risk during catheter ablation of atrial fibrillation. , 2014, Heart rhythm.

[17]  Katsuyuki Taguchi,et al.  Regional function analysis of left atrial appendage using motion estimation CT and risk of stroke in patients with atrial fibrillation. , 2016, European heart journal cardiovascular Imaging.

[18]  G. Wahba Smoothing noisy data with spline functions , 1975 .

[19]  Gustavo Carneiro,et al.  Deep Learning and Structured Prediction for the Segmentation of Mass in Mammograms , 2015, MICCAI.

[20]  Gareth Funka-Lea,et al.  Graph Cuts and Efficient N-D Image Segmentation , 2006, International Journal of Computer Vision.

[21]  Huazhu Fu,et al.  Retinal vessel segmentation via deep learning network and fully-connected conditional random fields , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[22]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  HirokiOe,et al.  Biatrial Appendage Thrombi in a Heart Failure Patient With Sinus Rhythm , 2016 .

[24]  Yan Wang,et al.  Left Atrial Appendage Studied by Computed Tomography to Help Planning for Appendage Closure Device Placement , 2010, Journal of cardiovascular electrophysiology.

[25]  Nikolas P. Galatsanos,et al.  A Class-Adaptive Spatially Variant Mixture Model for Image Segmentation , 2007, IEEE Transactions on Image Processing.

[26]  Christian Igel,et al.  Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network , 2013, MICCAI.

[27]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[28]  Krishnaswamy Chandrasekaran,et al.  Intracardiac Thrombosis and Embolism in Patients With Cardiac Amyloidosis , 2007, Circulation.

[29]  Dorin Comaniciu,et al.  Multi-Part Modeling and Segmentation of Left Atrium in C-Arm CT for Image-Guided Ablation of Atrial Fibrillation , 2014, IEEE Transactions on Medical Imaging.

[30]  Ronald Lumia,et al.  A new three dimensional connected components algorithm , 1982, Comput. Graph. Image Process..

[31]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[32]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[33]  Jiwen Lu,et al.  Left Atrial Appendage Segmentation Based on Ranking 2-D Segmentation Proposals , 2016, STACOM@MICCAI.

[34]  Zia-ur Rahman,et al.  A multiscale retinex for bridging the gap between color images and the human observation of scenes , 1997, IEEE Trans. Image Process..

[35]  J Clémenty,et al.  Catheter ablation for atrial fibrillation. , 2007, Circulation.

[36]  Prashanthan Sanders,et al.  Catheter ablation of atrial arrhythmias: state of the art , 2012, The Lancet.

[37]  Chihiro Saito,et al.  Correlation between left atrial appendage morphology and flow velocity in patients with paroxysmal atrial fibrillation. , 2015, European heart journal cardiovascular Imaging.

[38]  F. Alenghat,et al.  Catheter Ablation for Atrial Fibrillation in 2019. , 2019, JAMA.