Artificial Intelligence in the Image-Guided Care of Atrial Fibrillation

Atrial fibrillation arises mainly due to abnormalities in the cardiac conduction system and is associated with anatomical remodeling of the atria and the pulmonary veins. Cardiovascular imaging techniques, such as echocardiography, computed tomography, and magnetic resonance imaging, are crucial in the management of atrial fibrillation, as they not only provide anatomical context to evaluate structural alterations but also help in determining treatment strategies. However, interpreting these images requires significant human expertise. The potential of artificial intelligence in analyzing these images has been repeatedly suggested due to its ability to automate the process with precision comparable to human experts. This review summarizes the benefits of artificial intelligence in enhancing the clinical care of patients with atrial fibrillation through cardiovascular image analysis. It provides a detailed overview of the two most critical steps in image-guided AF management, namely, segmentation and classification. For segmentation, the state-of-the-art artificial intelligence methodologies and the factors influencing the segmentation performance are discussed. For classification, the applications of artificial intelligence in the diagnosis and prognosis of atrial fibrillation are provided. Finally, this review also scrutinizes the current challenges hindering the clinical applicability of these methods, with the aim of guiding future research toward more effective integration into clinical practice.

[1]  Cristian Izquierdo Morcillo,et al.  Prediction of incident cardiovascular events using machine learning and CMR radiomics , 2022, European Radiology.

[2]  X. Zhuang,et al.  $\mathcal {X}$-Metric: An N-Dimensional Information-Theoretic Framework for Groupwise Registration and Deep Combined Computing , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  M. Iguchi,et al.  Machine Learning Risk Prediction for Incident Heart Failure in Patients With Atrial Fibrillation , 2022, JACC. Asia.

[4]  James A. White,et al.  Machine learning prediction of atrial fibrillation in cardiovascular patients using cardiac magnetic resonance and electronic health information , 2022, Frontiers in Cardiovascular Medicine.

[5]  Sung Ho Hwang,et al.  Efficient Segmentation for Left Atrium With Convolution Neural Network Based on Active Learning in Late Gadolinium Enhancement Magnetic Resonance Imaging , 2022, Journal of Korean medical science.

[6]  P. Rajpurkar,et al.  Self-supervised learning in medicine and healthcare , 2022, Nature Biomedical Engineering.

[7]  Grigoris I. Grigoriadis,et al.  Segmentation of left atrium using CT images and a deep learning model , 2022, 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC).

[8]  M. Link,et al.  Prediction of Type and Recurrence of Atrial Fibrillation after Catheter Ablation via Left Atrial Electroanatomical Voltage Mapping Registration and Multilayer Perceptron Classification: A Retrospective Study , 2022, Sensors.

[9]  Kuanquan Wang,et al.  Uncertainty-guided symmetric multi-level supervision network for 3D left atrium segmentation in late gadolinium-enhanced MRI. , 2022, Medical physics.

[10]  Daiju Ueda,et al.  Artificial intelligence-based detection of atrial fibrillation from chest radiographs , 2022, European Radiology.

[11]  Xueqian Xie,et al.  Machine-learning-based radiomics identifies atrial fibrillation on the epicardial fat in contrast-enhanced and non-enhanced chest CT. , 2022, The British journal of radiology.

[12]  Wenjie Yang,et al.  Development and Validation of a Machine Learning-Based Radiomics Model on Cardiac Computed Tomography of Epicardial Adipose Tissue in Predicting Characteristics and Recurrence of Atrial Fibrillation , 2022, Frontiers in Cardiovascular Medicine.

[13]  S. Petersen,et al.  Generalizable Framework for Atrial Volume Estimation for Cardiac CT Images Using Deep Learning With Quality Control Assessment , 2022, Frontiers in Cardiovascular Medicine.

[14]  Steven E. Williams,et al.  Predicting Atrial Fibrillation Recurrence by Combining Population Data and Virtual Cohorts of Patient-Specific Left Atrial Models , 2022, Circulation. Arrhythmia and electrophysiology.

[15]  Leila C. Kahwati,et al.  Screening for Atrial Fibrillation: Updated Evidence Report and Systematic Review for the US Preventive Services Task Force. , 2022, JAMA.

[16]  Syed Waqas Zamir,et al.  Transformers in Medical Imaging: A Survey , 2022, Medical Image Anal..

[17]  Rahul Wadke,et al.  Atrial fibrillation. , 2022, Disease-a-month : DM.

[18]  D. Shen,et al.  Weakly Supervised Segmentation of COVID19 Infection with Scribble Annotation on CT Images , 2021, Pattern Recognition.

[19]  Dimitris N. Metaxas,et al.  UTNet: A Hybrid Transformer Architecture for Medical Image Segmentation , 2021, MICCAI.

[20]  Christoph M. Augustin,et al.  The openCARP Simulation Environment for Cardiac Electrophysiology , 2021, bioRxiv.

[21]  Xing Yang,et al.  18F-fluorodeoxyglucose positron emission tomography/computed tomography imaging in atrial fibrillation: a pilot prospective study. , 2021, European heart journal. Cardiovascular Imaging.

[22]  Daguang Xu,et al.  UNETR: Transformers for 3D Medical Image Segmentation , 2021, 2022 IEEE/CVF Winter Conference on Applications of Computer Vision (WACV).

[23]  N. Ayache,et al.  Applications of artificial intelligence in cardiovascular imaging , 2021, Nature Reviews Cardiology.

[24]  M. Chung,et al.  Machine Learning–Derived Fractal Features of Shape and Texture of the Left Atrium and Pulmonary Veins From Cardiac Computed Tomography Scans Are Associated With Risk of Recurrence of Atrial Fibrillation Postablation , 2021, Circulation. Arrhythmia and electrophysiology.

[25]  Y. Hwang,et al.  A Novel Approach for Predicting Atrial Fibrillation Recurrence After Ablation Using Deep Convolutional Neural Networks by Assessing Left Atrial Curved M-Mode Speckle-Tracking Images , 2021, Frontiers in Cardiovascular Medicine.

[26]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[27]  P. Munroe,et al.  Repeatability of Cardiac Magnetic Resonance Radiomics: A Multi-Centre Multi-Vendor Test-Retest Study , 2020, Frontiers in Cardiovascular Medicine.

[28]  Steven E. Williams,et al.  Fully Automatic Atrial Fibrosis Assessment Using a Multilabel Convolutional Neural Network , 2020, Circulation. Cardiovascular imaging.

[29]  M. Chung,et al.  Machine Learning–Based Risk Assessment for Cancer Therapy–Related Cardiac Dysfunction in 4300 Longitudinal Oncology Patients , 2020, Journal of the American Heart Association.

[30]  S. Gelly,et al.  An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale , 2020, ICLR.

[31]  Yuanyuan Wang,et al.  A global benchmark of algorithms for segmenting the left atrium from late gadolinium-enhanced cardiac magnetic resonance imaging , 2020, Medical Image Anal..

[32]  J. Kalman,et al.  Catheter ablation for atrial fibrillation: current indications and evolving technologies , 2020, Nature Reviews Cardiology.

[33]  Cristiana Corsi,et al.  A fully automated left atrium segmentation approach from late gadolinium enhanced magnetic resonance imaging based on a convolutional neural network. , 2020, Quantitative imaging in medicine and surgery.

[34]  Rheeda L. Ali,et al.  Preprocedure Application of Machine Learning and Mechanistic Simulations Predicts Likelihood of Paroxysmal Atrial Fibrillation Recurrence Following Pulmonary Vein Isolation , 2020, Circulation. Arrhythmia and electrophysiology.

[35]  G. Lip,et al.  Role for machine learning in sex-specific prediction of successful electrical cardioversion in atrial fibrillation? , 2020, Open Heart.

[36]  D. Peterson,et al.  Der orthopädische Rheumatologe ist ein Spezialist! , 2020, Zeitschrift für Orthopädie und Unfallchirurgie.

[37]  Alejandro F Frangi,et al.  The UK Biobank imaging enhancement of 100,000 participants: rationale, data collection, management and future directions , 2020, Nature Communications.

[38]  P. V. van Ooijen,et al.  Computed Tomography Screening for Early Lung Cancer, COPD and Cardiovascular Disease in Shanghai: Rationale and Design of a Population-based Comparative Study. , 2020, Academic Radiology.

[39]  Heng Liu,et al.  Segmentation and visualization of left atrium through a unified deep learning framework , 2020, International Journal of Computer Assisted Radiology and Surgery.

[40]  David S. Melnick,et al.  International evaluation of an AI system for breast cancer screening , 2020, Nature.

[41]  Thomas de Lange,et al.  ResUNet++: An Advanced Architecture for Medical Image Segmentation , 2019, 2019 IEEE International Symposium on Multimedia (ISM).

[42]  D. Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2019, Frontiers in Cardiovascular Medicine.

[43]  Stefan L. Zimmerman,et al.  Computationally guided personalized targeted ablation of persistent atrial fibrillation , 2019, Nature Biomedical Engineering.

[44]  Daniel Rueckert,et al.  Self-Supervised Learning for Cardiac MR Image Segmentation by Anatomical Position Prediction , 2019, MICCAI.

[45]  Greg Zaharchuk,et al.  Next generation research applications for hybrid PET/MR and PET/CT imaging using deep learning , 2019, European Journal of Nuclear Medicine and Molecular Imaging.

[46]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[47]  M. Miyagawa,et al.  Positron emission tomography/computed tomography detection of increased 18F-fluorodeoxyglucose uptake in the cardiac atria of patients with atrial fibrillation. , 2019, International journal of cardiology.

[48]  Mohammed Bennamoun,et al.  An Improved Approach to Weakly Supervised Semantic Segmentation , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[49]  David O. Martin,et al.  New Model of Automated Patient-Reported Outcomes Applied in Atrial Fibrillation , 2019, Circulation. Arrhythmia and electrophysiology.

[50]  Jichao Zhao,et al.  Fully Automatic Left Atrium Segmentation From Late Gadolinium Enhanced Magnetic Resonance Imaging Using a Dual Fully Convolutional Neural Network , 2019, IEEE Transactions on Medical Imaging.

[51]  Christopher X. Wong,et al.  Electroanatomical Remodeling of the Atria in Obesity: Impact of Adjacent Epicardial Fat. , 2018, JACC. Clinical electrophysiology.

[52]  Hervé Delingette,et al.  Explainable cardiac pathology classification on cine MRI with motion characterization by semi-supervised learning of apparent flow , 2018, Medical Image Anal..

[53]  Aimin Hao,et al.  Automatic 3D Atrial Segmentation from GE-MRIs Using Volumetric Fully Convolutional Networks , 2018, STACOM@MICCAI.

[54]  Heye Zhang,et al.  Multiview Sequential Learning and Dilated Residual Learning for a Fully Automatic Delineation of the Left Atrium and Pulmonary Veins from Late Gadolinium-Enhanced Cardiac MRI Images , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[55]  Eric Granger,et al.  Constrained‐CNN losses for weakly supervised segmentation☆ , 2018, Medical Image Anal..

[56]  Jiwen Lu,et al.  Left Atrial Appendage Segmentation Using Fully Convolutional Neural Networks and Modified Three-Dimensional Conditional Random Fields , 2018, IEEE Journal of Biomedical and Health Informatics.

[57]  Qingjie Liu,et al.  Road Extraction by Deep Residual U-Net , 2017, IEEE Geoscience and Remote Sensing Letters.

[58]  Andriy Fedorov,et al.  Computational Radiomics System to Decode the Radiographic Phenotype. , 2017, Cancer research.

[59]  Jie Hu,et al.  Squeeze-and-Excitation Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[60]  Artur Klepaczko,et al.  QMaZda - Software tools for image analysis and pattern recognition , 2017, SPA.

[61]  Lin Yang,et al.  Suggestive Annotation: A Deep Active Learning Framework for Biomedical Image Segmentation , 2017, MICCAI.

[62]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[63]  Scott Lundberg,et al.  A Unified Approach to Interpreting Model Predictions , 2017, NIPS.

[64]  Geoffrey G. Zhang,et al.  Intrinsic dependencies of CT radiomic features on voxel size and number of gray levels , 2017, Medical physics.

[65]  Konstantinos Kamnitsas,et al.  Reverse Classification Accuracy: Predicting Segmentation Performance in the Absence of Ground Truth , 2017, IEEE Transactions on Medical Imaging.

[66]  Xiahai Zhuang,et al.  Multivariate Mixture Model for Myocardial Segmentation Combining Multi-Source Images , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[67]  R. Steenbakkers,et al.  The Image Biomarker Standardization Initiative: Standardized Quantitative Radiomics for High-Throughput Image-based Phenotyping. , 2016, Radiology.

[68]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[69]  Seyed-Ahmad Ahmadi,et al.  Automatic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3D Conditional Random Fields , 2016, MICCAI.

[70]  Xiahai Zhuang,et al.  Multi-scale patch and multi-modality atlases for whole heart segmentation of MRI , 2016, Medical Image Anal..

[71]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[72]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[73]  D. Rueckert,et al.  DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks , 2016, IEEE Transactions on Medical Imaging.

[74]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[75]  Virginia Moyer,et al.  The US Preventive Services Task Force , 2015, North Carolina Medical Journal.

[76]  Dit-Yan Yeung,et al.  Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting , 2015, NIPS.

[77]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[78]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[79]  B. Ky,et al.  Cancer Therapy–Induced Cardiotoxicity: Basic Mechanisms and Potential Cardioprotective Therapies , 2014, Journal of the American Heart Association.

[80]  G. Filippatos,et al.  Insights into onco-cardiology: atrial fibrillation in cancer. , 2014, Journal of the American College of Cardiology.

[81]  Christopher McGann,et al.  Atrial Fibrillation Ablation Outcome Is Predicted by Left Atrial Remodeling on MRI , 2014, Circulation. Arrhythmia and electrophysiology.

[82]  Y. Chun,et al.  Current status of clinical background of patients with atrial fibrillation in a community-based survey: the Fushimi AF Registry. , 2013, Journal of cardiology.

[83]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[84]  H. Sievers,et al.  A Comprehensive Evaluation of Rhythm Monitoring Strategies for the Detection of Atrial Fibrillation Recurrence: Insights From 647 Continuously Monitored Patients and Implications for Monitoring After Therapeutic Interventions , 2012, Circulation.

[85]  Patrick Granton,et al.  Radiomics: extracting more information from medical images using advanced feature analysis. , 2012, European journal of cancer.

[86]  Joshua J. E. Blauer,et al.  Dark regions of no-reflow on late gadolinium enhancement magnetic resonance imaging result in scar formation after atrial fibrillation ablation. , 2011, Journal of the American College of Cardiology.

[87]  Javier Rodríguez,et al.  Theoretical generalization of normal and sick coronary arteries with fractal dimensions and the arterial intrinsic mathematical harmony , 2010, BMC medical physics.

[88]  Witold R. Rudnicki,et al.  Feature Selection with the Boruta Package , 2010 .

[89]  A. Natale,et al.  Left Atrial Appendage Studied by Computed Tomography to Help Planning for Appendage Closure Device Placement , 2010, Journal of cardiovascular electrophysiology.

[90]  Gregory Y H Lip,et al.  Refining clinical risk stratification for predicting stroke and thromboembolism in atrial fibrillation using a novel risk factor-based approach: the euro heart survey on atrial fibrillation. , 2010, Chest.

[91]  Carla Saraiva,et al.  Left atrial volume calculated by multi-detector computed tomography may predict successful pulmonary vein isolation in catheter ablation of atrial fibrillation. , 2009, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[92]  S. Nattel,et al.  Atrial fibrosis: mechanisms and clinical relevance in atrial fibrillation. , 2008, Journal of the American College of Cardiology.

[93]  K. Dickstein,et al.  How to diagnose diastolic heart failure: a consensus statement on the diagnosis of heart failure with normal left ventricular ejection fraction by the Heart Failure and Echocardiography Associations of the European Society of Cardiology. , 2007, European heart journal.

[94]  Hsuan-Hung Chuang,et al.  Cardiovascular imaging in the management of atrial fibrillation. , 2006, Journal of the American College of Cardiology.

[95]  Patrice Y. Simard,et al.  Best practices for convolutional neural networks applied to visual document analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[96]  S Chierchia,et al.  Catheter ablation of paroxysmal atrial fibrillation using a 3D mapping system. , 1999, Circulation.

[97]  D. Levy,et al.  Profile for estimating risk of heart failure. , 1999, Archives of internal medicine.

[98]  J Clémenty,et al.  Spontaneous initiation of atrial fibrillation by ectopic beats originating in the pulmonary veins. , 1998, The New England journal of medicine.

[99]  Zia-ur Rahman,et al.  Multi-scale retinex for color image enhancement , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[100]  N. Trayanova,et al.  Arrhythmogenic propensity of the fibrotic substrate after atrial fibrillation ablation : a longitudinal study using magnetic resonance imaging-based atrial models , 2019 .

[101]  Dhanunjaya R. Lakkireddy,et al.  Left atrial volume predicts atrial fibrillation recurrence after radiofrequency ablation: a meta-analysis , 2018, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[102]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization , 2016 .

[103]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[104]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[105]  D. Parish,et al.  Obesity and the risk of new-onset atrial fibrillation. , 2005, JAMA.

[106]  Mineichi Kudo,et al.  Comparison of algorithms that select features for pattern classifiers , 2000, Pattern Recognit..