Segmenting computed tomograms for cardiac ablation using machine learning leveraged by domain knowledge encoding

Background Segmentation of computed tomography (CT) is important for many clinical procedures including personalized cardiac ablation for the management of cardiac arrhythmias. While segmentation can be automated by machine learning (ML), it is limited by the need for large, labeled training data that may be difficult to obtain. We set out to combine ML of cardiac CT with domain knowledge, which reduces the need for large training datasets by encoding cardiac geometry, which we then tested in independent datasets and in a prospective study of atrial fibrillation (AF) ablation. Methods We mathematically represented atrial anatomy with simple geometric shapes and derived a model to parse cardiac structures in a small set of N = 6 digital hearts. The model, termed “virtual dissection,” was used to train ML to segment cardiac CT in N = 20 patients, then tested in independent datasets and in a prospective study. Results In independent test cohorts (N = 160) from 2 Institutions with different CT scanners, atrial structures were accurately segmented with Dice scores of 96.7% in internal (IQR: 95.3%–97.7%) and 93.5% in external (IQR: 91.9%–94.7%) test data, with good agreement with experts (r = 0.99; p < 0.0001). In a prospective study of 42 patients at ablation, this approach reduced segmentation time by 85% (2.3 ± 0.8 vs. 15.0 ± 6.9 min, p < 0.0001), yet provided similar Dice scores to experts (93.9% (IQR: 93.0%–94.6%) vs. 94.4% (IQR: 92.8%–95.7%), p = NS). Conclusions Encoding cardiac geometry using mathematical models greatly accelerated training of ML to segment CT, reducing the need for large training sets while retaining accuracy in independent test data. Combining ML with domain knowledge may have broad applications.

[1]  Malte E. K. Jensen,et al.  Self-supervised learning for medical image classification: a systematic review and implementation guidelines , 2023, npj Digit. Medicine.

[2]  Ari S. Morcos,et al.  A Cookbook of Self-Supervised Learning , 2023, ArXiv.

[3]  Cameron R. Wolfe,et al.  Current progress and open challenges for applying deep learning across the biosciences , 2022, Nature Communications.

[4]  G. Fung,et al.  Evaluating the Performance of a Convolutional Neural Network Algorithm for Measuring Thoracic Aortic Diameters in a Heterogeneous Population. , 2022, Radiology. Artificial intelligence.

[5]  Alistair A. Young,et al.  Whole Heart Anatomical Refinement from CCTA Using Extrapolation and Parcellation , 2021, FIMH.

[6]  John S. Erickson,et al.  The Problem of Fairness in Synthetic Healthcare Data , 2021, Entropy.

[7]  D. Zdrenghea,et al.  Formula to estimate left atrial volume using antero-posterior diameter in patients with catheter ablation of atrial fibrillation , 2021, Medicine.

[8]  Simon K Warfield,et al.  Transfer learning in medical image segmentation: New insights from analysis of the dynamics of model parameters and learned representations , 2021, Artif. Intell. Medicine.

[9]  Ming Y. Lu,et al.  Synthetic data in machine learning for medicine and healthcare , 2021, Nature Biomedical Engineering.

[10]  C. Brune,et al.  Anatomy-aided deep learning for medical image segmentation: a review , 2021, Physics in medicine and biology.

[11]  M. Chung,et al.  Machine Learning–Derived Fractal Features of Shape and Texture of the Left Atrium and Pulmonary Veins From Cardiac Computed Tomography Scans Are Associated With Risk of Recurrence of Atrial Fibrillation Postablation , 2021, Circulation. Arrhythmia and electrophysiology.

[12]  Anne C. Trutti,et al.  A probabilistic atlas of the human ventral tegmental area (VTA) based on 7 Tesla MRI data , 2021, Brain Structure and Function.

[13]  Shuangbing Xu,et al.  Impact of Left Atrial Sphericity Index on the Outcome of Catheter Ablation for Atrial Fibrillation , 2021, Journal of Cardiovascular Translational Research.

[14]  S. Schuler,et al.  A Bi-atrial Statistical Shape Model and 100 Volumetric Anatomical Models of the Atria , 2020 .

[15]  Jens Petersen,et al.  nnU-Net: a self-configuring method for deep learning-based biomedical image segmentation , 2020, Nature Methods.

[16]  Steven E. Williams,et al.  Fully Automatic Atrial Fibrosis Assessment Using a Multilabel Convolutional Neural Network , 2020, Circulation. Cardiovascular imaging.

[17]  Jian Zhuang,et al.  ImageCHD: A 3D Computed Tomography Image Dataset for Classification of Congenital Heart Disease , 2020, MICCAI.

[18]  G. Breithardt,et al.  Early Rhythm-Control Therapy in Patients with Atrial Fibrillation. , 2020, The New England journal of medicine.

[19]  Finale Doshi-Velez,et al.  The myth of generalisability in clinical research and machine learning in health care , 2020, The Lancet Digital Health.

[20]  Tom B. Brown,et al.  Language Models are Few-Shot Learners , 2020, NeurIPS.

[21]  J. Leskovec,et al.  Open Graph Benchmark: Datasets for Machine Learning on Graphs , 2020, NeurIPS.

[22]  Jeroen J. Bax,et al.  Identification and Quantification of Cardiovascular Structures From CCTA: An End-to-End, Rapid, Pixel-Wise, Deep-Learning Method. , 2020, JACC. Cardiovascular imaging.

[23]  Shaojie Tang,et al.  A survey on incorporating domain knowledge into deep learning for medical image analysis , 2020, Medical Image Anal..

[24]  Henry Horng-Shing Lu,et al.  Automated extraction of left atrial volumes from two-dimensional computer tomography images using a deep learning technique. , 2020, International journal of cardiology.

[25]  D. Rueckert,et al.  Deep Learning for Cardiac Image Segmentation: A Review , 2019, Frontiers in Cardiovascular Medicine.

[26]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[27]  Jun Zhang,et al.  Preliminary Clinical Study of the Differences Between Interobserver Evaluation and Deep Convolutional Neural Network-Based Segmentation of Multiple Organs at Risk in CT Images of Lung Cancer , 2019, Front. Oncol..

[28]  Yuanyuan Wang,et al.  Fully automated segmentation of the left atrium, pulmonary veins, and left atrial appendage from magnetic resonance angiography by joint‐atlas‐optimization , 2019, Medical physics.

[29]  Guang Yang,et al.  Evaluation of algorithms for Multi-Modality Whole Heart Segmentation: An open-access grand challenge , 2019, Medical Image Anal..

[30]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[31]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[32]  S. Tamang,et al.  Potential Biases in Machine Learning Algorithms Using Electronic Health Record Data , 2018, JAMA internal medicine.

[33]  Jitendra Malik,et al.  SFV , 2018, ACM Trans. Graph..

[34]  L. Ngo,et al.  Incremental Value of Left Atrial Geometric Remodeling in Predicting Late Atrial Fibrillation Recurrence After Pulmonary Vein Isolation: A Cardiovascular Magnetic Resonance Study , 2018, Journal of the American Heart Association.

[35]  Nikos Paragios,et al.  AtlasNet: Multi-atlas Non-linear Deep Networks for Medical Image Segmentation , 2018, MICCAI.

[36]  Shu Zhang,et al.  Pulmonary Vein Anatomy is Associated with Cryo Kinetics during Cryoballoon Ablation for Atrial Fibrillation , 2018, Arquivos brasileiros de cardiologia.

[37]  Marcel A. J. van Gerven,et al.  Computational Foundations of Natural Intelligence , 2017, bioRxiv.

[38]  Paul J. Wang,et al.  Multicentre safety of adding Focal Impulse and Rotor Modulation (FIRM) to conventional ablation for atrial fibrillation , 2017, Europace : European pacing, arrhythmias, and cardiac electrophysiology : journal of the working groups on cardiac pacing, arrhythmias, and cardiac cellular electrophysiology of the European Society of Cardiology.

[39]  R. Rosso,et al.  Use of New Imaging CARTO® Segmentation Module Software to Facilitate Ablation of Ventricular Arrhythmias , 2017, Journal of cardiovascular electrophysiology.

[40]  M. Mack,et al.  The future of transcatheter aortic valve implantation. , 2016, European heart journal.

[41]  Joshua B. Tenenbaum,et al.  Human-level concept learning through probabilistic program induction , 2015, Science.

[42]  Jürgen Weese,et al.  Benchmark for Algorithms Segmenting the Left Atrium From 3D CT and MRI Datasets , 2015, IEEE Transactions on Medical Imaging.

[43]  Sanjiv M Narayan,et al.  Ablation of rotor and focal sources reduces late recurrence of atrial fibrillation compared with trigger ablation alone: extended follow-up of the CONFIRM trial (Conventional Ablation for Atrial Fibrillation With or Without Focal Impulse and Rotor Modulation). , 2014, Journal of the American College of Cardiology.

[44]  Quoc V. Le,et al.  Stochastic Gradient Descent , 2014, Machine Learning with Neural Networks.

[45]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[46]  R. Kikinis,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[47]  José Angel Cabrera,et al.  Advances in Arrhythmia and Electrophysiology Left Atrial Anatomy Revisited , 2012 .

[48]  Gernot Brockmann,et al.  Automatic Aorta Segmentation and Valve Landmark Detection in C-Arm CT: Application to Aortic Valve Implantation , 2010, MICCAI.

[49]  David A. Steinman,et al.  A Framework for Geometric Analysis of Vascular Structures: Application to Cerebral Aneurysms , 2009, IEEE Transactions on Medical Imaging.

[50]  Christian Olsson,et al.  Thoracic Aortic Aneurysm and Dissection: Increasing Prevalence and Improved Outcomes Reported in a Nationwide Population-Based Study of More Than 14 000 Cases From 1987 to 2002 , 2006 .

[51]  Cheng-Yen Chang,et al.  Morphologic Characteristics of the Left Atrial Appendage, Roof, and Septum: Implications for the Ablation of Atrial Fibrillation , 2006, Journal of cardiovascular electrophysiology.

[52]  Prashanthan Sanders,et al.  Techniques, Evaluation, and Consequences of Linear Block at the Left Atrial Roof in Paroxysmal Atrial Fibrillation: A Prospective Randomized Study , 2005, Circulation.

[53]  Katja Zeppenfeld,et al.  Fusion of multislice computed tomography imaging with three-dimensional electroanatomic mapping to guide radiofrequency catheter ablation procedures. , 2005, Heart rhythm.

[54]  Hakan Oral,et al.  Anatomy of the Pulmonary Veins in Patients with Atrial Fibrillation and Effects of Segmental Ostial Ablation Analyzed by Computed Tomography , 2003, Journal of cardiovascular electrophysiology.

[55]  Kristel Michielsen,et al.  Morphological image analysis , 2000 .

[56]  Qianjun Jia,et al.  Artificial Intelligence-based Computed Tomography Processing Framework for Surgical Telementoring of Congenital Heart Disease , 2021, ACM J. Emerg. Technol. Comput. Syst..

[57]  Geoffrey E. Hinton,et al.  Deep Learning , 2015 .

[58]  Karl Krissian,et al.  Semi-automatic segmentation and detection of aorta dissection wall in MDCT angiography , 2014, Medical Image Anal..