Structure-to-Shape Aortic 3-D Deformation Reconstruction for Endovascular Interventions

Fluoroscopy-guided endovascular interventions by using X-ray images are challenging. The catheter needs to be manipulated precisely inside the aorta, while only 2-D views from the X-ray fluoroscopy are currently used to help the surgeons. Because the catheter is operated in a 3-D space, a visualization of the deforming 3-D aorta will be useful as guidance for catheter manipulation. Existing 3-D reconstruction methods fall short in only focusing on the deformation reconstruction of the aortic 3-D centerline, or using additional prior knowledge of 3-D catheter position for estimating the aortic 3-D deformation. In this article, we propose a novel framework that reconstructs the aortic 3-D deformation by fusing a preoperative 3-D model and two intraoperative X-ray images. Different from existing methods, the proposed framework reconstructs aortic deformation using a coarse-to-fine pipeline by first reconstructing the aortic 3-D centerline and then reconstructing the 3-D shape. To obtain the accurate features for the fluoroscopic-based 3-D reconstruction, we extract semantic features from the X-ray images, and compute the distance field to efficiently calculate the 3-D–2-D nonrigid correspondence. Nonlinear least squares optimization is used to solve the deformation of both centerline and shape. The proposed framework is validated using phantom and patient datasets, whose results demonstrate improved efficiency and accuracy compared with the existing methods. This framework provides a valuable clinical tool for endovascular interventions.

[1]  Hongdong Li,et al.  NAF: Neural Attenuation Fields for Sparse-View CBCT Reconstruction , 2022, MICCAI.

[2]  Yiyu Shi,et al.  ImageTBAD: A 3D Computed Tomography Angiography Image Dataset for Automatic Segmentation of Type-B Aortic Dissection , 2021, Frontiers in Physiology.

[3]  Yanhao Zhang,et al.  Deep Learning Assisted Automatic Intra-operative 3D Aortic Deformation Reconstruction , 2020, MICCAI.

[4]  Stefan Heldmann,et al.  Multilevel 2D-3D Intensity-Based Image Registration , 2020, WBIR.

[5]  Shoudong Huang,et al.  Aortic 3D Deformation Reconstruction using 2D X-ray Fluoroscopy and 3D Pre-operative Data for Endovascular Interventions , 2020, 2020 IEEE International Conference on Robotics and Automation (ICRA).

[6]  Xiaowei Ding,et al.  Embracing Imperfect Datasets: A Review of Deep Learning Solutions for Medical Image Segmentation , 2019, Medical Image Anal..

[7]  Katharina Breininger,et al.  Simultaneous reconstruction of multiple stiff wires from a single X-ray projection for endovascular aortic repair , 2019, International Journal of Computer Assisted Radiology and Surgery.

[8]  Celia V. Riga,et al.  Towards 3D Path Planning from a Single 2D Fluoroscopic Image for Robot Assisted Fenestrated Endovascular Aortic Repair , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[9]  Eric Therasse,et al.  A Numerical Preoperative Planning Model to Predict Arterial Deformations in Endovascular Aortic Aneurysm Repair , 2018, Annals of Biomedical Engineering.

[10]  P. Haigron,et al.  Patient-Specific Finite-Element Simulation of the Insertion of Guidewire During an EVAR Procedure: Guidewire Position Prediction Validation on 28 Cases , 2017, IEEE Transactions on Biomedical Engineering.

[11]  Nassir Navab,et al.  CathNets: Detection and Single-View Depth Prediction of Catheter Electrodes , 2016, MIAR.

[12]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[13]  Su-Lin Lee,et al.  SCEM+: Real-Time Robust Simultaneous Catheter and Environment Modeling for Endovascular Navigation , 2016, IEEE Robotics and Automation Letters.

[14]  Z. Jane Wang,et al.  A CNN Regression Approach for Real-Time 2D/3D Registration , 2016, IEEE Transactions on Medical Imaging.

[15]  Andreas K. Maier,et al.  Adaption of 3D Models to 2D X-Ray Images during Endovascular Abdominal Aneurysm Repair , 2015, MICCAI.

[16]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[17]  Philip Kollmannsberger,et al.  Architecture of the osteocyte network correlates with bone material quality , 2013, Journal of bone and mineral research : the official journal of the American Society for Bone and Mineral Research.

[18]  P. Haigron,et al.  Finite-Element-Based Matching of Pre- and Intraoperative Data for Image-Guided Endovascular Aneurysm Repair , 2013, IEEE Transactions on Biomedical Engineering.

[19]  B. Bou-Saïd,et al.  Prediction of deformations during endovascular aortic aneurysm repair using finite element simulation , 2013, Comput. Medical Imaging Graph..

[20]  Mohamed Cheriet,et al.  Nonrigid 2D/3D Registration of Coronary Artery Models With Live Fluoroscopy for Guidance of Cardiac Interventions , 2012, IEEE Transactions on Medical Imaging.

[21]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[22]  Hari Sundar,et al.  An Efficient Graph-Based Deformable 2D/3D Registration Algorithm with Applications for Abdominal Aortic Aneurysm Interventions , 2010, MIAR.

[23]  Peter Schröder,et al.  A simple geometric model for elastic deformations , 2010, ACM Trans. Graph..

[24]  Nassir Navab,et al.  Deformable 2D-3D Registration of Vascular Structures in a One View Scenario , 2009, IEEE Transactions on Medical Imaging.

[25]  Lik-Kwan Shark,et al.  A computationally efficient method for automatic registration of orthogonal x-ray images with volumetric CT data , 2008, Physics in medicine and biology.

[26]  Nassir Navab,et al.  Segmentation-Driven 2D-3D Registration for Abdominal Catheter Interventions , 2007, MICCAI.

[27]  Mark Pauly,et al.  Embedded deformation for shape manipulation , 2007, ACM Trans. Graph..

[28]  Marc Alexa,et al.  As-rigid-as-possible surface modeling , 2007, Symposium on Geometry Processing.

[29]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[30]  Guoyan Zheng,et al.  Reconstruction of Patient-Specific 3D Bone Surface from 2D Calibrated Fluoroscopic Images and Point Distribution Model , 2006, MICCAI.

[31]  Lik-Kwan Shark,et al.  An Extension of Iterative Closest Point Algorithm for 3D-2D Registration for Pre-treatment Validation in Radiotherapy , 2006, International Conference on Medical Information Visualisation - BioMedical Visualisation (MedVis'06).

[32]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[33]  Jonathan Richard Shewchuk,et al.  Adaptive Precision Floating-Point Arithmetic and Fast Robust Geometric Predicates , 1997, Discret. Comput. Geom..

[34]  Nicholas Ayache,et al.  3D-2D projective registration of free-form curves and surfaces , 1995, Proceedings of IEEE International Conference on Computer Vision.

[35]  Rangasami L. Kashyap,et al.  Building Skeleton Models via 3-D Medial Surface/Axis Thinning Algorithms , 1994, CVGIP Graph. Model. Image Process..

[36]  Rein van den Boomgaard,et al.  Methods for fast morphological image transforms using bitmapped binary images , 1992, CVGIP Graph. Model. Image Process..

[37]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  E. T. Y. Lee,et al.  Choosing nodes in parametric curve interpolation , 1989 .

[39]  R. Siddon Fast calculation of the exact radiological path for a three-dimensional CT array. , 1985, Medical physics.

[40]  David G. Kirkpatrick,et al.  On the shape of a set of points in the plane , 1983, IEEE Trans. Inf. Theory.

[41]  Andreas K. Maier,et al.  Move Over There: One-Click Deformation Correction for Image Fusion During Endovascular Aortic Repair , 2020, MICCAI.

[42]  Paolo Cignoni,et al.  MeshLab: an Open-Source Mesh Processing Tool , 2008, Eurographics Italian Chapter Conference.

[43]  E R Valstar,et al.  Image-based RSA: Roentgen stereophotogrammetric analysis based on 2D-3D image registration. , 2008, Journal of biomechanics.

[44]  Bostjan Likar,et al.  3-D/2-D registration by integrating 2-D information in 3-D , 2006, IEEE Transactions on Medical Imaging.

[45]  Gerald F. Davis,et al.  Research Interests , 2002, Description Logics.