A dynamic model‐based approach to motion and deformation tracking of prosthetic valves from biplane x‐ray images

PURPOSE Transcatheter aortic valve replacement (TAVR) is a minimally invasive procedure in which a prosthetic heart valve is placed and expanded within a defective aortic valve. The device placement is commonly performed using two-dimensional (2D) fluoroscopic imaging. Within this work, we propose a novel technique to track the motion and deformation of the prosthetic valve in three dimensions based on biplane fluoroscopic image sequences. METHODS The tracking approach uses a parameterized point cloud model of the valve stent which can undergo rigid three-dimensional (3D) transformation and different modes of expansion. Rigid elements of the model are individually rotated and translated in three dimensions to approximate the motions of the stent. Tracking is performed using an iterative 2D-3D registration procedure which estimates the model parameters by minimizing the mean-squared image values at the positions of the forward-projected model points. Additionally, an initialization technique is proposed, which locates clusters of salient features to determine the initial position and orientation of the model. RESULTS The proposed algorithms were evaluated based on simulations using a digital 4D CT phantom as well as experimentally acquired images of a prosthetic valve inside a chest phantom with anatomical background features. The target registration error was 0.12 ± 0.04 mm in the simulations and 0.64 ± 0.09 mm in the experimental data. CONCLUSIONS The proposed algorithm could be used to generate 3D visualization of the prosthetic valve from two projections. In combination with soft-tissue sensitive-imaging techniques like transesophageal echocardiography, this technique could enable 3D image guidance during TAVR procedures.

[1]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[2]  Andreas Wahle,et al.  3D heart-vessel reconstruction from biplane angiograms , 1996, IEEE Computer Graphics and Applications.

[3]  R Fahrig,et al.  Three-dimensional computed tomographic reconstruction using a C-arm mounted XRII: image-based correction of gantry motion nonidealities. , 2000, Medical physics.

[4]  Marleen de Bruijne,et al.  2D-3D shape reconstruction of the distal femur from stereo X-ray imaging using statistical shape models , 2011, Medical Image Anal..

[5]  O Dössel,et al.  3D ablation catheter localisation using individual C-arm x-ray projections. , 2014, Physics in medicine and biology.

[6]  Michael Grass,et al.  Model based 3D CS-catheter tracking from 2D X-ray projections: Binary versus attenuation models , 2014, Comput. Medical Imaging Graph..

[7]  Michael A. Speidel,et al.  Dynamic tracking of prosthetic valve motion and deformation from bi-plane x-ray views: feasibility study , 2016, SPIE Medical Imaging.

[8]  Fernando Vilariño,et al.  Predictive (un)distortion model and 3-D reconstruction by biplane snakes , 2002, IEEE Transactions on Medical Imaging.

[9]  Michael A. Speidel,et al.  Real-time pose estimation of devices from x-ray images: Application to x-ray/echo registration for cardiac interventions , 2016, Medical Image Anal..

[10]  Gerhard Kleinszig,et al.  Deformable 3D-2D Registration of Known Components for Image Guidance in Spine Surgery , 2016, MICCAI.

[11]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[12]  Guoyan Zheng,et al.  Reconstruction of Patient-Specific 3D Bone Surface from 2D Calibrated Fluoroscopic Images and Point Distribution Model , 2006, MICCAI.

[13]  Sebastian Schafer,et al.  4D interventional device reconstruction from biplane fluoroscopy. , 2016, Medical physics.

[14]  YingLiang Ma,et al.  Registration of 3D trans-esophageal echocardiography to X-ray fluoroscopy using image-based probe tracking , 2012, Medical Image Anal..

[15]  Hans-Christian Hege,et al.  Atlas-based 3D-Shape Reconstruction from X-Ray Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Joachim Hornegger,et al.  Geometric Accuracy of 3-D X-Ray Image-Based Localization from Two CArm Views , 2009 .

[17]  W. Segars,et al.  4D XCAT phantom for multimodality imaging research. , 2010, Medical physics.

[18]  Klaus C. J. Dietmayer,et al.  Catheter tracking in asynchronous biplane fluoroscopy images by 3D B-snakes , 2010, Medical Imaging.

[19]  Joachim Hornegger,et al.  Reconstruction method for curvilinear structures from two views , 2013, Medical Imaging.

[20]  Romina Murzilli,et al.  Echocardiography-X-Ray Image Fusion. , 2016, JACC. Cardiovascular imaging.

[21]  J. Leipsic,et al.  Structural integrity of balloon-expandable stents after transcatheter aortic valve replacement: assessment by multidetector computed tomography. , 2012, JACC. Cardiovascular interventions.

[22]  J. Wong,et al.  Flat-panel cone-beam computed tomography for image-guided radiation therapy. , 2002, International journal of radiation oncology, biology, physics.

[23]  Ryo Kurazume,et al.  3D reconstruction of a femoral shape using a parametric model and two 2D fluoroscopic images , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[24]  Guoyan Zheng,et al.  3D reconstruction of a patient-specific surface model of the proximal femur from calibrated x-ray radiographs: a validation study. , 2009, Medical physics.

[25]  Kai Yang,et al.  A geometric calibration method for cone beam CT systems. , 2006, Medical physics.

[26]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[27]  S.A.M. Baert,et al.  Three-dimensional guide-wire reconstruction from biplane image sequences for integrated display in 3-D vasculature , 2003, IEEE Transactions on Medical Imaging.

[28]  P. Radeva,et al.  3D vessel reconstruction from biplane angiograms using snakes , 1998, Computers in Cardiology 1998. Vol. 25 (Cat. No.98CH36292).

[29]  Terry M. Peters,et al.  US–Fluoroscopy Registration for Transcatheter Aortic Valve Implantation , 2012, IEEE Transactions on Biomedical Engineering.

[30]  YingLiang Ma,et al.  Evaluation of a Real-Time Hybrid Three-Dimensional Echo and X-Ray Imaging System for Guidance of Cardiac Catheterisation Procedures , 2012, MICCAI.

[31]  Guido P. M. Prause,et al.  Binary reconstruction of the heart chambers from biplane angiographic image sequences , 1996, IEEE Trans. Medical Imaging.

[32]  Joachim Hornegger,et al.  Accuracy of x-ray image-based 3D localization from two C-arm views: a comparison between an ideal system and a real device , 2009, Medical Imaging.

[33]  J. Carroll,et al.  Annual Outcomes With Transcatheter Valve Therapy: From the STS/ACC TVT Registry. , 2015, Journal of the American College of Cardiology.

[34]  Tom Drummond,et al.  Machine Learning for High-Speed Corner Detection , 2006, ECCV.