Ultrasound and Fluoroscopic Images Fusion by Autonomous Ultrasound Probe Detection

New minimal-invasive interventions such as transcatheter valve procedures exploit multiple imaging modalities to guide tools (fluoroscopy) and visualize soft tissue (transesophageal echocardiography (TEE)). Currently, these complementary modalities are visualized in separate coordinate systems and on separate monitors creating a challenging clinical workflow. This paper proposes a novel framework for fusing TEE and fluoroscopy by detecting the pose of the TEE probe in the fluoroscopic image. Probe pose detection is challenging in fluoroscopy and conventional computer vision techniques are not well suited. Current research requires manual initialization or the addition of fiducials. The main contribution of this paper is autonomous six DoF pose detection by combining discriminative learning techniques with a fast binary template library. The pose estimation problem is reformulated to incrementally detect pose parameters by exploiting natural invariances in the image. The theoretical contribution of this paper is validated on synthetic, phantom and in vivo data. The practical application of this technique is supported by accurate results (< 5 mm in-plane error) and computation time of 0.5s.

[1]  Hervé Delingette,et al.  Functional Imaging and Modeling of the Heart, 5th International Conference, FIMH 2009, Nice, France, June 3-5, 2009. Proceedings , 2009, Functional Imaging and Modeling of the Heart.

[2]  YingLiang Ma,et al.  Hybrid echo and x-ray image guidance for cardiac catheterization procedures by using a robotic arm: a feasibility study , 2010, Physics in medicine and biology.

[3]  Kawal S. Rhode,et al.  Rapid Image Registration of Three-Dimensional Transesophageal Echocardiography and X-ray Fluoroscopy for the Guidance of Cardiac Interventions , 2010, IPCAI.

[4]  Dorin Comaniciu,et al.  Learning-based hypothesis fusion for robust catheter tracking in 2D X-ray fluoroscopy , 2011, CVPR 2011.

[5]  Terry M. Peters,et al.  US–Fluoroscopy Registration for Transcatheter Aortic Valve Implantation , 2012, IEEE Transactions on Biomedical Engineering.

[6]  Vincent Lepetit,et al.  Dominant orientation templates for real-time detection of texture-less objects , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[7]  Tom Drummond,et al.  Multiple Target Localisation at over 100 FPS , 2009, BMVC.

[8]  YingLiang Ma,et al.  Registration of 3D trans-esophageal echocardiography to X-ray fluoroscopy using image-based probe tracking , 2012, Medical Image Anal..

[9]  Nassir Navab,et al.  Patient-Specific Modeling and Quantification of the Aortic and Mitral Valves From 4-D Cardiac CT and TEE , 2010, IEEE Transactions on Medical Imaging.

[10]  Russell H. Taylor,et al.  Information Processing in Computer-Assisted Interventions - Second International Conference, IPCAI 2011, Berlin, Germany, June 22, 2011. Proceedings , 2011, IPCAI.

[11]  Douglas Stanton,et al.  3D TEE Registration with X-Ray Fluoroscopy for Interventional Cardiac Applications , 2009, FIMH.