Simultaneous correspondence and non-rigid 3D reconstruction of the coronary tree from single X-ray images

We present a novel approach to simultaneously reconstruct the 3D structure of a non-rigid coronary tree and estimate point correspondences between an input X-ray image and a reference 3D shape. At the core of our approach lies an optimization scheme that iteratively fits a generative 3D model of increasing complexity and guides the matching process. As a result, and in contrast to existing approaches that assume rigidity or quasi-rigidity of the structure, our method is able to retrieve large non-linear deformations even when the input data is corrupted by the presence of noise and partial occlusions. We extensively evaluate our approach under synthetic and real data and demonstrate a remarkable improvement compared to state-of-the-art.

[1]  Örjan Smedby,et al.  Coronary Artery Segmentation and Skeletonization Based on Competing Fuzzy Connectedness Tree , 2007, MICCAI.

[2]  Stefan Klein,et al.  Patient Specific 4D Coronary Models from ECG-gated CTA Data for Intra-operative Dynamic Alignment of CTA with X-ray Images , 2009, MICCAI.

[3]  Raquel Urtasun,et al.  Combining discriminative and generative methods for 3D deformable surface and articulated pose reconstruction , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  H. Bischof,et al.  Edge Based Tube Detection for Coronary Artery Centerline Extraction , 2008, The MIDAS Journal.

[5]  Paul Suetens,et al.  Vesselness-based 2D–3D registration of the coronary arteries , 2009, International Journal of Computer Assisted Radiology and Surgery.

[6]  Nassir Navab,et al.  Deformable 2D-3D Registration of Vascular Structures in a One View Scenario , 2009, IEEE Transactions on Medical Imaging.

[7]  Michael J. Black,et al.  Combined discriminative and generative articulated pose and non-rigid shape estimation , 2007, NIPS.

[8]  Sebastian Thrun,et al.  SCAPE: shape completion and animation of people , 2005, SIGGRAPH '05.

[9]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using orthonormal matrices , 1988 .

[10]  Kawal S. Rhode,et al.  Intensity-based 2-D - 3-D registration of cerebral angiograms , 2003, IEEE Transactions on Medical Imaging.

[11]  Pascal Fua,et al.  Delineating trees in noisy 2D images and 3D image-stacks , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  R. Prim.  Shortest connection networks and some generalizations , 1957 .

[13]  T. Peters,et al.  2D-3D registration of coronary angiograms for cardiac procedure planning and guidance. , 2005, Medical physics.

[14]  Adrien Bartoli,et al.  Monocular Template-based Reconstruction of Inextensible Surfaces , 2011, International Journal of Computer Vision.

[15]  Laurent D. Cohen,et al.  Tubular anisotropy for 2D vessel segmentation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Russell H. Taylor,et al.  Assessing accuracy factors in deformable 2D/3D medical image registration using a statistical pelvis model , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Ankur Agarwal,et al.  3D human pose from silhouettes by relevance vector regression , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[18]  Laurent D. Cohen,et al.  Tubular anisotropy for 2D vessel segmentation , 2009, CVPR.

[19]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[20]  Kiriakos N. Kutulakos,et al.  Semidefinite Programming Heuristics for Surface Reconstruction Ambiguities , 2008, ECCV.

[21]  Michael J. Black,et al.  HumanEva: Synchronized Video and Motion Capture Dataset for Evaluation of Articulated Human Motion , 2006 .

[22]  Trevor Darrell,et al.  Sparse probabilistic regression for activity-independent human pose inference , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[24]  Trevor Darrell,et al.  Fast pose estimation with parameter-sensitive hashing , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[25]  Cristian Sminchisescu,et al.  Learning Joint Top-Down and Bottom-up Processes for 3D Visual Inference , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[26]  J. Munkres.  ALGORITHMS FOR THE ASSIGNMENT AND TRANSIORTATION tROBLEMS* , 1957 .

[27]  Andriy Myronenko,et al.  Point Set Registration: Coherent Point Drift , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Francesc Moreno-Noguer,et al.  Simultaneous pose, correspondence and non-rigid shape , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Vincent Lepetit,et al.  Closed-Form Solution to Non-rigid 3D Surface Registration , 2008, ECCV.

[30]  Martin Styner,et al.  Standardized evaluation methodology and reference database for evaluating coronary artery centerline extraction algorithms , 2009, Medical Image Anal..