Patient-specific femoral shape estimation using a parametric model and two 2D fluoroscopic images

In medical diagnostic imaging, the X-ray CT scanner and the MRI system have been widely used to examine 3D shapes and internal structures of living organisms and bones. However, these apparatuses are generally large and very expensive. Since an appointment is also required before examination, these systems are not suitable for urgent fracture diagnosis in emergency treatment. However, Xray/fluoroscopy has been widely used as traditional medical diagnosis. Therefore, the realization of the reconstruction of precise 3D shapes of living organisms or bones from a few conventional 2D fluoroscopic images might be very useful in practice, in terms of cost, labor, and radiation exposure. The present paper proposes a method by which to estimate a patient-specific 3D shape of a femur from only two fluoroscopic images using a parametric femoral model. First, we develop a parametric femoral model by the statistical analysis of 3D femoral shapes created from CT images of 56 patients. Then, the position and shape parameters of the parametric model are estimated from two 2D fluoroscopic images using a distance map constructed by the Level Set Method. Experiments using in vivo images for hip prosthesis patients are successfully carried out, and it is verified that the proposed system has practical applications.

[1]  Frank Y. Shih,et al.  Fast Euclidean distance transformation in two scans using a 3 × 3 neighborhood , 2004, Comput. Vis. Image Underst..

[2]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[3]  Mads Nielsen,et al.  Non-rigid registration by geometry-constrained diffusion , 1999, Medical Image Anal..

[4]  Philip W. Smith,et al.  Stereo-based registration of multi-sensor imagery for enhanced visualization of remote environments , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[5]  Nicholas Ayache,et al.  Medical image registration using geometric hashing , 1997 .

[6]  Toyohisa Kaneko,et al.  Efficient and Handy Texture Mapping on 3D Surfaces , 1999, Comput. Graph. Forum.

[7]  Kahori NAKAMURA,et al.  3次元パラメトリックモデルと複数X線投影像を用いた股関節の形状復元 3 D reconstruction of a femoral shape using a parametric model and two 2 D radiographs , 2006 .

[8]  Ioannis Stamos,et al.  Integration of range and image sensing for photo-realistic 3D modeling , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[9]  Katsushi Ikeuchi,et al.  Simultaneous determination of registration and deformation parameters among 3D range images , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[10]  R. Y. Tsai,et al.  An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision , 1986, CVPR 1986.

[11]  Konrad Klein,et al.  Texturing 3D Models of Real World Objects from Multiple Unregistered Photographic Views , 1999, Comput. Graph. Forum.

[12]  Michael A. Greenspan,et al.  Approximate k-d tree search for efficient ICP , 2003, Fourth International Conference on 3-D Digital Imaging and Modeling, 2003. 3DIM 2003. Proceedings..

[13]  Yen-Wei Chen,et al.  Automated Segmentation of the Liver from 3D CT Images Using Probabilistic Atlas and Multi-level Statistical Shape Model , 2007, MICCAI.

[14]  Charles R. Meyer,et al.  Demonstration of accuracy and clinical versatility of mutual information for automatic multimodality image fusion using affine and thin-plate spline warped geometric deformations , 1997, Medical Image Anal..

[15]  Ryo Kurazume,et al.  Fast alignment of 3D geometrical models and 2D color images using 2D distance maps , 2005, Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM'05).

[16]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[17]  Jacques Feldmar,et al.  Rigid and Affine Registration of Smooth Surfaces using Differential Properties , 1994, ECCV.

[18]  Ioannis Stamos,et al.  Automatic 3D to 2D registration for the photorealistic rendering of urban scenes , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[19]  David J. Hawkes,et al.  Cadaver Validation of the Use of Ultrasound for 3D Model Instantiation of Bony Anatomy in Image Guided Orthopaedic Surgery , 2004, MICCAI.

[20]  Marcel Breeuwer,et al.  Computational Mesh Generation for Vascular Structures with Deformable Surfaces , 2006, International Journal of Computer Assisted Radiology and Surgery.

[21]  James A. Sethian,et al.  Level Set Methods and Fast Marching Methods , 1999 .

[22]  Katsushi Ikeuchi,et al.  Simultaneous 2D images and 3D geometric model registration for texture mapping utilizing reflectance attribute , 2002 .

[23]  Jürgen Weese,et al.  A comparison of similarity measures for use in 2-D-3-D medical image registration , 1998, IEEE Transactions on Medical Imaging.

[24]  M. Rioux,et al.  Registration of range and color images using gradient constraints and range intensity images , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[25]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[26]  Chia-Ling Tsai,et al.  A View-Based Approach to Registration: Theory and Application to Vascular Image Registration , 2003, IPMI.

[27]  W. Eric L. Grimson,et al.  2D-3D rigid registration of X-ray fluoroscopy and CT images using mutual information and sparsely sampled histogram estimators , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[28]  Guoyan Zheng,et al.  Reconstruction of Patient-Specific 3D Bone Surface from 2D Calibrated Fluoroscopic Images and Point Distribution Model , 2006, MICCAI.

[29]  Ioannis Stamos,et al.  Automatic registration of 2-D with 3-D imagery in urban environments , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[30]  Dimitris N. Metaxas,et al.  Dynamic 3D models with local and global deformations: deformable superquadrics , 1990, [1990] Proceedings Third International Conference on Computer Vision.

[31]  Nicholas Ayache,et al.  Three-dimensional multimodal brain warping using the Demons algorithm and adaptive intensity corrections , 2001, IEEE Transactions on Medical Imaging.

[32]  J A Sethian,et al.  A fast marching level set method for monotonically advancing fronts. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[33]  Olivier D. Faugeras,et al.  3D articulated models and multi-view tracking with silhouettes , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.