A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images

Constructing a 3D bone surface model from a limited number of calibrated 2D X-ray images (e.g. 2) and a 3D point distribution model is a challenging task, especially, when we would like to construct a patient-specific surface model of a bone with pathology. One of the key steps for such a 2D/3D reconstruction is to establish correspondences between the 2D images and the 3D model. This paper presents a 2D/3D correspondence building method based on a non-rigid 2D point matching process, which iteratively uses a symmetric injective nearest-neighbor mapping operator and 2D thin-plate splines based deformations to find a fraction of best matched 2D point pairs between features extracted from the X-ray images and those extracted from the 3D model. The estimated point pairs are then used to set up a set of 3D point pairs such that we turn a 2D/3D reconstruction problem to a 3D/3D one, whose solutions are well studied. Incorporating this 2D/3D correspondence building method, a 2D/3D reconstruction scheme combining a statistical instantiation with a regularized shape deformation has been developed. Comprehensive experiments on clinical datasets and on images of cadaveric femurs with both non-pathologic and pathologic cases are designed and conducted to evaluate the performance of the 2D/3D correspondence building method as well as that of the 2D/3D reconstruction scheme. Quantitative and qualitative evaluation results are given, which demonstrate the validity of the present method and scheme.

[1]  Serge J. Belongie,et al.  Approximate Thin Plate Spline Mappings , 2002, ECCV.

[2]  Max Mignotte,et al.  3D/2D registration and segmentation of scoliotic vertebrae using statistical models. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[3]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[4]  L. Joskowicz,et al.  FRACAS: a system for computer-aided image-guided long bone fracture surgery. , 1998, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[5]  Thorsten M. Buzug,et al.  Evaluation and Enhancement of a Procedure for Generating a 3D Bone Model Using Radiographs , 2007 .

[6]  Martin Styner,et al.  Accurate and Robust Reconstruction of a Surface Model of the Proximal Femur From Sparse-Point Data and a Dense-Point Distribution Model for Surgical Navigation , 2007, IEEE Transactions on Biomedical Engineering.

[7]  Robert D. Nowak,et al.  Robust contour matching via the order-preserving assignment problem , 2006, IEEE Transactions on Image Processing.

[8]  M. Müller,et al.  The value of preoperative planning for total hip arthroplasty , 1998 .

[9]  Liqun Fu,et al.  Performance and Robustness of Automatic Fluoroscopic Image Calibration in a New Computer Assisted Surgery System , 2001, MICCAI.

[10]  K. Mardia,et al.  Statistical Shape Analysis , 1998 .

[11]  Timothy F. Cootes,et al.  Active shape models , 1998 .

[12]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[13]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Guoyan Zheng,et al.  Automatic Extraction of Femur Contours from Calibrated Fluoroscopic Images , 2007, 2007 IEEE Workshop on Applications of Computer Vision (WACV '07).

[15]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Leo Joskowicz,et al.  Robust Automatic C-Arm Calibration for Fluoroscopy-Based Navigation: A Practical Approach , 2002, MICCAI.

[17]  Hans-Christian Hege,et al.  Atlas-based 3D-Shape Reconstruction from X-Ray Images , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[19]  Tim Cootes,et al.  Automatic segmentation of lumbar vertebrae on digitised radiographs using linked active appearance models , 2006 .

[20]  I. Jolliffe Principal Component Analysis , 2002 .

[21]  Russell H. Taylor,et al.  Assessing accuracy factors in deformable 2D/3D medical image registration using a statistical pelvis model , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[22]  Guoyan Zheng,et al.  Reconstruction of Patient-Specific 3D Bone Surface from 2D Calibrated Fluoroscopic Images and Point Distribution Model , 2006, MICCAI.

[23]  Timothy F. Cootes,et al.  A minimum description length approach to statistical shape modeling , 2002, IEEE Transactions on Medical Imaging.

[24]  Guoyan Zheng,et al.  Statistical deformable bone models for robust 3D surface extrapolation from sparse data , 2007, Medical Image Anal..

[25]  Guoyan Zheng,et al.  3-D reconstruction of a surface model of the proximal femur from digital biplanar radiographs , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[26]  Guido Gerig,et al.  Elastic model-based segmentation of 3-D neuroradiological data sets , 1999, IEEE Transactions on Medical Imaging.

[27]  Guoyan Zheng,et al.  Unsupervised Reconstruction of a Patient-Specific Surface Model of a Proximal Femur from Calibrated Fluoroscopic Images , 2007, MICCAI.

[28]  T. H.,et al.  The Journal of Bone and Joint Surgery , 2006 .

[29]  Takeo Kanade,et al.  Geometric camera calibration using systems of linear equations , 1988, Proceedings. 1988 IEEE International Conference on Robotics and Automation.

[30]  Paul Suetens,et al.  Evaluation of image features and search strategies for segmentation of bone structures in radiographs using Active Shape Models , 2002, Medical Image Anal..

[31]  C. Small The statistical theory of shape , 1996 .

[32]  Peter Kazanzides,et al.  A C-Arm Fluoroscopy-Guided Progressive Cut Refinement Strategy Using a Surgical Robot , 2000 .

[33]  Robert Rohling,et al.  Automatic detection of fiducial markers in fluoroscopy images for on-line calibration. , 2005, Medical physics.

[34]  C Krettek,et al.  Computer-assisted fluoroscopy-based reduction of femoral fractures and antetorsion correction. , 2000, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[35]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[36]  L P Nolte,et al.  Fluoroscopy as an imaging means for computer-assisted surgical navigation. , 1999, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[37]  Fred L. Bookstein,et al.  Principal Warps: Thin-Plate Splines and the Decomposition of Deformations , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  C. Barillot,et al.  Interindividual functional mapping: a nonlinear local approach , 2003, NeuroImage.

[39]  Leo Joskowicz,et al.  Gradient-Based 2D/3D Rigid Registration of Fluoroscopic X-ray to CT , 2003, IEEE Trans. Medical Imaging.

[40]  R. Phillips,et al.  Image analysis for computer-assisted internal fixation of hip fractures , 2000, Medical Image Anal..

[41]  A Gueziec,et al.  A C-arm fluoroscopy-guided progressive cut refinement strategy using a surgical robot. , 2000, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[42]  Guoyan Zheng A Novel 3D/2D Correspondence Building Method for Anatomy-Based Registration , 2006, WBIR.

[43]  Tomaso A. Poggio,et al.  Regularization Networks and Support Vector Machines , 2000, Adv. Comput. Math..

[44]  R S Ledley,et al.  Computerized Medical Imaging and Graphics evolves from Computerized Tomography. , 1988, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[45]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[46]  Ying Chen,et al.  Automatic Extraction of Femur Contours from Hip X-Ray Images , 2005, CVBIA.

[47]  Martin Styner,et al.  Evaluation of 3D Correspondence Methods for Model Building , 2003, IPMI.

[48]  D Mitton,et al.  A Biplanar Reconstruction Method Based on 2D and 3D Contours: Application to the Distal Femur , 2003, Computer methods in biomechanics and biomedical engineering.

[49]  David S. Doermann,et al.  Robust point matching for nonrigid shapes by preserving local neighborhood structures , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Timothy F. Cootes,et al.  Automatic segmentaton of lumbar vertebrae on digitised radiographs using linked Active Appearance Models , 2006 .

[51]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[52]  Anand Rangarajan,et al.  A new point matching algorithm for non-rigid registration , 2003, Comput. Vis. Image Underst..

[53]  D. Kendall A Survey of the Statistical Theory of Shape , 1989 .

[54]  Stephen J. McKenna,et al.  Segmenting Tibia and Femur from Knee X-ray Images , 2005 .

[55]  Peter Kazanzides,et al.  Anatomy-based registration of CT-scan and intraoperative X-ray images for guiding a surgical robot , 1998, IEEE Transactions on Medical Imaging.

[56]  Guoyan Zheng,et al.  Surface Reconstruction of Bone from X-ray Images and Point Distribution Model Incorporating a Novel Method for 2D-3D Correspondence , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[57]  L. Joskowicz,et al.  Gradient-based 2-D/3-D rigid registration of fluoroscopic X-ray to CT , 2003, IEEE Transactions on Medical Imaging.

[58]  Aaron Hertzmann,et al.  Illustrating smooth surfaces , 2000, SIGGRAPH.

[59]  Lawrence H. Staib,et al.  Shape-based 3D surface correspondence using geodesics and local geometry , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[60]  Stéphane Lavallée,et al.  Nonrigid 3-D/2-D Registration of Images Using Statistical Models , 1999, MICCAI.

[61]  J. D. De Guise,et al.  3D reconstruction of the proximal femur with low-dose digital stereoradiography , 2004, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[62]  F. Bookstein Size and Shape Spaces for Landmark Data in Two Dimensions , 1986 .