Reconstruction of knee anatomy from single-plane fluoroscopic x-ray based on a nonlinear statistical shape model

Abstract. Purpose: Reconstruction of patient anatomy is critical to patient-specific instrument (PSI) design in total joint replacement (TJR). Conventionally, computed tomography (CT) and magnetic resonance imaging (MRI) are used to obtain the patient anatomy as they are accurate imaging modalities. However, computing anatomical landmarks from the patient anatomy for PSIs requires either high-resolution CT, increasing time of scan and radiation exposure to the patient, or longer and more expensive MRI scans. As an alternative, reconstruction from single-plane fluoroscopic x-ray provides a cost-efficient tool to obtain patient anatomical structures while allowing capture of the patient’s joint dynamics, important clinical information for TJR. Approach: We present a three-dimensional (3D) reconstruction scheme that automatically and accurately reconstructs the 3D knee anatomy from single-plane fluoroscopic x-ray based on a nonlinear statistical shape model called kernel principal component analysis. To increase robustness, we designed a hybrid energy function that integrated feature and intensity information as a similarity measure for the 3D reconstruction. Results: We evaluated the proposed method on five subjects during deep knee bending: the root-mean-square accuracy is 1.19  ±  0.36  mm for reconstructed femur and 1.15  ±  0.17  mm for reconstructed tibia. Conclusions: The proposed method demonstrates reliable 3D bone model reconstruction accuracy with successful elimination of prior 3D imaging and reduction of manual labor and radiation dose on patient as well as characterizing joints in motion. This method is promising for applications in medical interventions such as patient-specific arthroplasty design, surgical planning, surgical navigation, and understanding anatomical and dynamic characteristics of joints.

[1]  Thomas Gerig,et al.  Gaussian Process Morphable Models , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Bernhard Schölkopf,et al.  Learning to Find Pre-Images , 2003, NIPS.

[3]  Marleen de Bruijne,et al.  2D-3D shape reconstruction of the distal femur from stereo X-ray imaging using statistical shape models , 2011, Medical Image Anal..

[4]  Mohamed R Mahfouz,et al.  Improving Sex Estimation from Crania Using a Novel Three‐dimensional Quantitative Method , , , 2014, Journal of forensic sciences.

[5]  Mohamed R. Mahfouz,et al.  In Vivo Kinematics Evaluation in Flexion of Patients Implanted With Primary TKA , 2011 .

[6]  Jing Wu,et al.  Robust x-ray image segmentation by spectral clustering and active shape model , 2016, Journal of medical imaging.

[7]  Jürgen Weese,et al.  Towards real-time multi-modality 3-D medical image registration , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  D. Bae,et al.  Computer Assisted Navigation in Knee Arthroplasty , 2011, Clinics in orthopedic surgery.

[9]  Mohamed Mahfouz,et al.  Patella sex determination by 3D statistical shape models and nonlinear classifiers. , 2007, Forensic science international.

[10]  Jing Wu,et al.  2D-3D Registration of Knee Joint from Single Plane X-ray Fluoroscopy Using Nonlinear Shape Priors , 2016 .

[11]  Stefan M. Gabriel,et al.  Three-dimensional determination of femoral-tibial contact positions under in vivo conditions using fluoroscopy. , 1998, Clinical biomechanics.

[12]  Pietro Cerveri,et al.  2D/3D reconstruction of the distal femur using statistical shape models addressing personalized surgical instruments in knee arthroplasty: A feasibility analysis , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[13]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[14]  William Hoff,et al.  In vivo determination of normal and anterior cruciate ligament-deficient knee kinematics. , 2005, Journal of biomechanics.

[15]  Guoyan Zheng,et al.  Articulated Statistical Shape Model-Based 2D-3D Reconstruction of a Hip Joint , 2014, IPCAI.

[16]  William A. Hoff,et al.  CT from an Unmodified Standard Fluoroscopy Machine Using a Non-reproducible Path , 2004, ECCV Workshops CVAMIA and MMBIA.

[17]  Nicholas S. Johnson,et al.  Comparison of 3D bone models of the knee joint derived from CT and 3T MR imaging. , 2017, European journal of radiology.

[18]  Jing Wu,et al.  Fully automatic initialization of two-dimensional–three-dimensional medical image registration using hybrid classifier , 2015, Journal of medical imaging.

[19]  Alexander J. Smola,et al.  Learning with kernels , 1998 .

[20]  Randy E. Ellis,et al.  A Surgical Planning and Guidance System for High Tibial Osteotomy , 1999 .

[21]  Jianhua Yao,et al.  Deformable 2 D-3 D Medical Image Registration Using a Statistical Model : Accuracy Factor Assessment , 2012 .

[22]  M. R. Mahfouz,et al.  Automatic methods for characterization of sexual dimorphism of adult femora: distal femur , 2007, Computer methods in biomechanics and biomedical engineering.

[23]  Marleen de Bruijne,et al.  Statistical Shape Model-Based Femur Kinematics From Biplane Fluoroscopy , 2012, IEEE Transactions on Medical Imaging.

[24]  Bostjan Likar,et al.  A review of 3D/2D registration methods for image-guided interventions , 2012, Medical Image Anal..

[25]  D Mitton,et al.  A Biplanar Reconstruction Method Based on 2D and 3D Contours: Application to the Distal Femur , 2003, Computer methods in biomechanics and biomedical engineering.

[26]  Richard D. Komistek,et al.  A robust method for registration of three-dimensional knee implant models to two-dimensional fluoroscopy images , 2003, IEEE Transactions on Medical Imaging.

[27]  Natalie R. Shirley,et al.  A three-dimensional analysis of bilateral directional asymmetry in the human clavicle. , 2012, American journal of physical anthropology.

[28]  Alejandro F. Frangi,et al.  3D bone mineral density distribution and shape reconstruction of the proximal femur from a single simulated DXA image: an in vitro study , 2010, Medical Imaging.

[29]  Ivor W. Tsang,et al.  The pre-image problem in kernel methods , 2003, IEEE Transactions on Neural Networks.

[30]  Gunnar Rätsch,et al.  Kernel PCA and De-Noising in Feature Spaces , 1998, NIPS.

[31]  Beat Schmutz,et al.  Quantification of the accuracy of MRI generated 3D models of long bones compared to CT generated 3D models. , 2012, Medical engineering & physics.

[32]  Guoyan Zheng,et al.  A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images , 2009, Medical Image Anal..

[33]  Guoyan Zheng,et al.  Statistical shape model-based reconstruction of a scaled, patient-specific surface model of the pelvis from a single standard AP x-ray radiograph. , 2010, Medical physics.

[34]  Joseph Michael Johnson,et al.  Analysis, Segmentation and Prediction of Knee Cartilage using Statistical Shape Models , 2013 .