Monocular Vision- and IMU-Based System for Prosthesis Pose Estimation During Total Hip Replacement Surgery

The average age of population increases worldwide, so does the number of total hip replacement surgeries. Total hip replacement, however, often involves a risk of dislocation and prosthetic impingement. To minimize the risk after surgery, we propose an instrumented hip prosthesis that estimates the relative pose between prostheses intraoperatively and ensures the placement of prostheses within a safe zone. We create a model of the hip prosthesis as a ball and socket joint, which has four degrees of freedom (DOFs), including 3-DOF rotation and 1-DOF translation. We mount a camera and an inertial measurement unit (IMU) inside the hollow ball, or “femoral head prosthesis,” while printing customized patterns on the internal surface of the socket, or “acetabular cup.” Since the sensors were rigidly fixed to the femoral head prosthesis, measuring its motions poses a sensor ego-motion estimation problem. By matching feature points in images of the reference patterns, we propose a monocular vision based method with a relative error of less than 7% in the 3-DOF rotation and 8% in the 1-DOF translation. Further, to reduce system power consumption, we apply the IMU with its data fused by an extended Kalman filter to replace the camera in the 3-DOF rotation estimation, which yields a less than 4.8% relative error and a 21.6% decrease in power consumption. Experimental results show that the best approach to prosthesis pose estimation is a combination of monocular vision-based translation estimation and IMU-based rotation estimation, and we have verified the feasibility and validity of this system in prosthesis pose estimation.

[1]  J. B. Stiehl,et al.  Basic of Total Hip Replacement Surgery , 2004 .

[2]  Rainer Biedermann Validation and usefulness of a computer-assisted cup-positioning system in total hip arthroplasty. , 2007, The Journal of bone and joint surgery. American volume.

[3]  Christian Smith,et al.  Robot manipulators , 2009, IEEE Robotics & Automation Magazine.

[4]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[5]  Antonius Rohlmann,et al.  High-Tech Hip Implant for Wireless Temperature Measurements In Vivo , 2012, PloS one.

[6]  K. H. Widmer Is there really a “safe zone” for the placement of total hip components? , 2006 .

[7]  Qingguo Li,et al.  Concurrent validation of Xsens MVN measurement of lower limb joint angular kinematics , 2013, Physiological measurement.

[8]  I. Holm,et al.  Reliability of goniometric measurements and visual estimates of hip ROM in patients with osteoarthrosis. , 2000, Physiotherapy research international : the journal for researchers and clinicians in physical therapy.

[9]  Ashley W Blom,et al.  Dislocation following total hip replacement: the Avon Orthopaedic Centre experience. , 2008, Annals of the Royal College of Surgeons of England.

[10]  Robert B. McGhee,et al.  An extended Kalman filter for quaternion-based orientation estimation using MARG sensors , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[11]  Fredrik Öhberg,et al.  Comparative analysis of different adaptive filters for tracking lower segments of a human body using inertial motion sensors , 2013 .

[12]  Jiyang Gao,et al.  Design of a computer-aided visual system for Total Hip Replacement surgery , 2015, 2015 IEEE International Symposium on Circuits and Systems (ISCAS).

[13]  A von Strempel,et al.  [CT-based and CT-free navigation in total knee arthroplasty--a prospective comparative study with respects to clinical and radiological results]. , 2005, Zeitschrift fur Orthopadie und ihre Grenzgebiete.

[14]  Branislav Jaramaz,et al.  Description of Anatomic Coordinate Systems and Rationale for Use in an Image-Guided Total Hip Replacement System , 2000, MICCAI.

[15]  António Ramos,et al.  Active orthopaedic implants: Towards optimality , 2015, J. Frankl. Inst..

[16]  Shiying Hao,et al.  An implantable system for the in vivo measurement of Hip and Knee migration and micromotion , 2008, 2008 International Conference on Signals and Electronic Systems.

[17]  Noel C. Perkins,et al.  Accuracy of Femur Angles Estimated by IMUs During Clinical Procedures Used to Diagnose Femoroacetabular Impingement , 2015, IEEE Transactions on Biomedical Engineering.

[18]  J. J. Gerhardt,et al.  Range-of-motion measurements. , 1995, The Journal of bone and joint surgery. American volume.

[19]  Antonius Rohlmann,et al.  Total hip joint prosthesis for in vivo measurement of forces and moments. , 2010, Medical engineering & physics.

[20]  Jing Xie,et al.  Luminescence properties and energy transfer of Ce3+/Tb3+ co-doped Ca9La(PO4)5(SiO4)F2 phosphor , 2015 .

[21]  C. Kellett,et al.  ii) Complications of total hip arthroplasty , 2013 .

[22]  Guoyan Zheng,et al.  Augmented marker tracking for peri-acetabular osteotomy surgery , 2018, International Journal of Computer Assisted Radiology and Surgery.

[23]  Thomas Seel,et al.  IMU-Based Joint Angle Measurement for Gait Analysis , 2014, Sensors.

[24]  Yuan Ren,et al.  Nutation and Precession Stability Criterion of Magnetically Suspended Rigid Rotors With Gyroscopic Effects Based on Positive and Negative Frequency Characteristics , 2014, IEEE Transactions on Industrial Electronics.

[25]  A Rohlmann,et al.  Hip endoprosthesis for in vivo measurement of joint force and temperature. , 1999, Journal of biomechanics.

[26]  D. D’Lima,et al.  Bony Impingement Limits Design-related Increases in Hip Range of Motion , 2012, Clinical orthopaedics and related research.

[27]  B M Jolles,et al.  Functional calibration procedure for 3D knee joint angle description using inertial sensors. , 2009, Journal of biomechanics.

[28]  Jiancheng Fang,et al.  Whirling Modes Stability Criterion for a Magnetically Suspended Flywheel Rotor With Significant Gyroscopic Effects and Bending Modes , 2013, IEEE Transactions on Power Electronics.

[29]  Roman Kamnik,et al.  Kinematics based sensory fusion for wearable motion assessment in human walking , 2014, Comput. Methods Programs Biomed..

[30]  Zhengyou Zhang Essential Matrix , 2014, Computer Vision, A Reference Guide.

[31]  S. Kurtz,et al.  Projections of primary and revision hip and knee arthroplasty in the United States from 2005 to 2030. , 2007, The Journal of bone and joint surgery. American volume.

[32]  Jiyang Gao,et al.  A Visual-Aided Wireless Monitoring System Design for Total Hip Replacement Surgery , 2015, IEEE Transactions on Biomedical Circuits and Systems.

[33]  Bo Zhao,et al.  An energy efficient fully integrated OOK transceiver SoC for wireless body area networks , 2013, 2013 IEEE Asian Solid-State Circuits Conference (A-SSCC).

[34]  Zhaohui Huang,et al.  Photoluminescence properties and energy transfer behavior of Eu2+/Tb3+ co-doped Ba3Sc(PO4)3 phosphors , 2015 .

[35]  Farzam Farahmand,et al.  The impingement-dislocation risk of total hip replacement: Effects of cup orientation and patient maneuvers , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Jiyang Gao,et al.  Estimation of the relative pose of the femoral and acetabular components in a visual aided system for total hip replacement surgeries , 2014, 2014 IEEE 12th International New Circuits and Systems Conference (NEWCAS).

[37]  Shantanu Patil,et al.  Bony impingement affects range of motion after total hip arthroplasty: A subject‐specific approach , 2008, Journal of orthopaedic research : official publication of the Orthopaedic Research Society.

[38]  Hideki Yoshikawa,et al.  Anatomic hip range of motion after implantation during total hip arthroplasty as measured by a navigation system. , 2007, The Journal of arthroplasty.

[39]  Hartmuth Kiefer,et al.  OrthoPilot total hip arthroplasty workflow and surgery. , 2005, Orthopedics.