Deep 3D Convolutional Networks to Segment Bones Affected by Severe Osteoarthritis in CT Scans for PSI-Based Knee Surgical Planning

Segmentation of bony structures in CT scans is a crucial step in knee arthroplasty based on personalized surgical instruments (PSI). As a matter of fact, the success of the surgery depends on the quality of the matching between the patient-specific resection jigs, manufactured exploiting the patient bony surfaces attained by segmentation, and true patient surfaces. Severe pathological conditions as chronic osteoarthritis, deteriorating the cartilages, narrowing the intra-articular spaces and leading to bone impingement, complicate the segmentation making the recognition of bony boundaries sub-optimal for traditional semi-automated methods and often extremely difficult even for expert radiologists. Deep convolutional neural networks (CNNs) have been investigated in the last years towards automatic labeling of diagnostic images, especially harnessing the encoding-decoding U-Net architecture. In this article, we implemented deep CNNs to encompass the concurrent segmentation of the distal femur and the proximal tibia in CT images and evaluate how segmentation uncertainty may impact on the surgical planning. A retrospective set of 200 knee CT scans of patients was used to train the network and test the segmentation performances. Tests on a subset of 20 scans provided median dice, sensitivity and positive predictive value indices greater than 96% for both shapes, with median 3D reconstruction error in the range of 0.5mm. Median 3D errors on both PSI femoral and tibial contact areas and surgical cut alignments were less than 2mm and 2°, respectively, which can be considered clinically acceptable. These results substantiate that deep CNN architectures can disclose the opportunity of segmenting bone shapes in CT scans for PSI-based surgical planning with promising accuracy. However, we observed that segmentation scores alone cannot be taken as representative of the 3D errors at the contact areas of the PSI. Therefore when comparing segmentation algorithms of PSI-based surgical planning the 3D errors should be explicitly analyzed.

[1]  Guoyan Zheng,et al.  Deep Learning-Based Automatic Segmentation of the Proximal Femur from MR Images. , 2018, Advances in experimental medicine and biology.

[2]  Dapeng Oliver Wu,et al.  Why Deep Learning Works: A Manifold Disentanglement Perspective , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[3]  Richard Kijowski,et al.  Deep convolutional neural network for segmentation of knee joint anatomy , 2018, Magnetic resonance in medicine.

[4]  Deukhee Lee,et al.  Automatic spine segmentation from CT images using Convolutional Neural Network via redundant generation of class labels , 2019, J. Comput. Des. Eng..

[5]  Takeshi Ogawa,et al.  Factors related to disagreement in implant size between preoperative CT-based planning and the actual implants used intraoperatively for total hip arthroplasty , 2018, International Journal of Computer Assisted Radiology and Surgery.

[6]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[7]  Abtin Alvand,et al.  The impact of patient-specific instrumentation on unicompartmental knee arthroplasty: a prospective randomised controlled study , 2017, Knee Surgery, Sports Traumatology, Arthroscopy.

[8]  Arakua Welbeck,et al.  Segmentation of the Proximal Femur from MR Images using Deep Convolutional Neural Networks , 2018, Scientific Reports.

[9]  Hao Chen,et al.  3-D RoI-Aware U-Net for Accurate and Efficient Colorectal Tumor Segmentation , 2018, IEEE Transactions on Cybernetics.

[10]  Hans-Peter Meinzer,et al.  Statistical shape models for 3D medical image segmentation: A review , 2009, Medical Image Anal..

[11]  Fang Chen,et al.  Three-Dimensional Feature-Enhanced Network for Automatic Femur Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[12]  Wouter M. Kouw,et al.  CT image segmentation of bone for medical additive manufacturing using a convolutional neural network , 2018, Comput. Biol. Medicine.

[13]  J. Seon,et al.  Assessing the accuracy of patient-specific guides for total knee arthroplasty , 2016, Knee Surgery, Sports Traumatology, Arthroscopy.

[14]  Mustafa Sungur,et al.  Postoperative mechanical alignment analysis of total knee replacement patients operated with 3D printed patient specific instruments: A Prospective Cohort Study , 2019, Acta orthopaedica et traumatologica turcica.

[15]  Guoyan Zheng,et al.  3D U-net with Multi-level Deep Supervision: Fully Automatic Segmentation of Proximal Femur in 3D MR Images , 2017, MLMI@MICCAI.

[16]  Ying Liu,et al.  Context-Aware U-Net for Biomedical Image Segmentation , 2018, 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[17]  Lian Ding,et al.  A Lightweight U-Net Architecture Multi-Scale Convolutional Network for Pediatric Hand Bone Segmentation in X-Ray Image , 2019, IEEE Access.

[18]  Pietro Cerveri,et al.  2D/3D reconstruction of the distal femur using statistical shape models addressing personalized surgical instruments in knee arthroplasty: A feasibility analysis , 2017, The international journal of medical robotics + computer assisted surgery : MRCAS.

[19]  Vincent V G An,et al.  The accuracy of bony resection from patient-specific guides during total knee arthroplasty , 2017, Knee Surgery, Sports Traumatology, Arthroscopy.

[20]  Ikram Nizam,et al.  Accuracy of bone resection in total knee arthroplasty using CT assisted-3D printed patient specific cutting guides , 2018, SICOT-J.

[21]  Cheng-Kai Lin,et al.  Patient-specific instrumentation improves functional kinematics of minimally-invasive total knee replacements as revealed by computerized 3D fluoroscopy , 2019, Comput. Methods Programs Biomed..

[22]  Andrea Colombelli,et al.  Patient specific instrumentation in total knee arthroplasty , 2017, Acta bio-medica : Atenei Parmensis.

[23]  Carolyn Anglin,et al.  Guiding Device for the Patellar Cut in Total Knee Arthroplasty: Design and Validation , 2018, Bioengineering.

[24]  Xiaohui Xie,et al.  AnatomyNet: Deep learning for fast and fully automated whole‐volume segmentation of head and neck anatomy , 2018, Medical physics.

[25]  Pietro Cerveri,et al.  Stacked sparse autoencoder networks and statistical shape models for automatic staging of distal femur trochlear dysplasia , 2018, The international journal of medical robotics + computer assisted surgery : MRCAS.

[26]  Darren B Chen,et al.  Resection accuracy of patient‐specific cutting guides in total knee replacement , 2017, ANZ journal of surgery.

[27]  Mark R Pickering,et al.  Statistical shape modelling reveals large and distinct subchondral bony differences in osteoarthritic knees. , 2019, Journal of biomechanics.

[28]  F. Castoldi,et al.  Patient specific instrumentation in total knee arthroplasty: a state of the art. , 2016, Annals of translational medicine.

[29]  José G. Tamez-Peña,et al.  Unsupervised Segmentation and Quantification of Anatomical Knee Features: Data From the Osteoarthritis Initiative , 2012, IEEE Transactions on Biomedical Engineering.

[30]  Sim Heng Ong,et al.  Fast segmentation of bone in CT images using 3D adaptive thresholding , 2010, Comput. Biol. Medicine.

[31]  Jiapan Guo,et al.  Automatic segmentation of the mandible from computed tomography scans for 3D virtual surgical planning using the convolutional neural network , 2019, Physics in medicine and biology.

[32]  Randy E. Ellis,et al.  Validation of bone segmentation and improved 3-D registration using contour coherency in CT data , 2006, IEEE Transactions on Medical Imaging.

[33]  Ron Kikinis,et al.  An Effective Interactive Medical Image Segmentation Method Using Fast GrowCut , 2014 .

[34]  Ate B. Wymenga,et al.  Stability and alignment do not improve by using patient-specific instrumentation in total knee arthroplasty: a randomized controlled trial , 2018, Knee Surgery, Sports Traumatology, Arthroscopy.

[35]  Bo Wang,et al.  Patient-specific instrumentation improved axial alignment of the femoral component, operative time and perioperative blood loss after total knee arthroplasty , 2018, Knee Surgery, Sports Traumatology, Arthroscopy.

[36]  Michael Sandborg,et al.  Segmentation of bones in medical dual-energy computed tomography volumes using the 3D U-Net. , 2020, Physica medica : PM : an international journal devoted to the applications of physics to medicine and biology : official journal of the Italian Association of Biomedical Physics.

[37]  S. Majumdar,et al.  Use of 2D U-Net Convolutional Neural Networks for Automated Cartilage and Meniscus Segmentation of Knee MR Imaging Data to Determine Relaxometry and Morphometry. , 2018, Radiology.

[38]  J. P. Sousa,et al.  Patient-specific instrumentation in total knee arthroplasty: simpler, faster and more accurate than standard instrumentation—a randomized controlled trial , 2017, Knee Surgery, Sports Traumatology, Arthroscopy.

[39]  Timothy F. Cootes,et al.  Fully Automatic Segmentation of the Proximal Femur Using Random Forest Regression Voting , 2013, IEEE Transactions on Medical Imaging.

[40]  Klaus H. Maier-Hein,et al.  Automatic bone segmentation in whole-body CT images , 2018, International Journal of Computer Assisted Radiology and Surgery.

[41]  T. Smith,et al.  Favourable rotational alignment outcomes in PSI knee arthroplasty: A Level 1 systematic review and meta-analysis. , 2016, The Knee.

[42]  Olivier Cartiaux,et al.  Improved Accuracy with 3D Planning and Patient-Specific Instruments During Simulated Pelvic Bone Tumor Surgery , 2013, Annals of Biomedical Engineering.

[43]  Pietro Cerveri,et al.  Automating the design of resection guides specific to patient anatomy in knee replacement surgery by enhanced 3D curvature and surface modeling of distal femur shape models , 2014, Comput. Medical Imaging Graph..

[44]  S. Hofmann,et al.  Patient-specific total knee arthroplasty: the importance of planning by the surgeon , 2013, Knee Surgery, Sports Traumatology, Arthroscopy.

[45]  Guoyan Zheng,et al.  Latent3DU-net: Multi-level Latent Shape Space Constrained 3D U-net for Automatic Segmentation of the Proximal Femur from Radial MRI of the Hip , 2018, MLMI@MICCAI.

[46]  Olufemi R. Ayeni,et al.  Total knee arthroplasty using patient-specific instrumentation for osteoarthritis of the knee: a meta-analysis , 2019, BMC Musculoskeletal Disorders.

[47]  Eva Schwameis,et al.  Erratum to: Patient-specific instrumentation improved mechanical alignment, while early clinical outcome was comparable to conventional instrumentation in TKA , 2016, Knee Surgery, Sports Traumatology, Arthroscopy.

[48]  Peter Fennema,et al.  Efficacy of Patient-Specific Instruments in Total Knee Arthroplasty: A Systematic Review and Meta-Analysis , 2017, The Journal of bone and joint surgery. American volume.

[49]  Tim Bryant,et al.  A high level of satisfaction after bicompartmental individualized knee arthroplasty with patient-specific implants and instruments , 2018, Knee Surgery, Sports Traumatology, Arthroscopy.

[50]  Carsten O Tibesku,et al.  Improved femoral component rotation in TKA using patient-specific instrumentation. , 2014, The Knee.

[51]  Jaesung Hong,et al.  CT-based Navigation System Using a Patient-Specific Instrument for Femoral Component Positioning: An Experimental in vitro Study with a Sawbone Model , 2018, Yonsei medical journal.

[52]  Shaohua Kevin Zhou,et al.  Segmentation of Multiple Knee Bones from CT for Orthopedic Knee Surgery Planning , 2014, MICCAI.

[53]  Pietro Cerveri,et al.  Towards automatic computer‐aided knee surgery by innovative methods for processing the femur surface model , 2010, The international journal of medical robotics + computer assisted surgery : MRCAS.

[54]  Eva Schwameis,et al.  Patient-specific instrumentation improved mechanical alignment, while early clinical outcome was comparable to conventional instrumentation in TKA , 2014, Knee Surgery, Sports Traumatology, Arthroscopy.