Detection of human lower limb mechanical axis key points and its application on patella misalignment detection

The human lower limb mechanical axis is the most basic and essential diagnosis reference in clinical orthopedics. Orthopedists diagnose the varus or valgus knee according to the status of the lower limb mechanical axis. The conventional method used in this task relies on manual measurement, which is time-consuming and has operational differences. Given the above reason, in this work, we focus on designing a deep learning algorithm to address this problem and present a novel convolutional neural network architecture for mechanical axis detection. After the mechanical axis is detected, HKAA (Hip-Knee-Ankle Angle), which is a medical index, can be calculated automatically to assist in the medical diagnosis. We locate the mechanical axis by detecting both ends’ key points. Then we apply the detected key points to implement the patella misalignment detection for auxiliary radiography imaging. The mechanical axis key points detection network is based on the stacked hourglass module and adopts the deformable convolution for modeling the geometric features. Besides, we introduce an offset branch to reduce the systematic error. Then a detector trained in a semi-supervised strategy is applied for patella detection. The horizontal deviation of the patella from the knee center reflects the alignment of the patella. We use 879 collected radiographs (X-ray images) to train the key point detection model and other 98 radiographs perform as the validation set in this study. The proposed model achieves an accuracy of 83.0% for key points and reaches 61.1 mAP in patella detection. This model achieves excellent performance in human lower limb mechanical axis and patella detection.

[1]  Micah J. Sheller,et al.  The future of digital health with federated learning. , 2020, NPJ digital medicine.

[2]  Leena Sharma,et al.  The influence of alignment on risk of knee osteoarthritis progression according to baseline stage of disease. , 2002, Arthritis and rheumatism.

[3]  Yike Guo,et al.  The assessment of small bowel motility with attentive deformable neural network , 2020, Inf. Sci..

[4]  Xilin Chen,et al.  Dynamic R-CNN: Towards High Quality Object Detection via Dynamic Training , 2020, ECCV.

[5]  Muammer Turkoglu COVIDetectioNet: COVID-19 diagnosis system based on X-ray images using features selected from pre-learned deep features ensemble , 2020, Applied Intelligence.

[6]  Yuandong Tian,et al.  Exploring the Spatial Hierarchy of Mixture Models for Human Pose Estimation , 2012, ECCV.

[7]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated diagnosis of congestive heart failure using ECG signals , 2018, Applied Intelligence.

[8]  Guodong Guo,et al.  LS-CNN: Characterizing Local Patches at Multiple Scales for Face Recognition , 2020, IEEE Transactions on Information Forensics and Security.

[9]  Honggang Qi,et al.  Multi-Scale Structure-Aware Network for Human Pose Estimation , 2018, ECCV.

[10]  Ying Wu,et al.  Deeply Learned Compositional Models for Human Pose Estimation , 2018, ECCV.

[11]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[12]  Yi Yang,et al.  Articulated Human Detection with Flexible Mixtures of Parts , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Micah J. Sheller,et al.  The future of digital health with federated learning , 2020, npj Digital Medicine.

[14]  Sung-Jun Park,et al.  Intelligent analysis of coronal alignment in lower limbs based on radiographic image with convolutional neural network , 2020, Comput. Biol. Medicine.

[15]  L. Sharma,et al.  The role of knee alignment in disease progression and functional decline in knee osteoarthritis. , 2001, JAMA.

[16]  Jenq-Neng Hwang,et al.  Photometric transfer for direct visual odometry , 2021, Knowl. Based Syst..