Landmarks Detection with Anatomical Constraints for Total Hip Arthroplasty Preoperative Measurements

Total hip arthroplasty (THA) is a valid and reliable treatment for degenerative hip disease, and an elaborate preoperative planning is vital for such surgery. The key step of planning is to localize several anatomical landmarks in X-ray images for preoperative measurements. Conventionally, this work is almost conducted by surgeons manually that is labor-intensive and time-consuming. In this paper, we propose an automatic measurement method by detecting anatomical landmarks with the latest deep learning approaches. However, locating these landmarks automatically with high precision in X-ray images is challenging since image features of a certain landmark are subject to the variations of imaging postures and hip appearances. To this end, we impose the relative position constraints on each landmark by defining edges among landmarks according to the clinical significance. With multi-task learning, our method predicts the landmarks and edges simultaneously. Thus the correlations among these landmarks are exploited to correct the detection deviations implicitly in the network training. Extensive experiment results on two datasets have indicated the superiority of the anatomical constrained method and its potential for clinical applications.

[1]  Jun Zhang,et al.  Detecting Anatomical Landmarks From Limited Medical Imaging Data Using Two-Stage Task-Oriented Deep Neural Networks , 2017, IEEE Transactions on Image Processing.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Yaozong Gao,et al.  Robust Anatomical Landmark Detection for MR Brain Image Registration , 2014, MICCAI.

[4]  Dwarikanath Mahapatra,et al.  Landmark Detection in Cardiac MRI Using Learned Local Image Statistics , 2012, STACOM.

[5]  Shaohua Kevin Zhou,et al.  Less is More: Simultaneous View Classification and Landmark Detection for Abdominal Ultrasound Images , 2018, MICCAI.

[6]  Wenping Wang,et al.  Cephalometric Landmark Detection by AttentiveFeature Pyramid Fusion and Regression-Voting , 2019, MICCAI.

[7]  Jie Li,et al.  An Attention-Guided Deep Regression Model for Landmark Detection in Cephalograms , 2019, MICCAI.

[8]  Chengwen Chu,et al.  Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge , 2015, IEEE Transactions on Medical Imaging.

[9]  Dimitris N. Metaxas,et al.  Automated anatomical landmark detection ondistal femur surface using convolutional neural network , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[10]  Yaozong Gao,et al.  Collaborative regression-based anatomical landmark detection. , 2015, Physics in medicine and biology.

[11]  Timothy F. Cootes,et al.  Fully Automatic Cephalometric Evaluation using Random Forest Regression-Voting , 2015, ISBI 2015.

[12]  Horst Bischof,et al.  Regressing Heatmaps for Multiple Landmark Localization Using CNNs , 2016, MICCAI.

[13]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[14]  Bishesh Khanal,et al.  Fast Multiple Landmark Localisation Using a Patch-based Iterative Network , 2018, MICCAI.

[15]  Dong Liu,et al.  Deep High-Resolution Representation Learning for Human Pose Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[17]  Xiaoguang Lu,et al.  Discriminative Context Modeling Using Auxiliary Markers for LV Landmark Detection from a Single MR Image , 2012, STACOM.

[18]  Tim Leiner,et al.  CNN-based Landmark Detection in Cardiac CTA Scans , 2018, ArXiv.

[19]  Nassir Navab,et al.  X-ray-transform Invariant Anatomical Landmark Detection for Pelvic Trauma Surgery , 2018, MICCAI.

[20]  Jeremy Tan,et al.  Deep Adversarial Context-Aware Landmark Detection for Ultrasound Imaging , 2018, MICCAI.

[21]  Peng Yuan,et al.  Context-guided fully convolutional networks for joint craniomaxillofacial bone segmentation and landmark digitization , 2019, Medical Image Anal..

[22]  Seung-Jae Lim,et al.  Plain Radiography of the Hip: A Review of Radiographic Techniques and Image Features , 2015, Hip & pelvis.