Misshapen Pelvis Landmark Detection With Local-Global Feature Learning for Diagnosing Developmental Dysplasia of the Hip

Developmental dysplasia of the hip (DDH) is one of the most common orthopedic disorders in infants and young children. Accurately detecting and identifying the misshapen anatomical landmarks plays a crucial role in the diagnosis of DDH. However, the diversity during the calcification and the deformity due to the dislocation lead it a difficult task to detect the misshapen pelvis landmarks for both human expert and computer. Generally, the anatomical landmarks exhibit stable morphological features in part regions and rigid structural features in long ranges, which can be strong identification for the landmarks. In this paper, we investigate the local morphological features and global structural features for the misshapen landmark detection with a novel Pyramid Non-local UNet (PN-UNet). Firstly, we mine the local morphological features with a series of convolutional neural network (CNN) stacks, and convert the detection of a landmark to the segmentation of the landmark’s local neighborhood by UNet. Secondly, a non-local module is employed to capture the global structural features with high-level structural knowledge. With the end-to-end and accurate detection of pelvis landmarks, we realize a fully automatic and highly reliable diagnosis of DDH. In addition, a dataset with 10,000 pelvis X-ray images is constructed in our work. It is the first public dataset for diagnosing DDH and has been already released for open research. To the best of our knowledge, this is the first attempt to apply deep learning method in the diagnosis of DDH. Experimental results show that our approach achieves an excellent precision in landmark detection (average point to point error of 0.9286mm) and illness diagnosis over human experts. Project is available at http://imcc.ustc.edu.cn/project/ddh/.

[1]  Marios Anthimopoulos,et al.  Lung Pattern Classification for Interstitial Lung Diseases Using a Deep Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[2]  Yongdong Zhang,et al.  Misshapen Pelvis Landmark Detection by Spatial Local Correlation Mining for Diagnosing Developmental Dysplasia of the Hip , 2019, MICCAI.

[3]  Mohan S. Kankanhalli,et al.  Hierarchical Clustering Multi-Task Learning for Joint Human Action Grouping and Recognition , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Carlos Vázquez,et al.  Automatic detection of anatomical regions in frontal x-ray images: comparing convolutional neural networks to random forest , 2018, Medical Imaging.

[5]  Ben Glocker,et al.  Stratified Decision Forests for Accurate Anatomical Landmark Localization in Cardiac Images , 2017, IEEE Transactions on Medical Imaging.

[6]  Chengwen Chu,et al.  Evaluation and Comparison of Anatomical Landmark Detection Methods for Cephalometric X-Ray Images: A Grand Challenge , 2015, IEEE Transactions on Medical Imaging.

[7]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Maher A. Sid-Ahmed,et al.  An image processing system for locating craniofacial landmarks , 1994, IEEE Trans. Medical Imaging.

[9]  Emin Akata,et al.  A novel computer-based method for measuring the acetabular angle on hip radiographs , 2017, Acta orthopaedica et traumatologica turcica.

[10]  Mohammad A. Al-Abed,et al.  Algorithm for automatic angles measurement and screening for Developmental Dysplasia of the Hip (DDH) , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[11]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[12]  R. Aspden,et al.  Sex differences in proximal femur shape: findings from a population-based study in adolescents , 2020, Scientific Reports.

[13]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[14]  Jayaram K. Udupa,et al.  Oriented Active Shape Models , 2009, IEEE Transactions on Medical Imaging.

[15]  Yunchao Wei,et al.  CCNet: Criss-Cross Attention for Semantic Segmentation , 2018, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[16]  K. Mulpuri,et al.  Reliability of a New Radiographic Classification for Developmental Dysplasia of the Hip , 2015, Journal of pediatric orthopedics.

[17]  J. Madsen,et al.  Hip status in cerebral palsy after one year of continuous intrathecal baclofen infusion. , 2004, Pediatric neurology.

[18]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Ching-Wei Wang,et al.  Fully Automatic System for Accurate Localisation and Analysis of Cephalometric Landmarks in Lateral Cephalograms , 2016, Scientific Reports.

[20]  Yongdong Zhang,et al.  Extract Bone Parts Without Human Prior: End-to-end Convolutional Neural Network for Pediatric Bone Age Assessment , 2019, MICCAI.

[21]  Wen-Huang Cheng,et al.  Background Extraction Using Random Walk Image Fusion , 2018, IEEE Transactions on Cybernetics.

[22]  Dong Liu,et al.  Deep High-Resolution Representation Learning for Human Pose Estimation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[24]  Yaozong Gao,et al.  Detecting Anatomical Landmarks for Fast Alzheimer’s Disease Diagnosis , 2016, IEEE Transactions on Medical Imaging.

[25]  Timothy Woodacre,et al.  The costs of late detection of developmental dysplasia of the hip , 2013, Journal of children's orthopaedics.

[26]  D. Eastwood,et al.  Screening and treatment in developmental dysplasia of the hip—where do we go from here? , 2011, International Orthopaedics.

[27]  Milan Sonka,et al.  Segmentation and interpretation of MR brain images. An improved active shape model , 1998, IEEE Transactions on Medical Imaging.

[28]  Yongdong Zhang,et al.  Automated pulmonary nodule detection in CT images using deep convolutional neural networks , 2019, Pattern Recognit..

[29]  N. Clarke,et al.  The natural history of developmental dysplasia of the hip after early supervised treatment in the Pavlik harness. A prospective, longitudinal follow-up. , 2002, The Journal of bone and joint surgery. British volume.

[30]  J. McCauley,et al.  Use of intraoperative X-rays to optimize component position and leg length during total hip arthroplasty. , 2014, The Journal of arthroplasty.

[31]  Jia Deng,et al.  Stacked Hourglass Networks for Human Pose Estimation , 2016, ECCV.

[32]  Wen-Huang Cheng,et al.  Segmenting Hepatic Lesions Using Residual Attention U-Net with an Adaptive Weighted Dice Loss , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[33]  Ulas Bagci,et al.  Deep Geodesic Learning for Segmentation and Anatomical Landmarking , 2018, IEEE Transactions on Medical Imaging.

[34]  Abhinav Gupta,et al.  Non-local Neural Networks , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[35]  Fernando Ruiz Santiago,et al.  Imaging of Hip Pain: From Radiography to Cross-Sectional Imaging Techniques , 2016, Radiology research and practice.

[36]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[37]  Bulat Ibragimov,et al.  Fully automated quantitative cephalometry using convolutional neural networks , 2017, Journal of medical imaging.

[38]  Wen-Huang Cheng,et al.  Background Extraction Based on Joint Gaussian Conditional Random Fields , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[39]  Nima Tajbakhsh,et al.  UNet++: A Nested U-Net Architecture for Medical Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[40]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[41]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[42]  Timothy Hong,et al.  Cochrane Review: Screening programmes for developmental dysplasia of the hip in newborn infants. , 2013, Evidence-based child health : a Cochrane review journal.

[43]  Jun Fu,et al.  Dual Attention Network for Scene Segmentation , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[44]  Loïc Le Folgoc,et al.  Attention U-Net: Learning Where to Look for the Pancreas , 2018, ArXiv.

[45]  J. Herman Kan,et al.  Multimodality imaging of developmental dysplasia of the hip , 2013, Pediatric Radiology.

[46]  D. Tönnis,et al.  [Indications and time planning for operative interventions in hip dysplasia in child and adulthood]. , 1985, Zeitschrift fur Orthopadie und ihre Grenzgebiete.

[47]  Wen-Huang Cheng,et al.  Computer-aided classification of lung nodules on computed tomography images via deep learning technique , 2015, OncoTargets and therapy.

[48]  Wen-Huang Cheng,et al.  A comparative study of data fusion for RGB-D based visual recognition , 2016, Pattern Recognit. Lett..

[49]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[50]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[51]  Zheng-Jun Zha,et al.  Bidirectional Attention-Recognition Model for Fine-Grained Object Classification , 2020, IEEE Transactions on Multimedia.

[52]  H. Griffiths,et al.  Congenital dislocation of the hip: early and late diagnosis and management compared. , 1985, Archives of disease in childhood.