Pediatric Bone Age Assessment Using Deep Convolutional Neural Networks

Skeletal bone age assessment is a common clinical practice to diagnose endocrine and metabolic disorders in child development. In this paper, we describe a fully automated deep learning approach to the problem of bone age assessment using data from the 2017 Pediatric Bone Age Challenge organized by the Radiological Society of North America. The dataset for this competition is consisted of 12.6k radiological images. Each radiograph in this dataset is an image of a left hand labeled by the bone age and the sex of a patient. Our approach utilizes several deep neural network architectures trained end-to-end. We use images of whole hands as well as specific parts of a hand for both training and inference. This approach allows us to measure the importance of specific hand bones for the automated bone age analysis. We further evaluate performance of the method in the context of skeletal development stages. Our approach outperforms other common methods for bone age assessment.

[1]  M. Maresh,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1950 .

[2]  A. Poznanski,et al.  Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method) , 1977 .

[3]  Timothy F. Cootes,et al.  Training Models of Shape from Sets of Examples , 1992, BMVC.

[4]  A. Oestreich Hand Bone Age: A Digital Atlas of Skeletal Maturity , 2005 .

[5]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[9]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[10]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Sepp Hochreiter,et al.  Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) , 2015, ICLR.

[12]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[13]  A. Rakhlin Diabetic Retinopathy detection through integration of Deep Learning classification framework , 2017, bioRxiv.

[14]  Vladimir Iglovikov,et al.  Satellite Imagery Feature Detection using Deep Convolutional Neural Network: A Kaggle Competition , 2017, ArXiv.

[15]  Jenny Lee,et al.  Fully Automated Deep Learning System for Bone Age Assessment , 2017, Journal of Digital Imaging.

[16]  Alexander Rakhlin,et al.  Deep Convolutional Neural Networks for Breast Cancer Histology Image Analysis , 2018 .

[17]  S. Mohamad R. Soroushmehr,et al.  Deep Learning in Pharmacogenomics: From Gene Regulation to Patient Stratification , 2018, Pharmacogenomics.

[18]  Simo Saarakkala,et al.  Automatic Knee Osteoarthritis Diagnosis from Plain Radiographs: A Deep Learning-Based Approach , 2017, Scientific Reports.

[19]  C. Langlotz,et al.  Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs. , 2017, Radiology.

[20]  Anne E Carpenter,et al.  Opportunities and obstacles for deep learning in biology and medicine , 2017, bioRxiv.