Bone Age Assessment Based on Two-Stage Deep Neural Networks

Skeletal bone age assessment is a clinical practice to diagnose the maturity of children. To accurately assess the bone age, we proposed an automatic bone age assessment method in this paper based on deep convolution network. This method includes two stages: mask generation network and age assessment network. A U-Net convolution network with pretrained VGG16 as the encoder is used to extract the mask of bones. For the assessment module, the original images are fused together with the generated mask image to obtain segmented normalized hand bone images. We then built a multiple output convolution network for accurate age assessment. Finally, the bone age regression problem is transformed into the K-1 binary classification sub-problems. Our model was tested on RSNA2017 Pediatric Bone Age dataset. We were able to achieve the mean absolute error (MAE) of 5.98 months, which outperforms other common methods for bone age assessment. The proposed method could be used for developing fully automatic bone age assessment with better accuracy.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Ming Dong,et al.  Using Ranking-CNN for Age Estimation , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[4]  H. K. Huang,et al.  Bone age assessment of children using a digital hand atlas , 2007, Comput. Medical Imaging Graph..

[5]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.

[6]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[7]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[8]  A. Oestreich Hand Bone Age: A Digital Atlas of Skeletal Maturity , 2005 .

[9]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  W. Greulich,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1999 .

[13]  Jenny Lee,et al.  Fully Automated Deep Learning System for Bone Age Assessment , 2017, Journal of Digital Imaging.

[14]  Alexander Rakhlin,et al.  Pediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, bioRxiv.

[15]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Alexander Rakhlin,et al.  Paediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, DLMIA/ML-CDS@MICCAI.

[17]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Vladimir Iglovikov,et al.  Satellite Imagery Feature Detection using Deep Convolutional Neural Network: A Kaggle Competition , 2017, ArXiv.

[19]  H. H. Thodberg,et al.  The Use of Bone Age in Clinical Practice – Part 1 , 2011, Hormone Research in Paediatrics.

[20]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[21]  Soo Young Kim,et al.  Comparison of the Greulich-Pyle and Tanner Whitehouse (TW3) Methods in Bone age Assessment , 2008 .

[22]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.