Regression Convolutional Neural Network for Automated Pediatric Bone Age Assessment From Hand Radiograph

Skeletal bone age assessment is a common clinical practice to investigate endocrinology, and genetic and growth disorders of children. However, clinical interpretation and bone age analyses are time-consuming, labor intensive, and often subject to inter-observer variability. This advocates the need of a fully automated method for bone age assessment. We propose a regression convolutional neural network (CNN) to automatically assess the pediatric bone age from hand radiograph. Our network is specifically trained to place more attention to those bone age related regions in the X-ray images. Specifically, we first adopt the attention module to process all images and generate the coarse/fine attention maps as inputs for the regression network. Then, the regression CNN follows the supervision of the dynamic attention loss during training; thus, it can estimate the bone age of the hard (or “outlier”) images more accurately. The experimental results show that our method achieves an average discrepancy of 5.2–5.3 months between clinical and automatic bone age evaluations on two large datasets. In conclusion, we propose a fully automated deep learning solution to process X-ray images of the hand for bone age assessment, with the accuracy comparable to human experts but with much better efficiency.

[1]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Yacov Hel-Or,et al.  Multiple histogram matching , 2013, 2013 IEEE International Conference on Image Processing.

[3]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[4]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[5]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[6]  Carlos Alberola-López,et al.  A computational TW3 classifier for skeletal maturity assessment. A Computing with Words approach , 2004, J. Biomed. Informatics.

[7]  Bayan S. Sharif,et al.  Skeletal growth estimation using radiographic image processing and analysis , 2000, IEEE Transactions on Information Technology in Biomedicine.

[8]  Alexander V. Terekhov,et al.  Gradual Tuning: a better way of Fine Tuning the parameters of a Deep Neural Network , 2017, ArXiv.

[9]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[10]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Jian Liu,et al.  Automatic bone age assessment based on intelligent algorithms and comparison with TW3 method , 2008, Comput. Medical Imaging Graph..

[13]  Sasan Mahmoodi,et al.  Automated vision system for skeletal age assessment using knowledge based techniques , 1997 .

[14]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[15]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[16]  Alexander Rakhlin,et al.  Paediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, DLMIA/ML-CDS@MICCAI.

[17]  Gábor Székely,et al.  Fully automatic and fast segmentation of the femur bone from 3D-CT images with no shape prior , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[18]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[19]  F. Maiorana,et al.  Epiphysis and Metaphysis Extraction and Classification by Adaptive Thresholding and DoG Filtering for Automated Skeletal Bone Age Analysis , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[20]  Yi Li,et al.  Deformable Convolutional Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[21]  R. Stanhope,et al.  Investigation of delayed puberty , 1995, Clinical endocrinology.

[22]  Alejandro F. Frangi,et al.  Muliscale Vessel Enhancement Filtering , 1998, MICCAI.

[23]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[24]  L. Morris Assessment of Skeletal Maturity and Prediction of Adult Height (TW3 Method) , 2003 .

[25]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[26]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  A. Christoforidis,et al.  Bone age estimation and prediction of final height in patients with β-thalassaemia major: a comparison between the two most common methods , 2007, Pediatric Radiology.

[28]  S. Garn,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist. , 1959 .

[29]  V. De Sanctis,et al.  Hand X-ray in pediatric endocrinology: Skeletal age assessment and beyond , 2014, Indian journal of endocrinology and metabolism.

[30]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[31]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[32]  E Pietka,et al.  Digital hand atlas and web-based bone age assessment: system design and implementation. , 2000, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[35]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  H. K. Huang,et al.  Computer-assisted bone age assessment: image preprocessing and epiphyseal/metaphyseal ROI extraction , 2001, IEEE Transactions on Medical Imaging.