Evaluation of Skeletal Gender and Maturity for Hand Radiographs using Deep Convolutional Neural Networks

Assessment of skeletal maturity is typical strategy applied in clinical pediatrics today. The main goal of a Bone Age Assessment (BAA) is to determine endocrinology and growth disorders by comparing the bone and chronological age of the patient. Several methods are developed to determine skeletal maturity, but Greulich-Pyle and Tanner-Whitehouse represent the two most common methods that involve left hand and wrist radiographs. However, these methods are extremely time-dependent and rely on an experienced radiologist, who further evaluates bone age using hand atlas as a reference. In this paper, VGG-16 and ResNet50 are two Deep Convolutional Neural Network (DCNN) models applied with ImageNet pre-trained weights in order to estimate correct bone age and achieve high accuracy of gender prediction using public RSNA dataset that includes 12611 radiographs. The experimental results show month discrepancy of approximately eight months and 82% accuracy during the process of gender classification.

[1]  Vincent Lepetit,et al.  Automated Age Estimation from Hand MRI Volumes Using Deep Learning , 2016, MICCAI.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Carlos Alberola-López,et al.  A computational TW3 classifier for skeletal maturity assessment. A Computing with Words approach , 2004, J. Biomed. Informatics.

[4]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[5]  Vineeta Saini,et al.  An Efficient Image Sharpening Filter for Enhancing Edge Detection Techniques for 2 D , High Definition and Linearly Blurred Images , 2014 .

[6]  H. H. Thodberg,et al.  The Use of Bone Age in Clinical Practice – Part 1 , 2011, Hormone Research in Paediatrics.

[7]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  D. King,et al.  Reproducibility of bone ages when performed by radiology registrars: an audit of Tanner and Whitehouse II versus Greulich and Pyle methods. , 1994, The British journal of radiology.

[9]  Simone Palazzo,et al.  Deep learning for automated skeletal bone age assessment in X‐ray images , 2017, Medical Image Anal..

[10]  A. Christoforidis,et al.  Bone age estimation and prediction of final height in patients with β-thalassaemia major: a comparison between the two most common methods , 2007, Pediatric Radiology.

[11]  C. Langlotz,et al.  Performance of a Deep-Learning Neural Network Model in Assessing Skeletal Maturity on Pediatric Hand Radiographs. , 2017, Radiology.

[12]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[13]  Bayan S. Sharif,et al.  Skeletal growth estimation using radiographic image processing and analysis , 2000, IEEE Transactions on Information Technology in Biomedicine.

[14]  H. K. Huang,et al.  Computer-assisted bone age assessment: image preprocessing and epiphyseal/metaphyseal ROI extraction , 2001, IEEE Transactions on Medical Imaging.

[15]  Bin Liang,et al.  Using Convolutional Neural Networks and Transfer Learning for Bone Age Classification , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[16]  A. Poznanski,et al.  Assessment of Skeletal Maturity and Prediction of Adult Height (TW2 Method) , 1977 .

[17]  Nuzhat Hassan,et al.  Bone Age Assessment Methods: A Critical Review , 1969, Pakistan journal of medical sciences.

[18]  Ronald M. Summers,et al.  Improving Computer-Aided Detection Using Convolutional Neural Networks and Random View Aggregation , 2015, IEEE Transactions on Medical Imaging.

[19]  V. De Sanctis,et al.  Hand X-ray in pediatric endocrinology: Skeletal age assessment and beyond , 2014, Indian journal of endocrinology and metabolism.

[20]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[21]  Aifeng Zhang,et al.  Automatic bone age assessment for young children from newborn to 7-year-old using carpal bones , 2007, Comput. Medical Imaging Graph..

[22]  Kwang Gi Kim,et al.  Applying Deep Learning in Medical Images: The Case of Bone Age Estimation , 2018, Healthcare informatics research.

[23]  E Pietka,et al.  Digital hand atlas and web-based bone age assessment: system design and implementation. , 2000, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[24]  F. Maiorana,et al.  Epiphysis and Metaphysis Extraction and Classification by Adaptive Thresholding and DoG Filtering for Automated Skeletal Bone Age Analysis , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[25]  Dino Samartzis,et al.  Assessment of skeletal maturity in scoliosis patients to determine clinical management: a new classification scheme using distal radius and ulna radiographs. , 2014, The spine journal : official journal of the North American Spine Society.

[26]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[27]  R. Malina.  Skeletal Age and Age Verification in Youth Sport , 2011, Sports medicine.

[28]  Matthew Chen.  Automated Bone Age Classification with Deep Neural Networks , 2016 .

[29]  W. Greulich,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1999 .

[30]  James M. Tanner,et al.  Assessment of skeletal maturity and prediction of adult height : (TW2 method) , 1986 .