Hand Pose Estimation for Pediatric Bone Age Assessment

We present a new experimental framework for the task of Bone Age Assessment (BAA) based on a local analysis of anatomical Regions Of Interest (ROIs) of hand radiographs. For this purpose, we introduce the Radiological Hand Pose Estimation (RHPE) Dataset, composed of 6,288 hand radiographs from a population that is different from the currently available BAA datasets. We provide Bone Age groundtruths annotated by two expert radiologists as well as bounding boxes and keypoints denoting anatomical ROIs annotated by multiple trained subjects. In addition to RHPE, we provide bounding boxes and ROIs annotations for the publicly available BAA dataset by the Radiological Society of North America (RSNA) [9]. We propose a new experimental framework with hand detection and hand pose estimation as new tasks to extract local information for BAA methods. Thanks to its fine-grained and precisely localized annotations, our dataset will allow to exploit local information to push forward automated BAA algorithms. Additionally, we conduct experiments with state-of-the-art methods in each of the new tasks. Our proposed model, named BoNet, leverages local information and significantly outperforms state-of-the-art methods in BAA. We provide the RHPE dataset with the corresponding annotations, as well as the trained models, the source code for BoNet and the additional annotations created for the RSNA dataset.

[1]  H. H. Thodberg,et al.  The RSNA Pediatric Bone Age Machine Learning Challenge. , 2019, Radiology.

[2]  Yichen Wei,et al.  Simple Baselines for Human Pose Estimation and Tracking , 2018, ECCV.

[3]  Wilton Marion Krogman,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1951 .

[4]  Alexander Rakhlin,et al.  Pediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, bioRxiv.

[5]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  M. Maresh,et al.  Radiographic Atlas of Skeletal Development of the Hand and Wrist , 1950 .

[7]  Cree M. Gaskin,et al.  Skeletal Development of the Hand and Wrist: A Radiographic Atlas and Digital Bone Age Companion , 2011 .

[8]  Junsong Yuan,et al.  Hand PointNet: 3D Hand Pose Estimation Using Point Sets , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[9]  Cree M. Gaskin,et al.  Comprar Skeletal Development of the Hand and Wrist A Radiographic Atlas and Digital Bone Age Companion | Cree M. Gaskin MD | 9780199782055 | Oxford University Press , 2011 .

[10]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[11]  Sven Kreiborg,et al.  The BoneXpert Method for Automated Determination of Skeletal Maturity , 2009, IEEE Transactions on Medical Imaging.

[12]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[13]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Alexander Rakhlin,et al.  Paediatric Bone Age Assessment Using Deep Convolutional Neural Networks , 2017, DLMIA/ML-CDS@MICCAI.

[15]  H. K. Huang,et al.  Bone age assessment of children using a digital hand atlas , 2007, Comput. Medical Imaging Graph..

[16]  A. Oestreich Hand Bone Age: A Digital Atlas of Skeletal Maturity , 2005 .

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  W. A. Marshall,et al.  Prediction of adult height from height, bone age, and occurrence of menarche, at ages 4 to 16 with allowance for midparent height. , 1975, Archives of disease in childhood.

[19]  E. A. Enstrom Left-Handedness , 1968 .

[20]  Junsong Yuan,et al.  Point-to-Point Regression PointNet for 3D Hand Pose Estimation , 2018, ECCV.