Domain Specific Transporter Framework to Detect Fractures in Ultrasound

Ultrasound examination for detecting fractures is ideally suited for Emergency Departments (ED) as it is relatively fast, safe (from ionizing radiation), has dynamic imaging capability and is easily portable. High interobserver variability in manual assessment of ultrasound scans has piqued research interest in automatic assessment techniques using Deep Learning (DL). Most DL techniques are supervised and are trained on large numbers of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, domain specific transporter framework to identify relevant keypoints from wrist ultrasound scans. Our framework provides a concise geometric representation highlighting regions with high structural variation in a 3D ultrasound (3DUS) sequence. We also incorporate domain specific information represented by instantaneous local phase (LP) which detects bone features from 3DUS. We validate the technique on 3DUS videos obtained from 30 subjects. Each ultrasound scan was independently assessed by three readers to identify fractures along with the corresponding x-ray. Saliency of keypoints detected in the image are compared against manual assessment based on distance from relevant features.The transporter neural network was able to accurately detect 180 out of 250 bone regions sampled from wrist ultrasound videos. We expect this technique to increase the applicability of ultrasound in fracture detection.

[1]  Ankush Gupta,et al.  Unsupervised Learning of Object Keypoints for Perception and Control , 2019, NeurIPS.

[2]  Vishal M. Patel,et al.  Automatic segmentation of bone surfaces from ultrasound using a filter-layer-guided CNN , 2019, International Journal of Computer Assisted Radiology and Surgery.

[3]  Rachel Rowlands,et al.  Bedside Ultrasound vs X-Ray for the Diagnosis of Forearm Fractures in Children. , 2017, The Journal of emergency medicine.

[4]  J. Karlsson,et al.  Minimal training sufficient to diagnose pediatric wrist fractures with ultrasound , 2017, Critical Ultrasound Journal.

[5]  J. Kelder,et al.  Point-of-care ultrasound compared with conventional radiographic evaluation in children with suspected distal forearm fractures in the Netherlands: a diagnostic accuracy study , 2019, Emergency Medicine Journal.

[6]  Purang Abolmaesumi,et al.  Local Phase Tensor Features for 3-D Ultrasound to Statistical Shape+Pose Spine Model Registration , 2014, IEEE Transactions on Medical Imaging.

[7]  I. Hacihaliloglu Ultrasound imaging and segmentation of bone surfaces: A review. , 2017, Technology.

[8]  C. González,et al.  The utility of clinical ultrasonography in identifying distal forearm fractures in the pediatric emergency department , 2017, European journal of emergency medicine : official journal of the European Society for Emergency Medicine.

[9]  J. Goslings,et al.  The role of plain radiography in paediatric wrist trauma , 2012, Insights into Imaging.

[10]  J. Jaremko,et al.  Reliability of 2D and 3D ultrasound for infant hip dysplasia in the hands of novice users , 2018, European Radiology.

[11]  Ilker Hacihaliloglu Enhancement of bone shadow region using local phase-based ultrasound transmission maps , 2017, International Journal of Computer Assisted Radiology and Surgery.

[12]  Miss A.O. Penney (b) , 1974, The New Yale Book of Quotations.

[13]  S. Lee,et al.  Diagnostic Performance of Ultrasonography for Detection of Pediatric Elbow Fracture: A Meta-analysis. , 2019, Annals of emergency medicine.

[14]  Ankush Gupta,et al.  Self-Supervised Learning of Interpretable Keypoints From Unlabelled Videos , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  M. Boomsma,et al.  Ultrasound for Distal Forearm Fracture: A Systematic Review and Diagnostic Meta-Analysis , 2016, PloS one.

[16]  Alexei A. Efros,et al.  Unsupervised Visual Representation Learning by Context Prediction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[17]  S Solgaard,et al.  Epidemiology of distal radius fractures. , 1985, Acta orthopaedica Scandinavica.