Deep learning techniques for bone surface delineation in ultrasound

For computer-assisted interventions in orthopedic surgery, automatic bone surface delineation can be of great value. For instance, given such a method, an automatically extracted bone surface from intraoperative imaging modalities can be registered to the bone surfaces from preoperative images, allowing for enhanced visualization and/or surgical guidance. Ultrasound (US) is ideal for imaging bone surfaces intraoperatively, being real-time, non-ionizing, and cost-effective. However, due to its low signal-to-noise ratio and imaging artifacts, extracting bone surfaces automatically from such images remains challenging. In this work, we examine the suitability of deep learning for automatic bone surface extraction from US. Given 1800 manually annotated US frames, we examine the performance of two popular neural networks used for segmentation. Furthermore, we investigate the effect of different preprocessing methods used for manual annotations in training on the final segmentation quality, and demonstrate excellent qualitative and quantitative segmentation results.

[1]  Nassir Navab,et al.  Precise Ultrasound Bone Registration with Learning-Based Segmentation and Speed of Sound Calibration , 2017, MICCAI.

[2]  Niamul Quader,et al.  Confidence Weighted Local Phase Features for Robust Bone Surface Segmentation in Ultrasound , 2014, CLIP@MICCAI.

[3]  Orcun Goksel,et al.  Biomechanically Constrained Surface Registration: Application to MR-TRUS Fusion for Prostate Interventions , 2015, IEEE Transactions on Medical Imaging.

[4]  Theo van Walsum,et al.  Machine Learning Based Bone Segmentation in Ultrasound , 2016, CSI@MICCAI.

[5]  Theo van Walsum,et al.  Ultrasound Aided Vertebral Level Localization for Lumbar Surgery , 2017, IEEE Transactions on Medical Imaging.

[6]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[7]  Michael Felsberg,et al.  GET: The Connection Between Monogenic Scale-Space and Gaussian Derivatives , 2005, Scale-Space.

[8]  Russell H. Taylor,et al.  Understanding bone responses in B-mode ultrasound images and automatic bone surface extraction using a Bayesian probabilistic framework , 2004, SPIE Medical Imaging.

[9]  Purang Abolmaesumi,et al.  Local Phase Tensor Features for 3-D Ultrasound to Statistical Shape+Pose Spine Model Registration , 2014, IEEE Transactions on Medical Imaging.

[10]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[11]  Peter Kovesi,et al.  Image Features from Phase Congruency , 1995 .

[12]  Antony J Hodgson,et al.  Bone surface localization in ultrasound using image phase-based features. , 2009, Ultrasound in medicine & biology.

[13]  Nassir Navab,et al.  Ultrasound confidence maps using random walks , 2012, Medical Image Anal..

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Orcun Goksel,et al.  Registration of 3D freehand ultrasound to a bone model for orthopedic procedures of the forearm , 2018, International Journal of Computer Assisted Radiology and Surgery.

[16]  Orcun Goksel,et al.  Graphical Modeling of Ultrasound Propagation in Tissue for Automatic Bone Segmentation , 2016, MICCAI.