Complete Fetal Head Compounding from Multi-view 3D Ultrasound

Ultrasound (US) images suffer from artefacts which limit its diagnostic value, notably acoustic shadow. Shadows are dependent on probe orientation, with each view giving a distinct, partial view of the anatomy. In this work, we fuse the partially imaged fetal head anatomy, acquired from numerous views, into a single coherent compounding of the full anatomy. Firstly, a stream of freehand 3D US images is acquired, capturing as many different views as possible. The imaged anatomy at each time-point is then independently aligned to a canonical pose using an iterative spatial transformer network (iSTN), making our approach robust to fast fetal and probe motion. Secondly, images are fused by averaging only the best (most salient) features from all images, producing a more detailed compounding. Finally, the compounding is iteratively refined using a groupwise registration approach. We evaluate our compounding approach quantitatively and qualitatively, comparing it with average compounding and individual US frames. We also evaluate our alignment accuracy using two physically attached probes, that capture separate views simultaneously, providing ground-truth. Lastly, we demonstrate the potential clinical impact of our method for assessing cranial, facial and external ear abnormalities, with automated atlas-based masking and 3D volume rendering.

[1]  Sébastien Ourselin,et al.  Global image registration using a symmetric block-matching approach , 2014, Journal of medical imaging.

[2]  Bishesh Khanal,et al.  EchoFusion: Tracking and Reconstruction of Objects in 4D Freehand Ultrasound Imaging without External Trackers , 2018, DATRA/PIPPI@MICCAI.

[3]  T. MacGillivray,et al.  Temporal compounding: a novel implementation and its impact on quality and diagnostic value in echocardiography. , 2015, Ultrasound in medicine & biology.

[4]  Bishesh Khanal,et al.  Multi-view Image Reconstruction: Application to Fetal Ultrasound Compounding , 2018, DATRA/PIPPI@MICCAI.

[5]  Cheng Yao 3D echocardiography image compounding , 2012 .

[6]  J. Alison Noble,et al.  Adaptive Multiscale Ultrasound Compounding Using Phase Information , 2005, MICCAI.

[7]  Nassir Navab,et al.  Spatial Compounding of 3-D Fetal Brain Ultrasound Using Probabilistic Maps. , 2018, Ultrasound in medicine & biology.

[8]  Shutao Li,et al.  Image Fusion With Guided Filtering , 2013, IEEE Transactions on Image Processing.

[9]  Nicholas Ayache,et al.  Mosaicing of Confocal Microscopic In Vivo Soft Tissue Video Sequences , 2005, MICCAI.

[10]  Kanwal K. Bhatia,et al.  Fast Registration of 3D Fetal Ultrasound Images Using Learned Corresponding Salient Points , 2017, FIFI/OMIA@MICCAI.

[11]  Bishesh Khanal,et al.  LSTM Spatial Co-transformer Networks for Registration of 3D Fetal US and MR Brain Images , 2018, DATRA/PIPPI@MICCAI.

[12]  Edward H. Adelson,et al.  The Laplacian Pyramid as a Compact Image Code , 1983, IEEE Trans. Commun..