PURE: Panoramic Ultrasound Reconstruction by Seamless Stitching of Volumes

For training sonographers in navigating, acquiring, and interpreting ultrasound images, virtual-reality based simulation offers a safe, flexible, and standardized environment. In data-based training simulations, images from a-priori acquired volumes are displayed to the trainee. To understand the relationship between organs, it is necessary to allow for free exploration of the entire anatomy, which is often not possible with the limited field-of-view (FOV) of a single ultrasound volume. Thus, large FOV ultrasound volumes are of paramount importance. Combining several volumes into one larger volume has also potential utility in many other applications, such as diagnostic and operative guidance. In this work, we propose a method for combining several ultrasound volumes with tracked positions into a single large volume by stitching them in a seamless fashion. For stitching, we determine an optimal cut interface such that each pixel value comes from a single image; preserving the inherent speckle texture and preventing any blurring and degradation from common mean/median binning approaches to combining volumes. The cut interface is found based on image content using graphical models optimized by graph-cut. We show that our method produces panoramic reconstructions with seamless transitions between individual 3D acquisitions. Regarding standard deviation in homogeneous regions we get 1–19% loss of ultrasound texture compared to small 3D volumes while mean value interpolation gives a loss of 15–68%. The histograms of our reconstruction match the original histograms of the small 3D volumes almost perfectly with a \(\chi ^2\)-distance of less than 0.01.

[1]  Vladimir Kolmogorov,et al.  An experimental comparison of min-cut/max- flow algorithms for energy minimization in vision , 2001, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jocelyne Troccaz,et al.  Ultrasound Imaging Simulation: Application to the Diagnosis of Deep Venous Thromboses of Lower Limbs , 1998, MICCAI.

[3]  Frank Lindseth,et al.  Freehand 3D ultrasound reconstruction algorithms--a review. , 2007, Ultrasound in medicine & biology.

[4]  Tien-Tsin Wong,et al.  Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT , 2009, Comput. Medical Imaging Graph..

[5]  Orcun Goksel,et al.  Compliance boundary conditions for simulating deformations in a limited target region , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[6]  Andrew H. Gee,et al.  Rapid registration for wide field of view freehand three-dimensional ultrasound , 2003, IEEE Transactions on Medical Imaging.

[7]  Orcun Goksel,et al.  Model-based compensation of tissue deformation during data acquisition for interpolative ultrasound simulation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[8]  Robert N Rohling,et al.  Three-dimensional extended field-of-view ultrasound. , 2006, Ultrasound in medicine & biology.

[9]  Orcun Goksel,et al.  B-Mode Ultrasound Image Simulation in Deformable 3-D Medium , 2009, IEEE Transactions on Medical Imaging.

[10]  Nassir Navab,et al.  Three-Dimensional Ultrasound Mosaicing , 2007, MICCAI.

[11]  Daniel Cohen-Or,et al.  Real-Time Ultrasound Imaging Simulation , 1998, Real Time Imaging.

[12]  Andras Lasso,et al.  PLUS: Open-Source Toolkit for Ultrasound-Guided Intervention Systems , 2014, IEEE Transactions on Biomedical Engineering.

[13]  Irfan A. Essa,et al.  Graphcut textures: image and video synthesis using graph cuts , 2003, ACM Trans. Graph..

[14]  H H Ehricke SONOSim3D: a multimedia system for sonography simulation and education with an extensible case database. , 1998, European journal of ultrasound : official journal of the European Federation of Societies for Ultrasound in Medicine and Biology.

[15]  Graham M. Treece,et al.  A clinical system for three-dimensional extended-field-of-view ultrasound. , 2012, The British journal of radiology.

[16]  C Sohn,et al.  Ultrasound simulators: experience with the SonoTrainer and comparative review of other training systems , 2004, Ultrasound in obstetrics & gynecology : the official journal of the International Society of Ultrasound in Obstetrics and Gynecology.