Volumetric Ultrasound Panorama Based on 3D SIFT

The reconstruction of three-dimensional (3D) ultrasound panorama from multiple ultrasound volumes can provide a wide field of view for better clinical diagnosis. Registration of ultrasound volumes has been a key issue for the success of this panoramic process. In this paper, we propose a method to register and stitch ultrasound volumes, which are scanned by dedicated ultrasound probe, based on an improved 3D Scale Invariant Feature Transform (SIFT) algorithm. We propose methods to exclude artifacts from ultrasound images in order to improve the overall performance in 3D feature point extraction and matching. Our method has been validated on both phantom and clinical data sets of human liver. Experimental results show the effectiveness and stability of our approach, and the precision of our method is comparable to that of the position tracker based registration.

[1]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[2]  Robert N Rohling,et al.  Three-dimensional extended field-of-view ultrasound. , 2006, Ultrasound in medicine & biology.

[3]  Purang Abolmaesumi,et al.  Deformable registration using scale space keypoints , 2006, SPIE Medical Imaging.

[4]  Jie Tian,et al.  Rapid Multi-modality preRegistration based on SIFT descriptor , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[6]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[7]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[8]  Andrew H. Gee,et al.  Rapid registration for wide field of view freehand three-dimensional ultrasound , 2003, IEEE Transactions on Medical Imaging.

[9]  Nicholas Ayache,et al.  Medical Image Computing and Computer-Assisted Intervention - MICCAI 2007, 10th International Conference, Brisbane, Australia, October 29 - November 2, 2007, Proceedings, Part I , 2007, MICCAI.

[10]  Andrew Zisserman,et al.  Multiple View Geometry in Computer Vision (2nd ed) , 2003 .

[11]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[12]  Nassir Navab,et al.  Three-Dimensional Ultrasound Mosaicing , 2007, MICCAI.

[13]  David J. Hawkes,et al.  Registration of freehand 3D ultrasound and magnetic resonance liver images , 2004, Medical Image Anal..