Reconstruction of volumetric ultrasound panorama based on improved 3D SIFT

Registration of ultrasound volumes is a key issue for the reconstruction of volumetric ultrasound panorama. In this paper, we propose an improved three-dimensional (3D) scale invariant feature transform (SIFT) algorithm to globally register ultrasound volumes acquired from dedicated ultrasound probe, where local deformations are corrected by block-based warping algorithm. Original SIFT algorithm is extended to 3D and improved by combining the SIFT detector with Rohr3D detector to extract complementary features and applying the diffusion distance algorithm for robust feature comparison. Extensive experiments have been performed on both phantom and clinical data sets to demonstrate the effectiveness and robustness of our approach.

[1]  P.L. Carson,et al.  Rapid elastic image registration for 3-D ultrasound , 2002, IEEE Transactions on Medical Imaging.

[2]  Mubarak Shah,et al.  A 3-dimensional sift descriptor and its application to action recognition , 2007, ACM Multimedia.

[3]  Qinghua Huang,et al.  A new adaptive interpolation algorithm for 3D ultrasound imaging with speckle reduction and edge preservation , 2009, Comput. Medical Imaging Graph..

[4]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[5]  C R Meyer,et al.  Semiautomatic registration of volumetric ultrasound scans. , 1999, Ultrasound in medicine & biology.

[6]  P. Peetrons.  Ultrasound of muscles , 2001, European Radiology.

[7]  Michael Ying,et al.  Comparison of extended field of view and dual image ultrasound techniques: accuracy and reliability of distance measurements in phantom study. , 2005, Ultrasound in medicine & biology.

[8]  David J. Hawkes,et al.  Registration of freehand 3D ultrasound and magnetic resonance liver images , 2004, Medical Image Anal..

[9]  Max A. Viergever,et al.  General multimodal elastic registration based on mutual information , 1998, Medical Imaging.

[10]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[11]  Haibin Ling,et al.  Diffusion Distance for Histogram Comparison , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[12]  B. Tutschek,et al.  Advantages of and applications for extended field-of-view ultrasound in obstetrics , 2003, Archives of Gynecology and Obstetrics.

[13]  Haibin Ling,et al.  An Efficient Earth Mover's Distance Algorithm for Robust Histogram Comparison , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  D. McNally,et al.  Demonstration of the appearance of the paraspinal musculoligamentous structures of the cervical spine using ultrasound , 2005, Clinical anatomy.

[15]  Purang Abolmaesumi,et al.  Deformable registration using scale space keypoints , 2006, SPIE Medical Imaging.

[16]  Jie Tian,et al.  Rapid Multi-modality preRegistration based on SIFT descriptor , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  Karl Rohr.  On 3D differential operators for detecting point landmarks , 1997, Image Vis. Comput..

[18]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[19]  Paul Suetens,et al.  Non-rigid Multimodal Image Registration Using Mutual Information , 1998, MICCAI.

[20]  Karl Rohr,et al.  Evaluation of 3D Operators for the Detection of Anatomical Point Landmarks in MR and CT Images , 2002, Comput. Vis. Image Underst..

[21]  Andrew H. Gee,et al.  Rapid registration for wide field of view freehand three-dimensional ultrasound , 2003, IEEE Transactions on Medical Imaging.

[22]  Kyoung Ho Lee,et al.  Extended field-of-view sonography: advantages in abdominal applications. , 2003, Journal of ultrasound in medicine : official journal of the American Institute of Ultrasound in Medicine.

[23]  F. Bookstein,et al.  Morphometric Tools for Landmark Data: Geometry and Biology , 1999 .

[24]  Robert N Rohling,et al.  Three-dimensional extended field-of-view ultrasound. , 2006, Ultrasound in medicine & biology.

[25]  Abdul Ghapor Hussin,et al.  Computerized Medical Imaging and Graphics. , 2011 .

[26]  Matthew A. Brown,et al.  Recognising panoramas , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[27]  Raj Shekhar,et al.  Mutual information-based registration of cardiac ultrasound volumes , 2000, Medical Imaging: Image Processing.

[28]  Nassir Navab,et al.  Three-Dimensional Ultrasound Mosaicing , 2007, MICCAI.

[29]  Cordelia Schmid,et al.  Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).