Post-processing multiple-frame super-resolution in ultrasound imaging

High resolution medical ultrasound imaging is an ongoing challenge in many diagnosis applications and can be achieved by instrumentation. Very few works have investigated ultrasound image resolution enhancement whereas many works regarded general purpose optical image or video fields. Many algorithms were proposed within these fields to achieve the "super-resolution" (SR), which consists in merging several low resolution images to create a higher resolution image. However, the straightforward implementation of such techniques for ultrasound imaging is unsuccessful, due to the intrinsic nature of ultrasound motions and speckle. We show how to overcome the intrinsic limit of super-resolution in this framework by refining the registration part of common multi-frame techniques. Classic super-resolution algorithms were implemented and evaluated using sequences of ultrasound images. Such methods not only fail to estimate the true elastic motion but also break the speckle characteristics, resulting in a degradation of the original image. Knowing that a registration error of only 1 pixel leads to a high-resolution image worse than an interpolation, the registration must be adapted to the framework of ultrasound imaging. For this purpose, we investigate different motion estimations. The process described above was evaluated on ultrasound sequences containing up to 15 phantom images with an inclusion scanned with a 7.5 MHz linear probe. Qualitative improvements were observable as soon as at least 5 low-resolution images were used. Ultrasound B-mode profiles of radio-frequency lines were studied and the inclusion was more accurately identified. The Contrast-to-Noise Ratio was increased by approximately 13%.

[1]  Gregory S Mayer,et al.  Measuring information gain for frequency-encoded super-resolution MRI. , 2007, Magnetic resonance imaging.

[2]  Fabrice Morestin,et al.  A method for vector displacement estimation with ultrasound imaging and its application for thyroid nodular disease , 2008, Medical Image Anal..

[3]  Hayit Greenspan,et al.  Regularized super-resolution of brain MRI , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[4]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[5]  Liangpei Zhang,et al.  Adaptive Multiple-Frame Image Super-Resolution Based on U-Curve , 2010, IEEE Transactions on Image Processing.

[6]  Joos Vandewalle,et al.  Super-Resolution From Unregistered and Totally Aliased Signals Using Subspace Methods , 2007, IEEE Transactions on Signal Processing.

[7]  William F. Walker,et al.  Super-resolution image reconstruction using diffuse source models. , 2010, Ultrasound in medicine & biology.

[8]  Thomas L. Szabo,et al.  Diagnostic Ultrasound Imaging: Inside Out , 2004 .

[9]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[10]  Michal Irani,et al.  Improving resolution by image registration , 1991, CVGIP Graph. Model. Image Process..

[11]  Jerry L Prince,et al.  Medical Imaging Signals and Systems , 2005 .

[12]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[13]  H Stark,et al.  High-resolution image recovery from image-plane arrays, using convex projections. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[14]  Adrian Basarab,et al.  Ultrasound Image Sequence Registration and its Application for Thyroid Nodular Disease , 2009, J. Signal Process. Syst..

[15]  Simon K. Warfield,et al.  Robust Super-Resolution Volume Reconstruction From Slice Acquisitions: Application to Fetal Brain MRI , 2010, IEEE Transactions on Medical Imaging.

[16]  Ramiro Jordan,et al.  Superresolution Parallel MRI , 2007, 2007 IEEE International Conference on Image Processing.

[17]  Gregory T. Clement,et al.  Superresolution ultrasound imaging using back-projected reconstruction. , 2005, The Journal of the Acoustical Society of America.

[18]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[19]  Russell C. Hardie,et al.  Joint MAP registration and high-resolution image estimation using a sequence of undersampled images , 1997, IEEE Trans. Image Process..

[20]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[21]  MingXi Wan,et al.  Super-Resolution Reconstruction of Deformable Tissue from Temporal Sequence of Ultrasound Images , 2010, 2010 International Conference on Artificial Intelligence and Computational Intelligence.

[22]  P. Anandan,et al.  Hierarchical Model-Based Motion Estimation , 1992, ECCV.