Fusion of Magnetic Resonance and Ultrasound Images for Endometriosis Detection

This paper introduces a new fusion method for magnetic resonance (MR) and ultrasound (US) images, which aims at combining the advantages of each modality, i.e., good contrast and signal to noise ratio for the MR image and good spatial resolution for the US image. The proposed algorithm is on an inverse problem, performing a super-resolution of the MR image and a denoising of the US image. A polynomial function is introduced to model the relationships between the gray levels of the MR and US images. The resulting inverse problem is solved using a proximal alternating linearized minimization algorithm. The accuracy and the interest of the fusion algorithm are shown quantitatively and qualitatively via evaluations on synthetic and experimental phantom data.

[1]  S. Bendifallah,et al.  High postoperative fertility rate following surgical management of colorectal endometriosis , 2018, Human reproduction.

[2]  D. Rubens,et al.  Three-dimensional registration and fusion of ultrasound and MRI using major vessels as fiducial markers , 2001, IEEE Transactions on Medical Imaging.

[3]  Cindy Farquhar,et al.  Imaging modalities for the non-invasive diagnosis of endometriosis. , 2016, The Cochrane database of systematic reviews.

[4]  Adrien Bartoli,et al.  Mapping and characterizing endometrial implants by registering 2D transvaginal ultrasound to 3D pelvic magnetic resonance images , 2015, Comput. Medical Imaging Graph..

[5]  Ali Mohammad-Djafari,et al.  Data Fusion in the Field of Non Destructive Testing , 1996 .

[6]  A. Basarab,et al.  Fast Single Image Super-resolution using a New Analytical Solution for l2-l2 Problems. , 2016, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[7]  George K. Matsopoulos,et al.  Fusion of MR and CT Images of the Human Brain Using Multiresolution Morphology , 1994, ISMM.

[8]  Mostafa Amin-Naji,et al.  Multi-Focus Image Fusion in DCT Domain using Variance and Energy of Laplacian and Correlation Coefficient for Visual Sensor Networks , 2018 .

[9]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[10]  K. Parker,et al.  Deviations from Rayleigh Statistics in Ultrasonic Speckle , 1988, Ultrasonic imaging.

[11]  Djemel Ziou,et al.  Image Quality Metrics: PSNR vs. SSIM , 2010, 2010 20th International Conference on Pattern Recognition.

[12]  L.L. Lai,et al.  Medical diagnostic image data fusion based on wavelet transformation and self-organising features mapping neural networks , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[13]  Its'hak Dinstein,et al.  New maximum likelihood motion estimation schemes for noisy ultrasound images , 2002, Pattern Recognit..

[14]  H. Roman,et al.  Choosing the right surgical technique for deep endometriosis: shaving, disc excision, or bowel resection? , 2017, Fertility and sterility.

[15]  Belur V. Dasarathy,et al.  Medical Image Fusion: A survey of the state of the art , 2013, Inf. Fusion.

[16]  Kenneth E. Barner,et al.  Rayleigh-Maximum-Likelihood Filtering for Speckle Reduction of Ultrasound Images , 2007, IEEE Transactions on Medical Imaging.

[17]  J. Rolet,et al.  Extraction of spectral information from Landsat TM data and merger with SPOT panchromatic imagery: a contribution to the study of geological structures , 1993 .

[18]  Cedric Nishan Canagarajah,et al.  Non-Gaussian model-based fusion of noisy images in the wavelet domain , 2010, Comput. Vis. Image Underst..

[19]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[20]  Stéphanie Bidon,et al.  Motion estimation-based image enhancement in ultrasound imaging. , 2015, Ultrasonics.

[21]  Nicholas Ayache,et al.  Rigid registration of 3-D ultrasound with MR images: a new approach combining intensity and gradient information , 2001, IEEE Transactions on Medical Imaging.

[22]  S. Gupta,et al.  Locally adaptive wavelet domain Bayesian processor for denoising medical ultrasound images using Speckle modelling based on Rayleigh distribution , 2005 .

[23]  Jasjit S. Suri,et al.  MRI-ultrasound registration for targeted prostate biopsy , 2009, 2009 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[24]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[25]  Q Guihong,et al.  Medical image fusion by wavelet transform modulus maxima. , 2001, Optics express.

[26]  Jean-Yves Tourneret,et al.  Fast Single Image Super-Resolution Using a New Analytical Solution for $\ell _{2}$ – $\ell _{2}$ Problems , 2016, IEEE Transactions on Image Processing.

[27]  James D Christensen,et al.  Normalization of brain magnetic resonance images using histogram even-order derivative analysis. , 2003, Magnetic resonance imaging.

[28]  P. Choyke,et al.  Real-time MRI-TRUS fusion for guidance of targeted prostate biopsies , 2008, Computer aided surgery : official journal of the International Society for Computer Aided Surgery.

[29]  Yves Rosseel,et al.  On the Definition of Signal-To-Noise Ratio and Contrast-To-Noise Ratio for fMRI Data , 2013, PloS one.

[30]  M. N. Shanmukha Swamy,et al.  Despeckling of medical ultrasound images using data and rate adaptive lossy compression , 2005, IEEE Transactions on Medical Imaging.

[31]  Marc Teboulle,et al.  Proximal alternating linearized minimization for nonconvex and nonsmooth problems , 2013, Mathematical Programming.

[32]  Michael Brady,et al.  Velocity Estimation in Ultrasound Images: A Block Matching Approach , 2003, IPMI.

[33]  H. Gudbjartsson,et al.  The rician distribution of noisy mri data , 1995, Magnetic resonance in medicine.

[34]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[35]  Debasis Kundu,et al.  Generalized Rayleigh distribution: different methods of estimations , 2005, Comput. Stat. Data Anal..

[36]  Christophe De Vleeschouwer,et al.  Single-Scale Fusion: An Effective Approach to Merging Images , 2017, IEEE Trans. Image Process..