Local up-sampling and morphological analysis of low-resolution magnetic resonance images

Abstract Limitations in the resolution of acquired images, which are due to sensor manufacturing and acquisition conditions, are reduced with the help of algorithms that enhance the spatial resolution by assigning pixel values that are interpolated or approximated from known pixels. We propose a variant of the moving least-squares approximation for image up-sampling, with a specific focus on biomedical MR images. For each evaluation point, we locally compute the best approximation by minimizing a weighted least-squares error between the input data and their approximation with an implicit function. The proposed approach provides a continuous approximation, an accuracy and extrapolation capabilities higher than previous work, and a lower computational cost. As main application, we consider the up-sampling of low field MR images, where the volumetric and meshless properties of the approximation allow us to easily process images with anisotropic voxel size by rescaling the image and inter-slices resolution. Finally, we include the resolution rescaling into a pipeline that performs a morphological characterization of 3D anatomical districts, which has been developed with a focus on rheumatoid arthritis evolution and provides a more accurate segmentation as an input to quantitative analysis.

[1]  Marios Pitikakis,et al.  A Database of Segmented MRI Images of the Wrist and the Hand in Patients with Rheumatic Diseases , 2015, ICIAP Workshops.

[2]  Paolo Cignoni,et al.  Metro: Measuring Error on Simplified Surfaces , 1998, Comput. Graph. Forum.

[3]  Jayaram K. Udupa,et al.  User-Steered Image Segmentation Paradigms: Live Wire and Live Lane , 1998, Graph. Model. Image Process..

[4]  Giuseppe Patanè,et al.  Semantics-driven annotation of patient-specific 3D data: a step to assist diagnosis and treatment of rheumatoid arthritis , 2016, The Visual Computer.

[5]  Xiaoqiang Lu,et al.  MR image super-resolution via manifold regularized sparse learning , 2015, Neurocomputing.

[6]  Kourosh Jafari-Khouzani,et al.  MRI Upsampling Using Feature-Based Nonlocal Means Approach , 2014, IEEE Transactions on Medical Imaging.

[7]  Yeon Ju Lee,et al.  Nonlinear Image Upsampling Method Based on Radial Basis Function Interpolation , 2010, IEEE Transactions on Image Processing.

[8]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  R. Castillo,et al.  A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets , 2009, Physics in medicine and biology.

[10]  Paul Bird,et al.  Computerized measurement of magnetic resonance imaging erosion volumes in patients with rheumatoid arthritis: a comparison with existing magnetic resonance imaging scoring systems and standard clinical outcome measures. , 2003, Arthritis and rheumatism.

[11]  Di Zhang,et al.  MR image super-resolution reconstruction using sparse representation, nonlocal similarity and sparse derivative prior , 2015, Comput. Biol. Medicine.

[12]  Per-Erik Danielsson,et al.  High-accuracy rotation of images , 1992, CVGIP Graph. Model. Image Process..

[13]  Mark J. T. Smith,et al.  A New Method for Registration-Based Medical Image Interpolation , 2008, IEEE Transactions on Medical Imaging.

[14]  C Peterfy,et al.  The EULAR–OMERACT rheumatoid arthritis MRI reference image atlas: the wrist joint , 2005, Annals of the rheumatic diseases.

[15]  H. Seidel,et al.  Multi-level partition of unity implicits , 2003 .

[16]  A. Ardeshir Goshtasby,et al.  Matching of tomographic slices for interpolation , 1992, IEEE Trans. Medical Imaging.

[17]  Jan Sijbers,et al.  Robust edge-directed interpolation of magnetic resonance images , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[18]  J.A. De Guise,et al.  Surface reconstruction from planar x-ray images using moving least squares , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[19]  Dinggang Shen,et al.  Neonatal atlas construction using sparse representation , 2014, Human brain mapping.

[20]  Truong Q. Nguyen,et al.  Markov Random Field Model-Based Edge-Directed Image Interpolation , 2007, IEEE Transactions on Image Processing.

[21]  P. Lipsky,et al.  The evaluation of bone damage in rheumatoid arthritis with magnetic resonance imaging. , 2003, Clinical and experimental rheumatology.

[22]  James F. O'Brien,et al.  Interpolating and approximating implicit surfaces from polygon soup , 2005, SIGGRAPH Courses.

[23]  Michael Unser,et al.  Enlargement or reduction of digital images with minimum loss of information , 1995, IEEE Trans. Image Process..

[24]  Nirmal K. Bose,et al.  Superresolution and noise filtering using moving least squares , 2006, IEEE Transactions on Image Processing.

[25]  Kun Zhou,et al.  Locality Sensitive Discriminant Analysis , 2007, IJCAI.

[26]  J. Edmonds,et al.  OMERACT Rheumatoid Arthritis Magnetic Resonance Imaging Studies. Exercise 5: an international multicenter reliability study using computerized MRI erosion volume measurements. , 2003, The Journal of rheumatology.

[27]  Baining Guo,et al.  3D image interpolation based on directional coherence , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[28]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[29]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[30]  M. Goesele,et al.  Floating scale surface reconstruction , 2014, ACM Trans. Graph..

[31]  C. Spritzer,et al.  Early detection of carpal erosions in patients with rheumatoid arthritis: a pilot study of magnetic resonance imaging. , 1988, The Journal of rheumatology.

[32]  Daniel Rueckert,et al.  Automatic Quantification of Changes in Bone in Serial MR Images of Joints , 2006, IEEE Transactions on Medical Imaging.

[33]  J. Udupa,et al.  An objective comparison of 3-D image interpolation methods , 1998, IEEE Transactions on Medical Imaging.

[34]  M. Porat,et al.  On the Role of Exponential Splines in Image Interpolation , 2009, IEEE Transactions on Image Processing.

[35]  Richard K. Beatson,et al.  Reconstruction and representation of 3D objects with radial basis functions , 2001, SIGGRAPH.

[36]  I. J. Schoenberg,et al.  Cardinal interpolation and spline functions: II interpolation of data of power growth , 1972 .

[37]  Dacheng Tao,et al.  Large-Margin Multi-ViewInformation Bottleneck , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Osman Ratib,et al.  OsiriX: An Open-Source Software for Navigating in Multidimensional DICOM Images , 2004, Journal of Digital Imaging.

[39]  Brian Wyvill,et al.  Introduction to Implicit Surfaces , 1997 .

[40]  François Rousseau,et al.  A non-local approach for image super-resolution using intermodality priors , 2010, Medical Image Anal..

[41]  Chandrajit L. Bajaj,et al.  Quality meshing of implicit solvation models of biomolecular structures , 2006, Comput. Aided Geom. Des..

[42]  Holger Wendland,et al.  Piecewise polynomial, positive definite and compactly supported radial functions of minimal degree , 1995, Adv. Comput. Math..

[43]  Mathieu Desbrun,et al.  A constructive theory of sampling for image synthesis using reproducing Kernel bases , 2014, ACM Trans. Graph..

[44]  David Levin,et al.  The approximation power of moving least-squares , 1998, Math. Comput..

[45]  Michael Elad,et al.  Example-Based Regularization Deployed to Super-Resolution Reconstruction of a Single Image , 2009, Comput. J..

[46]  Martin Vetterli,et al.  Resolution enhancement of images using wavelet transform extrema extrapolation , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[47]  Max A. Viergever,et al.  Registration-based interpolation , 2004, IEEE Transactions on Medical Imaging.

[48]  Thomas S. Huang,et al.  Image super-resolution as sparse representation of raw image patches , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  C. Micchelli Interpolation of scattered data: Distance matrices and conditionally positive definite functions , 1986 .

[50]  Gérard G. Medioni,et al.  Object modelling by registration of multiple range images , 1992, Image Vis. Comput..

[51]  Guido Gerig,et al.  User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability , 2006, NeuroImage.

[52]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[53]  Franz Kainberger,et al.  Automatic Quantification of Joint Space Narrowing and Erosions in Rheumatoid Arthritis , 2009, IEEE Transactions on Medical Imaging.

[54]  Wen Gao,et al.  Image interpolation via regularized local linear regression , 2011, 28th Picture Coding Symposium.

[55]  Tommy Elfving,et al.  Interpolation and approximation by monotone cubic splines , 1991 .

[56]  Giuseppe Patanè,et al.  Topology- and error-driven extension of scalar functions from surfaces to volumes , 2009, TOGS.

[57]  Payel Ghosh,et al.  Incorporating priors for medical image segmentation using a genetic algorithm , 2016, Neurocomputing.

[58]  C. Krishna Mohan,et al.  Content based medical image retrieval using dictionary learning , 2015, Neurocomputing.

[59]  Gene H. Golub,et al.  Matrix computations , 1983 .

[60]  R. Farwig,et al.  Multivariate interpolation of arbitrarily spaced data by moving least squares methods , 1986 .

[61]  B. Gunturk,et al.  Multiframe resolution-enhancement methods for compressed video , 2002, IEEE Signal Processing Letters.

[62]  Hans-Peter Seidel,et al.  MovieReshape: tracking and reshaping of humans in videos , 2010, SIGGRAPH 2010.

[63]  Jayaram K. Udupa,et al.  Shape-based interpolation of multidimensional grey-level images , 1994, Medical Imaging.

[64]  D. Louis Collins,et al.  MRI Superresolution Using Self-Similarity and Image Priors , 2010, Int. J. Biomed. Imaging.

[65]  Jayaram K. Udupa,et al.  A task-specific evaluation of three-dimensional image interpolation techniques , 1999, IEEE Transactions on Medical Imaging.

[66]  Lei Zhang,et al.  Image Deblurring and Super-Resolution by Adaptive Sparse Domain Selection and Adaptive Regularization , 2010, IEEE Transactions on Image Processing.

[67]  R. Moots,et al.  MRI of rheumatoid arthritis image quantitation for the assessment of disease activity, progression and response to therapy. , 2008, Rheumatology.

[68]  Giuseppe Patanè,et al.  Semantic annotation of 3D anatomical models to support diagnosis and follow-up analysis of musculoskeletal pathologies , 2016, International Journal of Computer Assisted Radiology and Surgery.

[69]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[70]  Giuseppe Patanè,et al.  Multi-resolutive sparse approximations of d-dimensional data , 2013, Comput. Vis. Image Underst..

[71]  Ping Wah Wong,et al.  Edge-directed interpolation , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[72]  James F. O'Brien,et al.  Modelling with implicit surfaces that interpolate , 2005, SIGGRAPH Courses.

[73]  Hans-Peter Seidel,et al.  Animating deformable objects using sparse spacetime constraints , 2014, ACM Trans. Graph..

[74]  Neal Stewart,et al.  OMERACT Rheumatoid Arthritis Magnetic Resonance Imaging Studies. Summary of OMERACT 6 MR Imaging Module. , 2003, The Journal of rheumatology.

[75]  J M Bland,et al.  Statistical methods for assessing agreement between two methods of clinical measurement , 1986 .

[76]  S. Rifman Digital rectification of ERTS multispectral imagery , 1973 .

[77]  Dimitris Anastassiou,et al.  Subpixel edge localization and the interpolation of still images , 1995, IEEE Trans. Image Process..

[78]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[79]  J. Udupa,et al.  Shape-based interpolation of multidimensional objects. , 1990, IEEE transactions on medical imaging.

[80]  Sheila S. Hemami,et al.  Regularity-preserving image interpolation , 1999, IEEE Trans. Image Process..

[81]  S. Rippa,et al.  Numerical Procedures for Surface Fitting of Scattered Data by Radial Functions , 1986 .

[82]  Michael Elad,et al.  Generalizing the Nonlocal-Means to Super-Resolution Reconstruction , 2009, IEEE Transactions on Image Processing.

[83]  J Duryea,et al.  Semiautomated three-dimensional segmentation software to quantify carpal bone volume changes on wrist CT scans for arthritis assessment. , 2008, Medical physics.

[84]  Ole Fogh Olsen,et al.  Automatic Segmentation of the Articular Cartilage in Knee MRI Using a Hierarchical Multi-class Classification Scheme , 2005, MICCAI.

[85]  H. Thomsen,et al.  Detection of bone erosions in rheumatoid arthritis wrist joints with magnetic resonance imaging, computed tomography and radiography , 2008, Arthritis research & therapy.

[86]  Mei-Juan Chen,et al.  A fast edge-oriented algorithm for image interpolation , 2005, Image Vis. Comput..

[87]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.