Medical image resolution enhancement for healthcare using nonlocal self-similarity and low-rank prior

Medical images have high information redundancy, which can be used to improve image analysis and visualization for purpose of healthcare. In order to recover a high-resolution (HR) image from its low-resolution (LR) counterpart, this paper proposes a resolution enhancement method by using the nonlocal self-similar redundancy and the low-rank prior. The proposed method consists of three main steps. First, an initial HR image is generated by nonlocal interpolation, which is based on the self-similarity of medical images. Next, the low-rank minimum variance estimator is exploited to reconstruct the HR image. At last, we iteratively apply the subsampling consistency constraint and perform the low-rank reconstruction to refine the reconstructed HR result. Experimental results conducted on MR and CT images demonstrate that the proposed method outperforms conventional interpolation methods and is competitive with the current stat-of-the-art methods in terms of both quantitative metrics and visual quality.

[1]  Caiming Zhang,et al.  A fast weak-supervised pulmonary nodule segmentation method based on modified self-adaptive FCM algorithm , 2017, Soft Computing.

[2]  Karl Ricanek,et al.  The Future of Smart Health , 2016, Computer.

[3]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[4]  D. Louis Collins,et al.  MRI Superresolution Using Self-Similarity and Image Priors , 2010, Int. J. Biomed. Imaging.

[5]  A. Evans,et al.  MRI simulation-based evaluation of image-processing and classification methods , 1999, IEEE Transactions on Medical Imaging.

[6]  D. Louis Collins,et al.  Design and construction of a realistic digital brain phantom , 1998, IEEE Transactions on Medical Imaging.

[7]  Yilong Yin,et al.  Patch-Based Image Inpainting via Two-Stage Low Rank Approximation , 2018, IEEE Transactions on Visualization and Computer Graphics.

[8]  D. Shen,et al.  LRTV: MR Image Super-Resolution With Low-Rank and Total Variation Regularizations , 2015, IEEE Transactions on Medical Imaging.

[9]  Jin Li,et al.  Securely Outsourcing Attribute-Based Encryption with Checkability , 2014, IEEE Transactions on Parallel and Distributed Systems.

[10]  D. Shen,et al.  Resolution enhancement of lung 4D-CT data using multiscale interphase iterative nonlocal means. , 2013, Medical physics.

[11]  S. Osher,et al.  Fast Singular Value Thresholding without Singular Value Decomposition , 2013 .

[12]  Eli Shechtman,et al.  PatchMatch: a randomized correspondence algorithm for structural image editing , 2009, ACM Trans. Graph..

[13]  Xiaohong Shen,et al.  Image interpolation based on nonlocal self-similarity , 2014 .

[14]  Kourosh Jafari-Khouzani,et al.  MRI Upsampling Using Feature-Based Nonlocal Means Approach , 2014, IEEE Transactions on Medical Imaging.

[15]  Jin Li,et al.  Privacy-preserving outsourced classification in cloud computing , 2017, Cluster Computing.

[16]  Russell C. Hardie,et al.  A Fast Image Super-Resolution Algorithm Using an Adaptive Wiener Filter , 2007, IEEE Transactions on Image Processing.

[17]  E. Candès,et al.  Exact low-rank matrix completion via convex optimization , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[18]  Thomas Martin Deserno,et al.  Survey: interpolation methods in medical image processing , 1999, IEEE Transactions on Medical Imaging.

[19]  Shai Avidan,et al.  Coherency Sensitive Hashing , 2011, ICCV.

[20]  Li Yi,et al.  Image Super-Resolution Via Analysis Sparse Prior , 2013, IEEE Signal Processing Letters.

[21]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[22]  Lei Zhang,et al.  Nonlocal back-projection for adaptive image enlargement , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[23]  曹飞龙,et al.  Image Interpolation via Low-Rank Matrix Completion and Recovery , 2015 .

[24]  Roberto Manduchi,et al.  Bilateral filtering for gray and color images , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[25]  Jian Sun,et al.  Computing nearest-neighbor fields via Propagation-Assisted KD-Trees , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  M. Shamim Hossain,et al.  Healthcare Big Data Voice Pathology Assessment Framework , 2016, IEEE Access.

[27]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[28]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[29]  Jean-Michel Morel,et al.  A Review of Image Denoising Algorithms, with a New One , 2005, Multiscale Model. Simul..

[30]  Truong Q. Nguyen,et al.  Novel Example-Based Method for Super-Resolution and Denoising of Medical Images , 2014, IEEE Transactions on Image Processing.

[31]  M. Shamim Hossain,et al.  Cloud-assisted Industrial Internet of Things (IIoT) - Enabled framework for health monitoring , 2016, Comput. Networks.

[32]  Michal Irani,et al.  Motion Analysis for Image Enhancement: Resolution, Occlusion, and Transparency , 1993, J. Vis. Commun. Image Represent..

[33]  M. Unser,et al.  Interpolation revisited [medical images application] , 2000, IEEE Transactions on Medical Imaging.

[34]  M. Shamim Hossain,et al.  Patient State Recognition System for Healthcare Using Speech and Facial Expressions , 2016, Journal of Medical Systems.

[35]  David A. Glanzer,et al.  Technical Overview , 2008 .

[36]  Lei Zhang,et al.  An edge-guided image interpolation algorithm via directional filtering and data fusion , 2006, IEEE Transactions on Image Processing.

[37]  Dinggang Shen,et al.  Fiber-driven resolution enhancement of diffusion-weighted images , 2014, NeuroImage.

[38]  D. Louis Collins,et al.  Non-local MRI upsampling , 2010, Medical Image Anal..

[39]  Dinggang Shen,et al.  Hierarchical Patch-Based Sparse Representation—A New Approach for Resolution Enhancement of 4D-CT Lung Data , 2012, IEEE Transactions on Medical Imaging.

[40]  Xuelong Li,et al.  Single Image Super-Resolution With Non-Local Means and Steering Kernel Regression , 2012, IEEE Transactions on Image Processing.

[41]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[42]  Caiming Zhang,et al.  Patch Grouping SVD-Based Denoising Aggregation Patch Grouping SVD-Based Denoising Aggregation Back Projection Noisy Image , 2015 .

[43]  Jin Li,et al.  Secure Deduplication with Efficient and Reliable Convergent Key Management , 2014, IEEE Transactions on Parallel and Distributed Systems.

[44]  Siu-Ming Yiu,et al.  Multi-key privacy-preserving deep learning in cloud computing , 2017, Future Gener. Comput. Syst..

[45]  Zongxu Pan,et al.  Super-Resolution Based on Compressive Sensing and Structural Self-Similarity for Remote Sensing Images , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[46]  Wan-Chi Siu,et al.  Single image super-resolution using iterative Wiener filter , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[47]  Lei Zhang,et al.  Sparse Representation Based Image Interpolation With Nonlocal Autoregressive Modeling , 2013, IEEE Transactions on Image Processing.

[48]  Stanley Osher,et al.  A Low Patch-Rank Interpretation of Texture , 2013, SIAM J. Imaging Sci..

[49]  R. Larsen Lanczos Bidiagonalization With Partial Reorthogonalization , 1998 .

[50]  Truong Q. Nguyen,et al.  Single Image Super-Resolution Using Local Geometric Duality and Non-Local Similarity , 2016, IEEE Transactions on Image Processing.

[51]  Yu-Chiang Frank Wang,et al.  A Self-Learning Approach to Single Image Super-Resolution , 2013, IEEE Transactions on Multimedia.