Low-rank modeling and its applications in medical image analysis

Computer-aided medical image analysis has been widely used in clinics to facilitate objective disease diagnosis. This facilitation, however, is often qualitative instead of quantitative due to the analysis challenges associated with medical images such as low signal-to-noise ratio, signal dropout, and large variations. Consequently, physicians have to rely on their personal experiences to make diagnostic decisions, which in turn is expertise-dependent and prone to individual bias. Recently, low-rank modeling based approaches have achieved great success in natural image analysis. There is a trend that low-rank modeling will find its applications in medical image analysis. In this review paper, we like to review the recent progresses along this direction. Concretely, we will first explain the mathematical background of low-rank modeling, categorize existing low-rank modeling approaches and their applications in natural image analysis. After that, we will illustrate some application examples of using low-rank modeling in medical image analysis. Finally, we will discuss some possibilities of developing more robust analysis methods to better analyze cardiac images.

[1]  Yu-Chiang Frank Wang,et al.  Low-rank matrix recovery with structural incoherence for robust face recognition , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Yi Ma,et al.  TILT: Transform Invariant Low-Rank Textures , 2010, ACCV.

[3]  Emmanuel J. Candès,et al.  Unbiased Risk Estimates for Singular Value Thresholding and Spectral Estimators , 2012, IEEE Transactions on Signal Processing.

[4]  Zhi-Pei Liang,et al.  Accelerating cardiovascular imaging by exploiting regional low-rank structure via group sparsity , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[5]  John C. S. Lui,et al.  Online Robust Subspace Tracking from Partial Information , 2011, ArXiv.

[6]  Takeo Kanade,et al.  Robust L/sub 1/ norm factorization in the presence of outliers and missing data by alternative convex programming , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  Xiaodong Li,et al.  Stable Principal Component Pursuit , 2010, 2010 IEEE International Symposium on Information Theory.

[8]  Hongkai Zhao,et al.  Robust principal component analysis-based four-dimensional computed tomography , 2011, Physics in medicine and biology.

[9]  Xiaowei Zhou,et al.  Moving Object Detection by Detecting Contiguous Outliers in the Low-Rank Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Emmanuel J. Candès,et al.  A Singular Value Thresholding Algorithm for Matrix Completion , 2008, SIAM J. Optim..

[11]  Yi Ma,et al.  The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices , 2010, Journal of structural biology.

[12]  Justin P. Haldar,et al.  Further development of image reconstruction from highly undersampled (k, t)-space data with joint partial separability and sparsity constraints , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[13]  Yin Zhang,et al.  Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm , 2012, Mathematical Programming Computation.

[14]  James S. Duncan,et al.  Segmentation of the Left Ventricle From Cardiac MR Images Using a Subject-Specific Dynamical Model , 2010, IEEE Transactions on Medical Imaging.

[15]  Gene H. Golub,et al.  Matrix computations , 1983 .

[16]  J. Moreau.  Proximité et dualité dans un espace hilbertien , 1965 .

[17]  Xiaowei Zhou,et al.  Automatic mitral leaflet tracking in echocardiography by outlier detection in the low-rank representation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[19]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[20]  Constantine Caramanis,et al.  Robust PCA via Outlier Pursuit , 2010, IEEE Transactions on Information Theory.

[21]  C. Eckart,et al.  The approximation of one matrix by another of lower rank , 1936 .

[22]  M. Lustig,et al.  Compressed Sensing MRI , 2008, IEEE Signal Processing Magazine.

[23]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[24]  Y. Nesterov.  Gradient methods for minimizing composite objective function , 2007 .

[25]  Mathews Jacob,et al.  Accelerated Dynamic MRI Exploiting Sparsity and Low-Rank Structure: k-t SLR , 2011, IEEE Transactions on Medical Imaging.

[26]  Habib Zaidi,et al.  Four-dimensional (4D) image reconstruction strategies in dynamic PET: beyond conventional independent frame reconstruction. , 2009, Medical physics.

[27]  Tao Ding,et al.  Fast track matching and event detection , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Justin P. Haldar,et al.  Low rank matrix recovery for real-time cardiac MRI , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[29]  Dong Liu,et al.  Robust late fusion with rank minimization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[30]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[31]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[32]  Jiang Du,et al.  Noise reduction in multiple-echo data sets using singular value decomposition. , 2006, Magnetic resonance imaging.

[33]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[34]  Zhi-Pei Liang,et al.  SPATIOTEMPORAL IMAGINGWITH PARTIALLY SEPARABLE FUNCTIONS , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[35]  Michael Isard,et al.  Active Contours , 2000, Springer London.

[36]  Dimitri P. Bertsekas,et al.  Nonlinear Programming , 1997 .

[37]  R. Edelman,et al.  Magnetic resonance imaging (2) , 1993, The New England journal of medicine.

[38]  Chin-Wang Tao,et al.  Medical image compression using principal component analysis , 1996, Proceedings of 3rd IEEE International Conference on Image Processing.

[39]  Takayuki Okatani,et al.  On the Wiberg Algorithm for Matrix Factorization in the Presence of Missing Components , 2007, International Journal of Computer Vision.

[40]  Robert D. Nowak,et al.  Online identification and tracking of subspaces from highly incomplete information , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[41]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[42]  Zuowei Shen,et al.  Robust video denoising using low rank matrix completion , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Norbert Schuff,et al.  Denoising diffusion-weighted MR magnitude image sequences using low rank and edge constraints , 2012, 2012 9th IEEE International Symposium on Biomedical Imaging (ISBI).

[44]  Alex Pentland,et al.  A Bayesian Computer Vision System for Modeling Human Interactions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  Mustafa Ayazoglu,et al.  Fast algorithms for structured robust principal component analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[47]  I. Jolliffe.  Principal Component Analysis , 2002 .

[48]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2009, Found. Comput. Math..

[49]  Angshul Majumdar,et al.  Exploiting rank deficiency and transform domain sparsity for MR image reconstruction. , 2012, Magnetic resonance imaging.

[50]  Chao Yang,et al.  Parsing façade with rank-one approximation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[51]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[52]  Tommi S. Jaakkola,et al.  Maximum-Margin Matrix Factorization , 2004, NIPS.

[53]  John Wright,et al.  RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images , 2012, IEEE Trans. Pattern Anal. Mach. Intell..

[54]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[55]  Steve B. Jiang,et al.  Cine Cone Beam CT Reconstruction Using Low-Rank Matrix Factorization: Algorithm and a Proof-of-Principle Study , 2012, IEEE Transactions on Medical Imaging.

[56]  Robert Tibshirani,et al.  Spectral Regularization Algorithms for Learning Large Incomplete Matrices , 2010, J. Mach. Learn. Res..

[57]  G. Sapiro,et al.  A collaborative framework for 3D alignment and classification of heterogeneous subvolumes in cryo-electron tomography. , 2013, Journal of structural biology.

[58]  Stefano Soatto,et al.  Dynamic Textures , 2003, International Journal of Computer Vision.

[59]  Yong Yu,et al.  Robust Subspace Segmentation by Low-Rank Representation , 2010, ICML.

[60]  Ying Wu,et al.  A unified approach to salient object detection via low rank matrix recovery , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[61]  Ronen Basri,et al.  Lambertian Reflectance and Linear Subspaces , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[62]  J. Alison Noble,et al.  Registration of Multiview Real-Time 3-D Echocardiographic Sequences , 2007, IEEE Transactions on Medical Imaging.

[63]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[64]  Xuelong Li,et al.  Matrix completion by Truncated Nuclear Norm Regularization , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[65]  Minh N. Do,et al.  Spatiotemporal denoising of MR spectroscopic imaging data by low-rank approximations , 2011, 2011 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[66]  Pablo A. Parrilo,et al.  Rank-Sparsity Incoherence for Matrix Decomposition , 2009, SIAM J. Optim..

[67]  Yi Ma,et al.  Compressive principal component pursuit , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[68]  R. Vidal,et al.  Motion segmentation with missing data using PowerFactorization and GPCA , 2004, CVPR 2004.