Optimization Methods for Medical Image Super Resolution Reconstruction

Super-resolution (SR) concentrates on constructing a high-resolution (HR) image of a scene from two or more sets of low-resolution (LR) images of the same scene. It is the process of combining a sequence of low-resolution (LR) noisy blurred images to produce a higher-resolution image. The reconstruction of high-resolution images is computationally expensive. SR is defined to be an inverse problem that is well-known as ill-conditioned. The SR problem has been reformulated using optimization techniques to define a solution that is a close approximation of the true scene and less sensitive to errors in the observed images. This paper reviews the optimized SR reconstruction approaches and highlights its challenges and limitations. An experiment has been done to compare between bicubic, iterative back-projection (IBP), projected onto convex sets (POCS), total variation (TV) and Gradient descent via sparse representation. The experimental results show that Gradient descent via sparse representation outperforms other optimization techniques.

[1]  Changhong Chen,et al.  Adaptive joint nonlocal means denoising back projection for image super resolution , 2013, 2013 IEEE International Conference on Image Processing.

[2]  Michael Elad,et al.  Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images , 1997, IEEE Trans. Image Process..

[3]  Lina J. Karam,et al.  Super-resolution using a Wavelet-based Adaptive Wiener Filter , 2010, 2010 IEEE International Conference on Image Processing.

[4]  Xiaohai He,et al.  An Improved Iterative Back-Projection Algorithm for Video Super-Resolution Reconstruction , 2010, 2010 Symposium on Photonics and Optoelectronics.

[5]  Richard C. Pais,et al.  The Lung Image Database Consortium (LIDC) and Image Database Resource Initiative (IDRI): a completed reference database of lung nodules on CT scans. , 2011, Medical physics.

[6]  Yu Bing Han,et al.  Super resolution reconstruction of video sequence based on total variation , 2004, Proceedings of 2004 International Symposium on Intelligent Multimedia, Video and Speech Processing, 2004..

[7]  Gholamreza Anbarjafari,et al.  Improved Iterative Back Projection for video super-resolution , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[8]  Heng Lian,et al.  Variational Local Structure Estimation for Image Super-Resolution , 2006, 2006 International Conference on Image Processing.

[9]  Mohamed M. Fouad,et al.  Two-step super-resolution technique using bounded total variation and bisquare M-estimator under local illumination changes , 2011, 2011 18th IEEE International Conference on Image Processing.

[10]  M. Hadhoud,et al.  A new super-resolution image reconstruction algorithm based on wavelet fusion , 2005, Proceedings of the Twenty-Second National Radio Science Conference, 2005. NRSC 2005..

[11]  Edmund Y. Lam,et al.  A Total Variation Regularization Based Super-Resolution Reconstruction Algorithm for Digital Video , 2007, EURASIP J. Adv. Signal Process..

[12]  Niyanta Panchal,et al.  Survey On Multi-Frame Image Super-Resolution , 2013 .

[13]  Nikolas P. Galatsanos,et al.  Super-Resolution Based on Fast Registration and Maximum a Posteriori Reconstruction , 2007, IEEE Transactions on Image Processing.

[14]  Joseph Y. Lo,et al.  Efficient Fourier-Wavelet Super-Resolution , 2010, IEEE Transactions on Image Processing.

[15]  Dionysios I. Reisis,et al.  Single-image super-resolution using low complexity adaptive iterative back-projection , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[16]  Aggelos K. Katsaggelos,et al.  Total variation super resolution using a variational approach , 2008, 2008 15th IEEE International Conference on Image Processing.

[17]  Fei Zhou,et al.  Image super-resolution via Kernel regression of sparse coefficients , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  Truong Q. Nguyen,et al.  Fast and high quality learning-based super-resolution utilizing TV regularization method , 2011, 2011 18th IEEE International Conference on Image Processing.

[19]  Dinesh Rajan,et al.  Unified Blind Method for Multi-Image Super-Resolution and Single/Multi-Image Blur Deconvolution , 2013, IEEE Transactions on Image Processing.

[20]  Luca Lucchese,et al.  A Frequency Domain Technique for Range Data Registration , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Masato Inoue,et al.  Posterior mean super-resolution with a compound Gaussian Markov random field prior , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Min-Cheng Pan,et al.  Efficient method for improving Poisson MAP super-resolution , 1999 .

[23]  Dan Ventura,et al.  Super-resolution via recapture and Bayesian effect modeling , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Hao Chen,et al.  Blind Super-Resolution Image Reconstruction Based on POCS Model , 2009, 2009 International Conference on Measuring Technology and Mechatronics Automation.

[25]  Joos Vandewalle,et al.  How to take advantage of aliasing in bandlimited signals , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[26]  Masato Inoue,et al.  Posterior-Mean Super-Resolution With a Causal Gaussian Markov Random Field Prior , 2011, IEEE Transactions on Image Processing.

[27]  Liangpei Zhang,et al.  Multiframe Super-Resolution Employing a Spatially Weighted Total Variation Model , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[28]  Andrew Zisserman,et al.  Computer vision applied to super resolution , 2003, IEEE Signal Process. Mag..

[29]  M. Sakurai,et al.  Super-resolution image processing with total variation regularization and shock filters , 2012, The 1st IEEE Global Conference on Consumer Electronics 2012.

[30]  Kai-Kuang Ma,et al.  A survey on super-resolution imaging , 2011, Signal Image Video Process..

[31]  Sabine Süsstrunk,et al.  A Frequency Domain Approach to Registration of Aliased Images with Application to Super-resolution , 2006, EURASIP J. Adv. Signal Process..

[32]  Sabine Süsstrunk,et al.  Super-resolution from highly undersampled images , 2005, IEEE International Conference on Image Processing 2005.

[33]  Luca Lucchese,et al.  A noise-robust frequency domain technique for estimating planar roto-translations , 2000, IEEE Trans. Signal Process..

[34]  Huixin Zhou,et al.  Total variation regularized iterative back-projection method for single frame image super resolution , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[35]  Yu-Chiang Frank Wang,et al.  A Self-Learning Approach to Single Image Super-Resolution , 2013, IEEE Transactions on Multimedia.

[36]  Masashi Watanabe,et al.  Super-resolution utilizing total variation regularization and a shock filter , 2012, 2012 19th IEEE International Conference on Image Processing.

[37]  Joseph Chazalon,et al.  Efficient Example-Based Super-Resolution of Single Text Images Based on Selective Patch Processing , 2014, 2014 11th IAPR International Workshop on Document Analysis Systems.

[38]  Xuelong Li,et al.  A Unified Learning Framework for Single Image Super-Resolution , 2014, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Joos Vandewalle,et al.  Super-Resolution From Unregistered and Totally Aliased Signals Using Subspace Methods , 2007, IEEE Transactions on Signal Processing.

[40]  Jianping Qiao,et al.  Gradient-based adaptive interpolation in super-resolution image restoration , 2008, 2008 9th International Conference on Signal Processing.

[41]  Marwa Moustafa,et al.  Analysis of shift estimation techniques of super resolution applied to satellite images , 2013, 2013 8th International Conference on Computer Engineering & Systems (ICCES).

[42]  Gholamreza Anbarjafari,et al.  Iterative back projection based image resolution enhancement , 2013, 2013 8th Iranian Conference on Machine Vision and Image Processing (MVIP).

[43]  Shmuel Peleg,et al.  Image sequence enhancement using sub-pixel displacements , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[44]  Yong Hu,et al.  Video image super-resolution restoration based on iterative back-projection algorithm , 2009, 2009 IEEE International Conference on Computational Intelligence for Measurement Systems and Applications.

[45]  Chia-Hung Yeh,et al.  Self-learning-based single image super-resolution of a highly compressed image , 2013, 2013 IEEE 15th International Workshop on Multimedia Signal Processing (MMSP).

[46]  Fei Zhou,et al.  Single image super-resolution using incoherent sub-dictionaries learning , 2012, IEEE Transactions on Consumer Electronics.

[47]  Gholamreza Anbarjafari,et al.  Image resolution enhancement by using interpolation followed by iterative back projection , 2013, 2013 21st Signal Processing and Communications Applications Conference (SIU).

[48]  Moon Gi Kang,et al.  Super-resolution image reconstruction: a technical overview , 2003, IEEE Signal Process. Mag..

[49]  Zhanpeng Zhang,et al.  Multi-frame Image Super-resolution by Total-variation Regularization , 2012 .

[50]  Jin Hyung Kim,et al.  An example-based prior model for text image super-resolution , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[51]  R. Venkatesh Babu,et al.  Super resolution using a single image dictionary , 2014, 2014 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT).

[52]  Harry Shum,et al.  Patch based blind image super resolution , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[53]  Joos Vandewalle,et al.  Aliasing is Good for You: Joint Registration and Reconstruction for Super-Resolution , 2006 .

[54]  Tomio Goto,et al.  Super resolution image reconstruction using total variation regularization and learning-based method , 2010, 2010 IEEE International Conference on Image Processing.

[55]  Roger Y. Tsai,et al.  Multiframe image restoration and registration , 1984 .

[56]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[57]  Rui Xu,et al.  Super resolution reconstruction based on total variation regularization , 2010, 2010 IEEE International Conference on Robotics and Biomimetics.

[58]  Volodymyr Ponomaryov,et al.  Super Resolution Image Generation Using Wavelet Domain Interpolation With Edge Extraction via a Sparse Representation , 2014, IEEE Geoscience and Remote Sensing Letters.

[59]  H. Stark,et al.  Tomographic image reconstruction using the theory of convex projections. , 1988, IEEE transactions on medical imaging.

[60]  Frédéric Champagnat,et al.  An Improved Observation Model for Super-Resolution Under Affine Motion , 2006, IEEE Transactions on Image Processing.

[61]  B. Marcel,et al.  3 - Calcul de translation et rotation par la transformation de Fourier , 1997 .

[62]  Michael Elad,et al.  Advances and challenges in super‐resolution , 2004, Int. J. Imaging Syst. Technol..

[63]  Tomio Goto,et al.  New learning-based super resolution utilizing total variation regularization method , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[64]  N. Kumar,et al.  Neural network based single image super resolution , 2012, 11th Symposium on Neural Network Applications in Electrical Engineering.

[65]  Russell Zaretzki,et al.  Non-parametric Bayesian dictionary learning for image super resolution , 2011 .

[66]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[67]  Thomas S. Huang,et al.  Image Super-Resolution Via Sparse Representation , 2010, IEEE Transactions on Image Processing.

[68]  Chun Qi,et al.  Low-Rank Neighbor Embedding for Single Image Super-Resolution , 2014, IEEE Signal Processing Letters.

[69]  Yanbing Xue,et al.  Super-Resolution Image Reconstruction Based on K-Means-Markov Network , 2009, 2009 Fifth International Conference on Natural Computation.

[70]  Liangpei Zhang,et al.  A MAP Approach for Joint Motion Estimation, Segmentation, and Super Resolution , 2007, IEEE Transactions on Image Processing.

[71]  Kin-Man Lam,et al.  Guided iterative back-projection scheme for single-image super-resolution , 2013, 2013 IEEE Global High Tech Congress on Electronics.