A generalized modeling of ill-posed inverse reconstruction of images using a novel data-driven framework

By definition, an instance of image reconstruction often combines denoising, deblurring and enhancing objectively and appears as a fundamental process in visual processing systems which is mathematically an ill-posed inverse optimization problem. It suffers additional complexities because of a non-stationary nature of the image, restricting available methods to produce inconsistent restoration on a variety of image and degradation types. It requires filling this gap by a generic framework of image restoration. Therefore, in this paper, we modeled a novel data-driven framework of generic image reconstruction as a testing benchmark to the emerging application of deep learning. The proposed framework comprises of data engineering, image filtering and a regression neural network for better restoration of many degraded images. We evaluated the effectiveness of the framework on many images degraded by a Gaussian, out-of-focus, motion or airy-pattern blur and random additive white Gaussian noise. The performance appeared better in comparison to a benchmark and state-of-the-art generic image restoration results on several indicators. Furthermore, the framework performed better in comparison to a recent approach to image reconstruction which uses a deep convolutional neural network.

[1]  João Paulo Papa,et al.  A Deep Boltzmann Machine-Based Approach for Robust Image Denoising , 2017, CIARP.

[2]  Jitendra Malik,et al.  A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[3]  Rémi Flamary,et al.  Astronomical image reconstruction with convolutional neural networks , 2016, 2017 25th European Signal Processing Conference (EUSIPCO).

[4]  Peyman Milanfar,et al.  A General Framework for Regularized, Similarity-Based Image Restoration , 2014, IEEE Transactions on Image Processing.

[5]  Raveendran Paramesran,et al.  Hybrid non-convex second-order total variation with applications to non-blind image deblurring , 2020, Signal Image Video Process..

[6]  Wei Liu,et al.  Deep Non-Blind Deconvolution via Generalized Low-Rank Approximation , 2018, NeurIPS.

[7]  Chi Fang,et al.  Robust Image Restoration via Adaptive Low-Rank Approximation and Joint Kernel Regression , 2014, IEEE Transactions on Image Processing.

[8]  Re Gonzalez,et al.  R.C. Eddins, Digital image processing using MATLAB, vol. Gatesmark Publishing Knoxville , 2009 .

[9]  Mohsin Bilal,et al.  Evolutionary Reconstruction: Image Restoration for Space Variant Degradation , 2013, Smart Comput. Rev..

[10]  Tae-Sun Choi,et al.  Estimation and optimization based ill-posed inverse restoration using fuzzy logic , 2012, Multimedia Tools and Applications.

[11]  Ting-Zhu Huang,et al.  An Efficient Variational Method for Image Restoration , 2013 .

[12]  Aggelos K. Katsaggelos,et al.  Image restoration using a modified Hopfield network , 1992, IEEE Trans. Image Process..

[13]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[14]  Stuart William Perry,et al.  Adaptive Image Restoration: Perception Based Neural Nework Models and Algorithms. , 2006 .

[15]  Michael J. Black,et al.  Fields of Experts , 2009, International Journal of Computer Vision.

[16]  Heyan Huang,et al.  Texture-preserving deconvolution via image decomposition , 2017, Signal Image Video Process..

[17]  Yicong Zhou,et al.  A new weighted mean filter with a two-phase detector for removing impulse noise , 2015, Inf. Sci..

[18]  Mohsin Bilal,et al.  Novel Optimization Framework to Recover True Image Data , 2015, Cognitive Computation.

[19]  D S Biggs,et al.  Acceleration of iterative image restoration algorithms. , 1997, Applied optics.

[20]  Dianne P. O'Leary,et al.  Deblurring Images: Matrices, Spectra and Filtering , 2006, J. Electronic Imaging.

[21]  Ayyaz Hussain,et al.  Optimal edge preserving restoration with efficient regularisation , 2015 .

[22]  Mohsin Bilal,et al.  Modified particle swarm optimization and fuzzy regularization for pseudo de-convolution of spatially variant blurs , 2015, Multimedia Tools and Applications.

[23]  Michael Unser,et al.  Deep Convolutional Neural Network for Inverse Problems in Imaging , 2016, IEEE Transactions on Image Processing.

[24]  Max Mignotte,et al.  A segmentation-based regularization term for image deconvolution , 2006, IEEE Transactions on Image Processing.

[25]  Xin Zhang,et al.  Non-blind deblurring of structured images with geometric deformation , 2014, The Visual Computer.

[26]  Tae-Sun Choi,et al.  Fuzzy-based hybrid filter for Rician noise removal , 2016, Signal Image Video Process..

[27]  Yu Shi,et al.  Multi-frame real image restoration based on double loops with alternative maximum likelihood estimation , 2016, Signal Image Video Process..

[28]  William H. Richardson,et al.  Bayesian-Based Iterative Method of Image Restoration , 1972 .

[29]  Nasser Aghazadeh,et al.  Reordering for improving global Arnoldi–Tikhonov method in image restoration problems , 2018, Signal Image Video Process..

[30]  Ce Liu,et al.  Deep Convolutional Neural Network for Image Deconvolution , 2014, NIPS.

[31]  L. Lucy An iterative technique for the rectification of observed distributions , 1974 .

[32]  Mohsin Bilal,et al.  Image restoration by multivariate-stochastic optimization using improved particle swarm algorithm , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).