Optimal Restoration of Spatially Variant Degraded Images using Intelligent Methods

Image restoration is fundamental to visual information processing systems. In many real world scenarios, noise and blur are the two main unavoidable sources of degradation in images. The problem is deemed as an ill-posed inverse by nature due to the simultaneous occurrences of noise and blur in the image. Blurring function categorizes the degradation as space variant (SVD) if different spatial locations of the recorded scene are convolved by varying point spread function. In contrast, the degradation is categorized as spatially invariant (SID) if a unique point spread function blurs the whole image. This dissertation focuses on spatial degradations, initiating from space invariant towards space variant. Existing methods for restoration of SVD images, for example, neural networks and numerical optimization bear the limitations of high cost, lower restoration, less generalization, discontinuity and instability for different spatial locations. It is learnt that three factors are vital to develop an effective framework for restoration, which are: 1. The optimization of the ill-posed inverse restoration problem by minimizing constrained error function 2. A smoothness constraint 3. A regularization scheme The main objective of this dissertation is to improve the restoration results, by possible applications of new intelligent methods. This dissertation provides comprehensive solutions to both spatial degradation problems, by considering above three factors. Firstly, SID images are restored, by a steepest descent based restoration approach. In this approach, an efficient smoothness constraint is proposed, to model the error function. In the next step, the steepest descent based approach is improved and a novel fuzzy regularization scheme is also proposed to better model the error function. It performed better than the existing methods on a specific blur function and low power additive noise. However, local search properties of gradient based approaches and eventually lower restoration for SVD images, due to their high sensitivity for varying textures, noise powers and blurs allowed for the possible application of computational intelligence models. Finally, in this dissertation, a new optimization framework is proposed for image restoration of SVD images. In the proposed framework, particle swarm optimization based evolution is retained to minimize the Modified Error Estimate (MEE), for better restoration. The framework added hyper-heuristic layer to combine local and global search properties. Therefore, randomness in the evolution, augmented with apriori knowledge from problem domain, assisted in achieving the objective of better restoration. It introduced new swarm initialization and mutation of global best particle of the swarm. In addition, an adaptive weighted regularization scheme is introduced in MEE to cater with the uncertainty due to ill-posed nature of the inverse problem. Furthermore, a new fuzzy logic and mathematical morphology based regularization scheme is also proposed in the framework, to improve the restoration stability and generalization, for SVD images. Different experiments are performed to observe the performance of proposed solutions. Visual and quantitative results are obtained and provided for each experiment. Signal-to-noise ratio (SNR) and mean-squared-error (MSE) are computed for comparative analysis, which endorsed better restoration quantitatively, over well-known restoration methods. However, the stability in restoration performance of proposed framework is observed in visual results, for SVD images. Detailed experimental and comparative analysis shown better restoration, stabilization and generalization of the proposed framework for varied textures in standard and simulated images, and noises over well-known restoration approaches. I dedicate this thesis to my loving parents and other family members who supported me a lot in reaching my goal.

[1]  Gui Wei-hua,et al.  Medical Images Edge Detection Based on Mathematical Morphology , 2005, 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference.

[2]  Barry R. Masters,et al.  Digital Image Processing, Third Edition , 2009 .

[3]  L. Clarke,et al.  Fuzzy-logic adaptive neural networks for nuclear medicine image restorations , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[4]  Doreen Meier,et al.  Fundamentals Of Neural Networks Architectures Algorithms And Applications , 2016 .

[5]  David Mendlovic,et al.  Deblurring Space-Variant Blur by Adding Noisy Image , 2011, SSVM.

[6]  Khier Benmahammed,et al.  Multiresolution Support for Adaptive Image Restoration Using Neural Networks , 2002, ICANN.

[7]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[8]  Bo Zhao,et al.  Non-blind Image Deblurring from a Single Image , 2012, Cognitive Computation.

[9]  Heung-Moon Choi,et al.  Nonlinear restoration of spatially varying blurred images using self-organizing neural network , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[10]  Vitaly Kober,et al.  Space-Variant Restoration with Sliding Discrete Cosine Transform , 2007, CAIP.

[11]  Banshidhar Majhi,et al.  Particle swarm optimization based regularization for image restoration , 2009, 2009 World Congress on Nature & Biologically Inspired Computing (NaBIC).

[12]  Aggelos K. Katsaggelos,et al.  Image restoration using a modified Hopfield network , 1992, IEEE Trans. Image Process..

[13]  Ling Guan,et al.  Adaptive Image Processing: A Computational Intelligence Perspective , 2001 .

[14]  Mohammad Majid al-Rifaie,et al.  Creativity and Autonomy in Swarm Intelligence Systems , 2012, Cognitive Computation.

[15]  Joachim Weickert,et al.  Variational Deblurring of Images with Uncertain and Spatially Variant Blurs , 2005, DAGM-Symposium.

[16]  Wilhelm Burger,et al.  Digital Image Processing - An Algorithmic Introduction using Java , 2008, Texts in Computer Science.

[17]  Yi Sun A generalized updating rule for modified Hopfield neural network , 1997, Proceedings of International Conference on Neural Networks (ICNN'97).

[18]  Stuart Jefferies,et al.  A computational method for the restoration of images with an unknown, spatially-varying blur. , 2006, Optics express.

[19]  Alexander V. Tikhonov,et al.  Ill-Posed Problems in Natural Sciences , 1989 .

[20]  D S Biggs,et al.  Acceleration of iterative image restoration algorithms. , 1997, Applied optics.

[21]  Shu-Mei Guo,et al.  A Novel Fuzzy Filter for Impulse Noise Removal , 2004, ISNN.

[22]  Ling Guan Image restoration by a neural network with hierarchical cluster architecture , 1994, J. Electronic Imaging.

[23]  Yun Zhang,et al.  Color images restoration with multi-layer morphological(MLM) neural network , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[24]  David C. Redding,et al.  Massively Parallel Spatially-Variant Maximum Likelihood Image Restoration , 1995, Signal Recovery and Synthesis.

[25]  José Manuel Fuertes,et al.  Decision support system for classifying archaeological pottery profiles based on Mathematical Morphology , 2014, Multimedia Tools and Applications.

[26]  Eero P. Simoncelli,et al.  Image Denoising using Gaussian Scale Mixtures in the Wavelet Domain , 2002 .

[27]  José Demisio Simões da Silva,et al.  Restoring images with a multiscale neural network based technique , 2008, 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence).

[28]  Max Mignotte,et al.  A segmentation-based regularization term for image deconvolution , 2006, IEEE Transactions on Image Processing.

[29]  Li Gao,et al.  A new method for parameter estimation of edge-preserving regularization in image restoration , 2009 .

[30]  Maurice Clerc,et al.  The particle swarm - explosion, stability, and convergence in a multidimensional complex space , 2002, IEEE Trans. Evol. Comput..

[31]  Mohsin Bilal,et al.  Evolutionary Reconstruction: Image Restoration for Space Variant Degradation , 2013, Smart Comput. Rev..

[32]  Stuart William Perry,et al.  Adaptive Image Restoration: Perception Based Neural Nework Models and Algorithms. , 2006 .

[33]  Nahum Kiryati,et al.  Restoration of Images with Piecewise Space-Variant Blur , 2007, SSVM.

[34]  Tae-Sun Choi,et al.  Estimation and optimization based ill-posed inverse restoration using fuzzy logic , 2012, Multimedia Tools and Applications.

[35]  B. K. Jenkins,et al.  Image restoration using a neural network , 1988, IEEE Trans. Acoust. Speech Signal Process..

[36]  Ling Guan,et al.  Weight assignment for adaptive image restoration by neural networks , 2000, IEEE Trans. Neural Networks Learn. Syst..

[37]  K. Benmahammed,et al.  Adaptive image restoration using Hopfield neural network , 2001, Neural Networks for Signal Processing XI: Proceedings of the 2001 IEEE Signal Processing Society Workshop (IEEE Cat. No.01TH8584).

[38]  Aggelos K. Katsaggelos,et al.  Digital image restoration , 2012, IEEE Signal Process. Mag..

[39]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[40]  Tae-Sun Choi,et al.  Intelligent noise detection and filtering using neuro-fuzzy system , 2012, Multimedia Tools and Applications.

[41]  Eero P. Simoncelli,et al.  Image restoration using Gaussian scale mixtures in the wavelet domain , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[43]  Zhe Jiang,et al.  Spatial Statistics , 2013 .

[44]  Ya-Xiang Yuan,et al.  Optimization Theory and Methods: Nonlinear Programming , 2010 .

[45]  S. R. Simanca,et al.  On Circulant Matrices , 2012 .

[46]  Tae-Sun Choi,et al.  Rician noise removal from MR images using novel adapted selective non-local means filter , 2012, Multimedia Tools and Applications.

[47]  A. Murat Tekalp,et al.  POCS-based restoration of space-varying blurred images , 1994, IEEE Trans. Image Process..

[48]  Aggelos K. Katsaggelos,et al.  A regularized iterative image restoration algorithm , 1991, IEEE Trans. Signal Process..

[49]  Javier Portilla,et al.  Image Restoration Using Space-Variant Gaussian Scale Mixtures in Overcomplete Pyramids , 2008, IEEE Transactions on Image Processing.

[50]  Dianne P. O'Leary,et al.  Restoring Images Degraded by Spatially Variant Blur , 1998, SIAM J. Sci. Comput..

[51]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .