Object Removal and Image Restoration within Subspaces by Prioritized Patch Optimization

The purpose of this work is to develop a robust technique for image inpainting to restore small cracks as well as large regions those include the regions developed by object removal. The image to be restored is transformed into sub-bands by the use of DWT (Discrete Wavelet Transform). These sub-bands are reconstructed back to spatial domain to obtain the subspaces images that are at the same scale as the original image to be restored but having different resolutions. These subspace images are then subjected individually to ‘prioritized exemplar approach’ to fill-in different structures and textures simultaneously. We also optimize the patch size to cope up different sizes of textures, structures and varying resolution of the subspace images. These restored subspace images are superposed to obtain the final restored image. A number of images with changing complexion are used to estimate the effectiveness of the algorithm. The results shows visually plausible background where from the object is removed in variety of images with different structures and textures. The RMSE (Root Mean Squared Error) and PSNR (Peak Signal to Noise Ratio) measures are used to quantify the improvement over visual quality of the restoration.

[1]  Tony F. Chan,et al.  Total Variation Wavelet Inpainting , 2006, Journal of Mathematical Imaging and Vision.

[2]  L. Pessoa,et al.  Finding out about filling-in: a guide to perceptual completion for visual science and the philosophy of perception. , 1998, The Behavioral and brain sciences.

[3]  G. Kanizsa,et al.  Organization in Vision: Essays on Gestalt Perception , 1979 .

[4]  Rachid Deriche,et al.  Vector-valued image regularization with PDEs: a common framework for different applications , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Guillermo Sapiro,et al.  A Variational Framework for Exemplar-Based Image Inpainting , 2011, International Journal of Computer Vision.

[6]  Guillermo Sapiro,et al.  Wavelet-domain reconstruction of lost blocks in wireless image transmission and packet-switched networks , 2002, Proceedings. International Conference on Image Processing.

[7]  Rajesh Pandurang Borole,et al.  Patch-Based Inpainting for Object Removal and Region Filling in Images , 2013, J. Intell. Syst..

[8]  Raymond H. Chan,et al.  A Primal–Dual Method for Total-Variation-Based Wavelet Domain Inpainting , 2012, IEEE Transactions on Image Processing.

[9]  Qiuqi Ruan,et al.  Object Removal By Cross Isophotes Exemplar-based Inpainting , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Gang Pan,et al.  Structure-Aware Image Completion with Texture Propagation , 2011, 2011 Sixth International Conference on Image and Graphics.

[11]  Guillermo Sapiro,et al.  A Variational Model for Filling-In Gray Level and Color Images , 2001, ICCV.

[12]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[13]  Kim L. Boyer,et al.  Integration, Inference, and Management of Spatial Information Using Bayesian Networks: Perceptual Organization , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Guillermo Sapiro,et al.  Projection based image and video inpainting using wavelets , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[15]  Tien D. Bui,et al.  Image inpainting using wavelet-based inter- and intra-scale dependency , 2008, 2008 19th International Conference on Pattern Recognition.

[16]  James R. Bergen,et al.  Pyramid-based texture analysis/synthesis , 1995, Proceedings., International Conference on Image Processing.

[17]  Lingwei Chen,et al.  Blind Image Restoration Using Divisional Regularization and Wavelet Technique , 2008, 2008 Fourth International Conference on Natural Computation.

[18]  Dong Liang,et al.  An new method for image inpainting using wavelets , 2011, 2011 International Conference on Multimedia Technology.

[19]  Anil C. Kokaram,et al.  Interpolation of missing data in image sequences , 1995, IEEE Trans. Image Process..

[20]  Alexei A. Efros,et al.  Image quilting for texture synthesis and transfer , 2001, SIGGRAPH.

[21]  Rajesh Pandurang Borole,et al.  Image Restoration using Prioritized Exemplar Inpainting with Automatic Patch Optimization , 2017 .

[22]  Harry Shum,et al.  Image completion with structure propagation , 2005, ACM Trans. Graph..

[23]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[24]  Daniel Cohen-Or,et al.  Fragment-based image completion , 2003, ACM Trans. Graph..

[25]  Jean-Michel Morel,et al.  Level lines based disocclusion , 1998, Proceedings 1998 International Conference on Image Processing. ICIP98 (Cat. No.98CB36269).

[26]  Baining Guo,et al.  Real-time texture synthesis by patch-based sampling , 2001, TOGS.

[27]  David Donovan Garber,et al.  Computational models for texture analysis and texture synthesis , 1981 .

[28]  Paul Harrison,et al.  A Non-Hierarchical Procedure for Re-Synthesis of Complex Textures , 2001, WSCG.

[29]  Michael T. Orchard,et al.  Image Inpainting Based on Geometrical Modeling of Complexwavelet Coefficients , 2007, 2007 IEEE International Conference on Image Processing.

[30]  Michael Ashikhmin,et al.  Synthesizing natural textures , 2001, I3D '01.

[31]  Tony F. Chan,et al.  Non-texture inpainting by curvature-driven diffusions (CDD) , 2001 .

[32]  Raymond H. Chan,et al.  A Fast Optimization Transfer Algorithm for Image Inpainting in Wavelet Domains , 2009, IEEE Transactions on Image Processing.

[33]  Louis Laborelli,et al.  Missing data correction in still images and image sequences , 2002, MULTIMEDIA '02.

[34]  Yi-Chun Liao,et al.  Exemplar-based Image Inpainting base on Structure Construction , 2008, J. Softw..

[35]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[36]  Oscar C. Au,et al.  Sketch-Guided Texture-Based Image Inpainting , 2006, 2006 International Conference on Image Processing.

[37]  Jeremy S. De Bonet,et al.  Multiresolution sampling procedure for analysis and synthesis of texture images , 1997, SIGGRAPH.

[38]  Rajesh Pandurang Borole,et al.  Image Restoration and Object Removal Using Prioritized Adaptive Patch-Based Inpainting in a Wavelet Domain , 2017, J. Inf. Process. Syst..