Image Inpainting by Multiscale Spline Interpolation

Recovering the missing region of images is a task that is called image inpainting. Due to the shape of missing areas, different methods are presented with different views. One of the challenges of this problem is extracting various features which lead to better results. Experimental results show that both global and local features are useful for this task. In this paper, a multi-scale image inpainting method that utilizes both local and global features is proposed. The first step of this method is selecting the scales of the image according to the width of the lines in the mask. Then adaptive image inpainting is applied to the damaged images, and the lost pixels are predicted, and at the end, before voting the results, the repaired image of each scale is up-sampled. The proposed method is tested on damaged images with scratches and creases. The metric that we use to evaluate our approach is PSNR. In this metric, 1.2 dB improvement exists compare with previous works.

[1]  Mehran Ebrahimi,et al.  EdgeConnect: Generative Image Inpainting with Adversarial Edge Learning , 2019, ArXiv.

[2]  Bo Du,et al.  MUSICAL: Multi-Scale Image Contextual Attention Learning for Inpainting , 2019, IJCAI.

[3]  Jaime Larumbe.  Automatic Text Detection Using Morphological Operations and Inpainting , 2017 .

[4]  Xiangzhi Bai,et al.  Patch-Sparsity-Based Image Inpainting Through a Facet Deduced Directional Derivative , 2019, IEEE Transactions on Circuits and Systems for Video Technology.

[5]  Petros Maragos,et al.  An inpainting system for automatic image structure - texture restoration with text removal , 2008, 2008 15th IEEE International Conference on Image Processing.

[6]  Wu Yadong,et al.  An Efficient Scratches Detection and Inpainting Algorithm for Old Film Restoration , 2009, 2009 International Conference on Information Technology and Computer Science.

[7]  Harry Shum,et al.  Automatic eyeglasses removal from face images , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Yaojie Liu,et al.  A comparison of image inpainting techniques , 2015, International Conference on Graphic and Image Processing.

[9]  Shadrokh Samavi,et al.  Image Inpainting by Adaptive Fusion of Variable Spline Interpolations , 2020, 2020 25th International Computer Conference, Computer Society of Iran (CSICC).

[10]  Meiqing Wang,et al.  Fast Convergent Image Inpainting Method Based on BSCB Model , 2009 .

[11]  Hiroshi Ishikawa,et al.  Globally and locally consistent image completion , 2017, ACM Trans. Graph..

[12]  Nader Karimi,et al.  RIBBONS: Rapid Inpainting Based on Browsing of Neighborhood Statistics , 2018, Electrical Engineering (ICEE), Iranian Conference on.

[13]  Nader Karimi,et al.  Image Inpainting by Hyperbolic Selection of Pixels for Two-Dimensional Bicubic Interpolations , 2017, Electrical Engineering (ICEE), Iranian Conference on.

[14]  T. S. Subashini,et al.  Automatic Detection and Inpainting of Text Images , 2013 .

[15]  Narendra Patel,et al.  AUTOMATIC TEXT DETECTION USING ORPHOLOGICAL OPERATIONS AND INPAINTING , 2013 .