CoInGP: convolutional inpainting with genetic programming

We investigate the use of Genetic Programming (GP) as a convolutional predictor for supervised learning tasks in signal processing, focusing on the use case of predicting missing pixels in images. The training is performed by sweeping a small sliding window on the available pixels: all pixels in the window except for the central one are fed in input to a GP tree whose output is taken as the predicted value for the central pixel. The best GP tree in the population scoring the lowest prediction error over all available pixels in the population is then tested on the actual missing pixels of the degraded image. We experimentally assess this approach by training over four target images, removing up to 20\% of the pixels for the testing phase. The results indicate that our method can learn to some extent the distribution of missing pixels in an image and that GP with Moore neighborhood works better than the Von Neumann neighborhood, although the latter allows for a larger training set size.

[1]  John R. Koza,et al.  Genetic programming - on the programming of computers by means of natural selection , 1993, Complex adaptive systems.

[2]  Omar ElHarrouss,et al.  Image Inpainting: A Review , 2019, Neural Processing Letters.

[3]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[4]  Sung Yong Shin,et al.  On pixel-based texture synthesis by non-parametric sampling , 2006, Comput. Graph..

[5]  Yi Mei,et al.  Genetic programming for production scheduling: a survey with a unified framework , 2017, Complex & Intelligent Systems.

[6]  Una-May O'Reilly,et al.  One-Class Classification of Low Volume DoS Attacks with Genetic Programming , 2017, GPTP.

[7]  Qi Chen,et al.  Hessian Complexity Measure for Genetic Programming-Based Imputation Predictor Selection in Symbolic Regression with Incomplete Data , 2020, EuroGP.

[8]  Riccardo Poli,et al.  A Field Guide to Genetic Programming , 2008 .

[9]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[10]  Zhen Yang,et al.  Exemplar Image Completion Based on Evolutionary Algorithms , 2013, 2013 Fourth International Conference on Emerging Intelligent Data and Web Technologies.

[11]  Mengjie Zhang,et al.  Multiple imputation and genetic programming for classification with incomplete data , 2017, GECCO.

[12]  Maarten Keijzer,et al.  Improving Symbolic Regression with Interval Arithmetic and Linear Scaling , 2003, EuroGP.

[13]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Hugo Jair Escalante,et al.  Convolutional Genetic Programming , 2019, MCPR.

[15]  Mengjie Zhang,et al.  Multiple Imputation for Missing Data Using Genetic Programming , 2015, GECCO.

[16]  Cynthia Rudin,et al.  This Looks Like That: Deep Learning for Interpretable Image Recognition , 2018 .

[17]  Christine Guillemot,et al.  Image Inpainting : Overview and Recent Advances , 2014, IEEE Signal Processing Magazine.

[18]  Guillermo Sapiro,et al.  A Comprehensive Framework for Image Inpainting , 2010, IEEE Transactions on Image Processing.

[19]  Jiwu Huang,et al.  Localization of Diffusion-Based Inpainting in Digital Images , 2017, IEEE Transactions on Information Forensics and Security.

[20]  Helio J. C. Barbosa,et al.  Symbolic regression via genetic programming , 2000, Proceedings. Vol.1. Sixth Brazilian Symposium on Neural Networks.

[21]  Joel L. Schiff,et al.  Cellular Automata: A Discrete View of the World (Wiley Series in Discrete Mathematics & Optimization) , 2007 .

[22]  Ting-Chun Wang,et al.  Image Inpainting for Irregular Holes Using Partial Convolutions , 2018, ECCV.

[23]  Shiguang Shan,et al.  Shift-Net: Image Inpainting via Deep Feature Rearrangement , 2018, ECCV.

[24]  Zhen Yang,et al.  Image inpainting algorithm based on TV model and evolutionary algorithm , 2014, Soft Computing - A Fusion of Foundations, Methodologies and Applications.

[25]  Aleksandra Pizurica,et al.  Context-Aware Patch-Based Image Inpainting Using Markov Random Field Modeling , 2015, IEEE Transactions on Image Processing.