GAN Evaluation by Multi-Method Fusion

Generative adversarial networks (GAN) have made great progress in areas, such as computer vision, but evaluation of GAN models is still a daunting task. Numerous researchers have proposed many methods for GAN model evaluation. However, most methods have strong pertinence, which leads to large deviations in the results of different evaluation methods. To date, no consensus has been reached on which method best captures the advantages and limitations of GAN models. In this study, a multi-method fusion approach is proposed to evaluate GAN models from many aspects, such as accuracy, diversity of the images generated by the model, and similarity with the training images. This method provides a new idea for GAN model assessment. Meanwhile, a strategy similar to ensemble learning is used to analyze the generalization of multi-method fusion for GAN assessment. This method and the human eye cognitive assessment model are used on celebA benchmarks and self-acquired image data sets to generate results. Through human eye cognition and comparison with the latest GAN model assessment method, showing that the multi-method fusion GAN evaluation method proposed in this paper has strong robustness and effectiveness.

[1]  Julien Rabin,et al.  Wasserstein Barycenter and Its Application to Texture Mixing , 2011, SSVM.

[2]  Alexei A. Efros,et al.  Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[3]  Bolei Zhou,et al.  Learning Deep Features for Scene Recognition using Places Database , 2014, NIPS.

[4]  Weisi Lin,et al.  A ParaBoost Method to Image Quality Assessment , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[5]  D. Dowson,et al.  The Fréchet distance between multivariate normal distributions , 1982 .

[6]  H. Hahn Sur quelques points du calcul fonctionnel , 1908 .

[7]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[8]  Hui Jiang,et al.  Generating images with recurrent adversarial networks , 2016, ArXiv.

[9]  Léon Bottou,et al.  Wasserstein Generative Adversarial Networks , 2017, ICML.

[10]  Rishi Sharma,et al.  A Note on the Inception Score , 2018, ArXiv.

[11]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[12]  Ali Borji,et al.  Pros and Cons of GAN Evaluation Measures , 2018, Comput. Vis. Image Underst..

[13]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.

[15]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Weisi Lin,et al.  Image Quality Assessment Using Multi-Method Fusion , 2013, IEEE Transactions on Image Processing.

[17]  W. Hoeffding Probability Inequalities for sums of Bounded Random Variables , 1963 .

[18]  Rob Fergus,et al.  Deep Generative Image Models using a Laplacian Pyramid of Adversarial Networks , 2015, NIPS.

[19]  Sepp Hochreiter,et al.  GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium , 2017, NIPS.

[20]  Abhinav Gupta,et al.  Generative Image Modeling Using Style and Structure Adversarial Networks , 2016, ECCV.

[21]  Jaakko Lehtinen,et al.  Progressive Growing of GANs for Improved Quality, Stability, and Variation , 2017, ICLR.

[22]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Soumith Chintala,et al.  Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks , 2015, ICLR.

[24]  Alex Graves,et al.  Conditional Image Generation with PixelCNN Decoders , 2016, NIPS.

[25]  Cordelia Schmid,et al.  How good is my GAN? , 2018, ECCV.

[26]  E. H. Simpson Measurement of Diversity , 1949, Nature.

[27]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[28]  Xiaogang Wang,et al.  Deep Learning Face Attributes in the Wild , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Max Welling,et al.  Semi-supervised Learning with Deep Generative Models , 2014, NIPS.

[30]  Matthias Bethge,et al.  A note on the evaluation of generative models , 2015, ICLR.