Cscore: A Novel No-Reference Evaluation Metric for Generated Images

The development of deep learning advances the field of image processing. In recent years, lots of methods have made out- standing achievements in the domain of text-to-image synthesis, like Generative Adversarial Networks (GANs). Until now, although some evaluation metrics has been proposed to measure the performance of GANs in text-to-image synthesis, the quality of these evaluation metrics has always been controversial. At present, there is no widely used evaluation metric to judge the quality of generated image. In this paper, a novel No-Reference image quality evaluation metric is proposed, which can be used to get a score for each generated image produced by deep learning without referring to the real image. This evaluation metric can provide a new way to verify the quality of complex networks by judging the quality of generated images retroactively.

[1]  Alexei A. Efros,et al.  Context Encoders: Feature Learning by Inpainting , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Alan C. Bovik,et al.  Image information and visual quality , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[3]  Zhou Wang,et al.  Image Quality Assessment: From Error Measurement to Structural Similarity , 2004 .

[4]  Dimitris N. Metaxas,et al.  StackGAN: Text to Photo-Realistic Image Synthesis with Stacked Generative Adversarial Networks , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[5]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[6]  Gustavo de Veciana,et al.  An information fidelity criterion for image quality assessment using natural scene statistics , 2005, IEEE Transactions on Image Processing.

[7]  Xin Zhou,et al.  Infrared small-target detection using multiscale gray difference weighted image entropy , 2016, IEEE Transactions on Aerospace and Electronic Systems.

[8]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[9]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[10]  Rishi Sharma,et al.  A Note on the Inception Score , 2018, ArXiv.

[11]  Hao Li,et al.  High-Resolution Image Inpainting Using Multi-scale Neural Patch Synthesis , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Pietro Perona,et al.  The Caltech-UCSD Birds-200-2011 Dataset , 2011 .

[13]  Wojciech Zaremba,et al.  Improved Techniques for Training GANs , 2016, NIPS.